n. 爬行者,爬行动物
网络 爬虫; 爬行者; 网络爬虫
Maximum database size for crawler 2GB 2GB
爬虫的最大数据库大小 2GB 2GB
Use a site map to lead the crawler around your site.
使用站点地图引导爬行器遍历您的站点。
Define the crawler subdirectories, as illustrated in Figure 8.
定义爬虫子目录,如图8所示。
This article took you through the task of creating a Web crawler by.
本文向您介绍了创建Web crawler的过程。
Notice also that only the base URI string is added to the crawler.
另外请注意,只有基 URI 字符串被添加到了 crawler。