Use a site map to lead the crawler around your site.
使用站点地图引导爬行器遍历您的站点。
Define the crawler subdirectories, as illustrated in Figure 8.
定义爬虫子目录，如图8所示。
Notice also that only the base URI string is added to the crawler.
另外请注意，只有基URI字符串被添加到了 crawler。
The next step is to make a sample announcement document available to the crawler.
下一步是为爬行器提供一个样例通知文档。
Select UNIX file system as the crawler type, as shown in Figure 6, and then click on the Next button.
选择UNIXfilesystem作为爬虫类型，如图6 所示，然后单击Next 按钮。
Thread count: the number of concurrent working threads in the crawler.
线程数：在爬虫软件并发工作线程的数量。
The Sitemaps 0.90 protocol offers the option of a Sitemaps index file to be provided to the crawler as well.
Sitemaps 0.90提供了一个选项，可以把Sitemapsindex文件提供给爬虫程序。
Next, navigate to the crawler details page and click 'Start full recrawl', as shown at the bottom of Figure 3.
接下来，导航到爬行器的细节页面并单击“Startfull recrawl”，如图3底部所示。
Analyse bearing structure with the crawler, its feasibility for variant bearing structure in variant pattern machine.
分析履带行走机构支重结构，在各机型中使用不同支重结构的可行性。
Define the crawler name (UNIX file system crawler 1, for example), as shown in Figure 7, and then click on the Next button.
定义爬虫名称(例如，UNIXfilesystemcrawler1)，如图7所示，然后单击Next按钮。
In the crawler crane of the present invention, moreover, it is possible to improve the transportability because the width of the upper rotating body can be shortened.
此外，本发明的履带式起重机能够使上部旋转体的横宽尽可能地小，所以能够提高输送性。
You can see that the home page has already been fetched and indexed, and the crawler is working on fetching and indexing the pages that have been linked directly from it.
从图中可以看到已经获取并索引了主页，程序现在的工作是获取和索引直接从该主页链接出的页面。
An effective site map is built as a high level overview of the different pages in the site and presents a large list of links to the crawler in as few pages as possible.
高效站点地图将会构建为站点中不同页面的简要概述，并且会在尽可能少的页面中为爬网程序呈现大量的链接的列表。
Thus the efficiency of site crawls provides relief to both sides: the hosting Web server and the crawler as well, by keeping the number of GET requests for pages at a minimum.
这样，站点爬行的效率为两边都减轻了负担：宿主Web服务器和爬虫程序，方法是把GET页面请求数量保持在最小值。
The behavior policies define which pages the crawler will bring down to the indexer, how often to go back to a Web site to check it again, and something called a politeness policy.
这种行为策略定义了爬虫会将哪些页面带入索引程序、以什么样的频率回到Web站点上再次对它进行检查，以及一种礼貌原则。
In other words, before you show the actual contact form, have your street address, city, state, ZIP, local phone, etc. at the top of the page where the crawler will get to it quickly.
换句话说，在你展示实际的联系表单之前，将你的街道地址、城市名称、州名称、邮政编码以及本地电话等等放在该页的最上方，那里搜索引擎爬虫将很快地访问到。
The crawler type water magnetizing device is characterized in that the water magnetizing device comprises a soft belt on which a plurality of bar magnets are mounted.
履带式磁化水装置，其特征在于其包括软带，软带上安装若干条形磁铁。
Bathed in xenon spotlights, the white spaceship, attached to its twin solid rocket boosters and orange external fuel tank, crept 3.4 miles on the back of an enormous tractor called the Crawler.
沐浴着氙气聚光灯光，白色的飞船，带着一对固体火箭推进器和橙色外挂燃料箱，在称为“爬行者”的巨大拖拉机上缓慢行驶了3.4英里。
Bathed in xenon spotlights, the white spaceship, attached to its twin solid rocket boosters and orange external fuel tank, crept 3.4 miles on the back of an enormous tractor called the Crawler.
沐浴着氙气聚光灯光，白色的飞船，带着一对固体火箭推进器和橙色外挂燃料箱，在称为“爬行者”的巨大拖拉机上缓慢行驶了3.4英里。
应用推荐