Use a site map to lead the crawler around your site.
使用站点地图引导爬行器遍历您的站点。
Define the crawler subdirectories, as illustrated in Figure 8.
定义爬虫子目录，如图8所示。
These factors make the crawler a complex component of the system.
这些因素使得抓取工具对系统复杂的部分。
Notice also that only the base URI string is added to the crawler.
另外请注意，只有基URI字符串被添加到了 crawler。
Can I control the crawler request rate from Ask spider to my site?
我能控制爬虫请求率从问蜘蛛到我的地点吗？
Thread count: the number of concurrent working threads in the crawler.
线程数：在爬虫软件并发工作线程的数量。
Click on the Edit button in the query_statistic line to move to the crawler TAB.
单击query_statistic行的Ededit按钮，移向爬虫选项卡。
The crawler works with multiple threads to fetch URLs from the crawler queue.
爬虫软件使用多个线程从队列爬虫获取url。
The next step is to make a sample announcement document available to the crawler.
下一步是为爬行器提供一个样例通知文档。
The oven is arch structure design and the substrates are carried by the crawler.
烘箱采用拱形结构设计，必履带输送基材。
And to the ground more air dust, and vulnerable to the crawler, mice, pet damage.
而且贴近地面的空气多尘土，也容易受到爬虫、老鼠、宠物的侵害。
Analysis the welding industry structure of the machining process of the crawler excavator.
对目前履带作为液压挖掘机行业中焊接结构件的机械加工工艺进行了分析。
The following steps show you how to create the collection and the crawler, and to get it started
以下步骤演示如何创建集合和爬虫，准备开始
Select UNIX file system as the crawler type, as shown in Figure 6, and then click on the Next button.
选择UNIXfilesystem作为爬虫类型，如图6 所示，然后单击Next 按钮。
The solution method is described in this paper and also the briefs of ray source shooting on the crawler.
文中介绍了解决这些问题的方法，并对用装在管道爬行器上的射线源拍片的方法作了简单介绍。
The Sitemaps 0.90 protocol offers the option of a Sitemaps index file to be provided to the crawler as well.
Sitemaps 0.90提供了一个选项，可以把Sitemapsindex文件提供给爬虫程序。
Next, navigate to the crawler details page and click 'Start full recrawl', as shown at the bottom of Figure 3.
接下来，导航到爬行器的细节页面并单击“Startfull recrawl”，如图3底部所示。
Analyse bearing structure with the crawler, its feasibility for variant bearing structure in variant pattern machine.
分析履带行走机构支重结构，在各机型中使用不同支重结构的可行性。
Define the crawler name (UNIX file system crawler 1, for example), as shown in Figure 7, and then click on the Next button.
定义爬虫名称(例如，UNIXfilesystemcrawler1)，如图7所示，然后单击Next按钮。
If the crawler plate bolts loose to continue operating the machine will track bolts and gaps between panels, which led to track Crack plate.
若在履带板螺栓松动的情况下继续运转机器，会使螺栓和履带板之间产生间隙，进而导致履带板的裂纹。
Altogether, the Ares I-X rocket, its Mobile Launch Platform and the crawler-transporter itself weigh about 16 million pounds (7.2 million kg).
“战神i - X”火箭重180万磅(816 466公斤)，加上的它的移动发射平台和履带式运输车，总重达1600万英镑(720万公斤)。
The structure of the reference the same track basic parameters of the crawler tractor, design the structure and size of crawler, make whole design are optimized.
履带的结构同样参考了履带拖拉机的基本参数，设计了履带的结构和尺寸，使整个设计得到了优化。
The trip from the Vehicle Assembly Building to the launchpad takes about five hours, and the crawler burns about 150 gallons (570 liters) of diesel fuel every mile.
此短途运行，从装配大楼到发射基地，需时约5个小时，以及运输履带车烧掉约150加仑（ 570公升）的柴油每英里。
The crawler type water magnetizing device is characterized in that the water magnetizing device comprises a soft belt on which a plurality of bar magnets are mounted.
履带式磁化水装置，其特征在于其包括软带，软带上安装若干条形磁铁。
An effective site map is built as a high level overview of the different pages in the site and presents a large list of links to the crawler in as few pages as possible.
高效站点地图将会构建为站点中不同页面的简要概述，并且会在尽可能少的页面中为爬网程序呈现大量的链接的列表。
You can see that the home page has already been fetched and indexed, and the crawler is working on fetching and indexing the pages that have been linked directly from it.
从图中可以看到已经获取并索引了主页，程序现在的工作是获取和索引直接从该主页链接出的页面。
Thus the efficiency of site crawls provides relief to both sides: the hosting Web server and the crawler as well, by keeping the number of GET requests for pages at a minimum.
这样，站点爬行的效率为两边都减轻了负担：宿主Web服务器和爬虫程序，方法是把GET页面请求数量保持在最小值。
The behavior policies define which pages the crawler will bring down to the indexer, how often to go back to a Web site to check it again, and something called a politeness policy.
这种行为策略定义了爬虫会将哪些页面带入索引程序、以什么样的频率回到Web站点上再次对它进行检查，以及一种礼貌原则。
The behavior policies define which pages the crawler will bring down to the indexer, how often to go back to a Web site to check it again, and something called a politeness policy.
这种行为策略定义了爬虫会将哪些页面带入索引程序、以什么样的频率回到Web站点上再次对它进行检查，以及一种礼貌原则。
应用推荐