For instance, many babies are perfectly proficient crawlers, but they decide to try walking because there's more to see and do when they stand upright.
例如，许多婴儿都能非常熟练地爬行，但他们却决定尝试行走，因为当他们站直时，有更多的东西能看和做。
Making the sitemap accessible to crawlers.
使站点地图能被爬虫程序访问。
This helps customers and search engine crawlers.
该页面对客户和搜索引擎都是有所帮助的。
Other useful specialized crawlers include Web site checkers.
其他有用的专用爬虫包括Web站点检查器。
Automation detection - Detecting bots, crawlers, scanners and other surface malicious activity.
自动检测——对机器人、爬虫、扫描及其他恶意行为进行检测。
In the search admin portlet, create your collection, and configure your crawlers and taxonomies.
在搜索管理Portlet中，创建集合，并配置爬网程序和分类。
Keep in mind when optimizing a web page crawlers are basically only looking at your source code.
当你优化一个网站的时候时刻谨记爬行程序主要查看你的源代码。
The final step is to allow this XML document to be made accessible to crawlers through a Web server.
最后一步需要使爬虫程序能通过Web服务器访问这个XML文档。
The walkers moved faster than the crawlers but meandered—a good strategy for exploring new territory.
步行者比爬行者运动的要快，但是曲折前进---一种探索新领域的好策略。
Together, these tactics should help you give search engine crawlers a better idea of your exact location.
总得来说，这些办法应该能够帮助你让搜索引擎爬虫对你的确切地址有一个更好的了解。
Analysis is made of the loading on the crawlers under normal conditions and steering torque resistance.
对履带在普遍状态下的受力情况及其转向阻力矩进行了分析。
This classic text based browser shows us just the text - just what the search engines crawlers will see.
这款经典的文本浏览器只显示了文本—就是网络蜘蛛所看到的。
The content of the different search collections might be slightly out-of-sync while crawlers are running.
在爬网程序运行时，不同搜索源的内容可能会稍微失去同步。
Yet how these hairy crawlers negotiate steep, slippery surfaces has been a tangled web for arachnologists.
不过这些毛绒绒的蜘蛛如何在或陡峭或湿滑的表面上立足，一直令蜘蛛学家们颇为费解。
There are also a number of non-traditional uses for crawlers, such as archiving content or generating statistics.
爬虫也有一些非传统的用途，例如对内容进行归档或生成统计数据。
On each server, the scheduler will start the crawlers, and the collections will be updated to have the same content.
在每个服务器上，调度程序将启动爬网程序，并且将对集合进行更新以使其具有相同的内容。
These crawlers look for missing content, validate all links, and ensure that your Hypertext Markup Language (HTML) is valid.
这些爬虫会查找缺少的内容、验证所有的链接，并会确保超文本标记语言（HTML）是有效的。
What can you do with earthworms? Some people use the creepy crawlers to catch fish. But others put worms to work making compost.
蚯蚓可以用来做什么？有人用这种爬虫做鱼饵钓鱼。但也有人使用这种蚯蚓来制作堆肥。
A site map is useful to facilitate deep crawling so that crawlers can easily visit and index pages deeply embedded within the site.
站点地图对于爬网深度是非常有用的，它使爬行器能够轻松地访问并建立深嵌于该站点内的页面的索引。
Topic crawler based on dynamic topic base was proposed by studying on topic crawlers which filter URLs based on different strategies.
通过对基于不同策略过滤url的主题爬虫的研究，提出了一种基于动态主题库的主题爬虫。
In this case, the Ares I-X took a ride on one of two crawlers built to carry around the Saturn V rockets that sent astronauts to the moon.
这一次，战神一号X型乘坐的“战车”就是那时的两辆履带车之一，当年它运送的土星v火箭把宇航员送上了月球。
E-mail harvesting crawlers search Web sites for E-mail addresses that are then used to generate the mass of spam that we all deal with each day.
这种爬虫会在Web站点上搜索e - mail地址，然后生成我们每天不得不处理的大量垃圾邮件。
Search engines rely on programs known as crawlers (or spiders) that gather information by following the trails of hyperlinks that tie the Web together.
搜索引擎使用一种称为搜寻器(或称蜘蛛机器人)的自动程序随着将网页连接一起的超级链接的足迹来收集资料。
Using Portal Search, administrators can define content source crawlers which use the HTTP protocol to crawl and index Web sites or content repositories.
使用PortalSearch，管理员可以定义内容源爬网程序，爬网程序使用HTTP协议来抓取Web站点或内容存储库并为其建立索引。
As described above, Portal Search includes a scheduler to start the crawlers and the index maintenance process that removes outdated documents and broken links.
如前所述，PortalSearch包括用来启动爬网程序和索引维护处理的调度程序，其中索引维护处理可以删除过时的文档和断开的链接。
So if you're a small business that relies on local search traffic, it's a good idea to make sure search engine crawlers have a good sense of where you're located.
所以，如果你经营着一家依赖本地搜索流量的小企业，那么，明智的办法就是设法确保搜索引擎爬虫知道你在哪里。
Sitemaps 0.90 is a simple and intuitive way for webmasters to provide the right level of information to Web crawlers so that they can efficiently crawl a Web site.
Sitemaps 0.90为Web 站点管理员提供了简单而且直观的方法，使他们可以向web爬虫程序提供正确的信息，从而使爬虫程序能够高效地爬行某个 Web 站点。
If this pattern continues, crawlers are squeezed between the dual pressures of maintaining acceptable crawling performance while gathering constantly-increasing volumes of information.
如果这种模式继续下去的话，爬虫程序会受到双重的压力，在维持可接受的爬行性能的同时又要聚集不断增加的信息量。
Also known as "invisible web", the term "deep web" refers to a vast repository of underlying content, such as documents in online databases that general-purpose web crawlers cannot reach.
“深网”也被称做“隐形网”，指的是网络中存储数量浩繁的基本信息的空间，例如存储于在线数据库中的文件，一般用途的网络搜索器是找不到这些文件的。
应用推荐