Broken links also bring search engine crawlers to a halt.
损坏的链接也会使搜索引擎停止运行。
However, crawlers don't care about these; they ignore (and should!)
然而，爬虫程序却对此漠不关心；他们忽略了(不应该忽略！)
Therefore, the defined crawlers and the maintenance process might not be running.
因此，已定义的爬网程序和维护处理可能不会运行。
Very simply, a slow loading page puts off both human visitors and search engine crawlers.
很简单，把一个网页下载速度慢了人力访客和搜索引擎抓取工具。
Very simply, a slow loading page puts off both human visitors and search engine crawlers.
很简单，把一个网页下载速度慢了人力访客和搜索引擎抓取工具。
应用推荐