It should be noted that while Lucene is a search engine, it has no crawling capability.

需要注意的是，虽然Lucene是一个搜索引擎，但它没有爬行能力。

youdao

There's currently no way for you to manually remove URLs from this report; they will drop out naturally over time as we stop crawling URLs that repeatedly 404.

目前你无法从这个报告中手动删除网址；当我们停止抓起那些一直出现404错误的网页时，他们将会在未来消失。

youdao

Making mistakes in the robots.txt file accidentally disallow spiders from crawling through the entire site, resulting in no indexed pages.

txt文件中的偶然失误会禁止“蜘蛛(spider)”爬过整个站点，最后导致没有建立页面的索引。

youdao

Well, imagine no more: AvP offers wall-crawling gameplay and complements it with an actual upside-down or sideways viewpoint.

CNN: Preview: Aliens vs. Predator

Over the past six years, no product caused more injuries than Leap Frog playgrounds, a toy that prior to its 2006 recall left crawling children susceptible to scrapes and bruises.

FORBES: Magazine Article