At the same time, Web crawler developers work to create new crawling approaches that account for the ever-increasing complexity of Web pages, often with impact on their processing speed.

与此同时，web爬虫程序开发人员努力创建新的爬行方法以应对日益复杂的web页面，因为复杂的web页面常常会影响页面的处理速度。

youdao

For the mass number of web pages needed to be crawled, how the information crawling system gets more web pages with good quality effectively, is related to the system performance.

信息采集系统需要采集的页面数量非常浩大，如何有效地采集到高质量的网页关乎系统性能。

youdao

The experiments verified efficiency of web crawling and accuracy of pages classification. Additionally, we describe an incremental update crawler system in Deep Web.

并通过实验证明，该方法具有网页抓取的高效性以及页面分类的准确性。

youdao

The search engine's Web-crawling spider now keeps an eye out for viruses and malware as it combs the Web, and shows users a warning page before allowing them to access malicious sites.

FORBES: Made For Hacking

It will be a free site that uses algorithms to build profiles based on users' preexisting Web-crawling information.

FORBES: Social Slingers

Webaroo's computer scientists in Mumbai and New Delhi cranked out dozens of Web-crawling algorithms that decipher the necessary and truly informative stuff.

FORBES: Narrow Your Horizons