Each search engine has its own automated program called a "web spider" or "web crawler" that crawls the web.

每个搜索引擎都有自己爬行网页的自动化程序，叫做“网络蜘蛛（web spider）”或“网络爬虫（web crawler）”。

youdao

As the core of the search engines, web spider laid the foundation for it.

而网络爬虫作为搜索引擎核心部分，为搜索引擎的功能实现奠定了基石。

youdao

Finally summary and forecast of the parallel web spider are also introduced.

最后对并行网络爬虫做了总结和展望。

youdao

The search engine's Web-crawling spider now keeps an eye out for viruses and malware as it combs the Web, and shows users a warning page before allowing them to access malicious sites.

FORBES: Made For Hacking

It's basically a pound cake with a spider web on top of the glaze.

NPR: Author Shares Tricks And Treats For All

The Spaniards advance the ball in a series of triangles pieced together like an intricate spider web.

WSJ: La Roja: How Spain Became the World's Best Soccer Team