有助于为爬网程序优化站点的整个结构,通过提供备用的We b页面组,从而使爬网程序能够快速地访问大量的嵌入式页面并针对这些页面建立索引。
Helps to optimize the entire structure of the site for a crawler by providing an alternate set of Web pages so that crawlers can quickly access and index a large number of embedded pages.
有助于为爬网程序优化站点的整个结构,通过提供备用的We b页面组,从而使爬网程序能够快速地访问大量的嵌入式页面并针对这些页面建立索引。
Helps to optimize the entire structure of the site for a crawler by providing an alternate set of Web pages so that crawlers can quickly access and index a large number of embedded pages.
应用推荐