The Visitor in Listing 3 produces a map that associates each external page with a list of internal pages that link to it.
清单3中的Visitor 生成一个映射,将每一个外部页面与链接它的一组内部页面相关联。
Tip: If you want to only crawl internal pages (and have them in your HTML map), uncheck “Check External Links” when adding your URL to crawl
提示:如果你只想抓取内部页面(并包含在HTML地图中),在添加要抓取的URL时取消选择“检查外部地址(Check External Links)”
Your internal pages will not appear in the search engine index without the proper linking structure to internal pages for the spider to follow.
如果链接结构没有遵循规则,你的内部页面是不会被索引到的。
Your internal pages will not appear in the search engine index without the proper linking structure to internal pages for the spider to follow.
如果链接结构没有遵循规则,你的内部页面是不会被索引到的。
应用推荐