我们的搜索索引不会收录含有太多无效视频链接或低质量视频的网站。

If a site has too many non-working video links or page after page of video spam, the site won't be included in the search index.

youdao

还要注意的是，else语句是必需的，因为调用Free会使下次对同一组件索引的检验变成无效检验。

Also note that the else statements are needed, since a call to Free will make the next check to the same component index an invalid check.

youdao

如果你删掉了一个页面或者网站的部分内容，你可以通过修改robot . txt预防蜘蛛爬行和索引那些无效链接。

If you've removed a page or section, you can use the robot.txt to prevent the spiders crawling and indexing the broken links.

youdao