Google's beta program, called Sitemaps (see Resources), costs nothing and provides several ways to tell Google's spider where your pages are.

Google的beta程序称为Sitemaps(参见参考资料)，它是免费的，提供几种向Google爬行器通知页面位置的方法。

youdao

In addition, each page can encode a robots tag that instructs the spider about whether to index that page and follow links from it. (See Resources.)

另外，每个页面都可以有一个robots标记，它指示爬行器是否将这个页面编入索引，以及是否沿着其中的链接前进(参见参考资料。)

youdao

And we certainly didn't have access to modern medical resources. There was no doctor my mother could bring me to see about my spider bite.

当然也没有先进的现代医疗资源，也没有一个医生可以来帮我处理蜘蛛咬伤的伤口。

youdao