The Google spider will choke on a meta refresh redirect and a 302 redirect can cause duplicate content penalties.

Google爬行器会由于元刷新重定向而阻塞，而302重定向会导致重复内容处罚。

youdao

Google also stretches across the web like a giant spider, with a leg in everything from online search and E-mail to social networking and web-based software applications, or apps.

谷歌也在互联网上大举扩张，就像一只巨型蜘蛛，触脚遍及网络搜索、电子邮件、社交网络及网络软件应用。

youdao

So Schoemaker says he sets his web pages to automatically display legitimate content to the Google spider, while giving other users the ad-filled arbitrage page.

FORBES: Bitten By The Google Spider

That's not a problem, Koppula says, because supplemental results are no less legitimate than normal results, and pages in the supplemental index aren't checked any less frequently by Google's spider.

FORBES: Magazine Article

Asked if the supplemental index is getting bigger, he responds that "new pages are constantly being added, " but that the "algorithmic nature" of Google's spider makes it hard to measure the index's size or how fast it's growing.

FORBES: Magazine Article