-
So Schoemaker says he sets his web pages to automatically display legitimate content to the Google spider, while giving other users the ad-filled arbitrage page.
FORBES: Bitten By The Google Spider
-
That's not a problem, Koppula says, because supplemental results are no less legitimate than normal results, and pages in the supplemental index aren't checked any less frequently by Google's spider.
FORBES: Magazine Article
-
Asked if the supplemental index is getting bigger, he responds that "new pages are constantly being added, " but that the "algorithmic nature" of Google's spider makes it hard to measure the index's size or how fast it's growing.
FORBES: Magazine Article