Blocking USA traffic without blocking search engine bots?

美国交通阻塞不阻止搜索引擎机器人？

youdao

The post advises website owners who are blocking Google's search bot software known as Googlebot from crawling their RSS/Atom feeds to unblock it via their robots.txt file.

该文章建议阻止Googlebot （Google的搜索机器人软件）爬虫收录网站RSS/Atom feeds的站长们通过robots.txt文件解除爬虫限制。

youdao

The data's release came as measures to attempt to curb illegal downloading began to take hold, such as the blocking of popular piracy websites and the relegation and removal of search results from Google.

BBC: A glimpse at piracy in the UK and beyond