Newer protocols, such as SOAP, make spidering much easier and less intrusive to normal Web operations.

一些新的协议，例如SOAP，会让爬行对于普通的Web操作来说更为容易，并且所受的干扰更小。

youdao

"For those that do it right it's a big deal, " says Scott Silverman, Shop.org's executive director, who cited Circuit City and Sears as chains that have effectively merged store and Web operations.

FORBES: Web Shoppers Tapping The Brakes

This is the way large web operations such as Google and Facebook manage Internet-scale data processing, although the Web players tend to take a do-it-yourself approach based on internally developed or open-source software.

FORBES

If this is to work it is going to need a change of culture, from one where the government viewed its web operations as something to be farmed out to some giant suppliers and forgotten, to something far more responsive.

BBC: All right gov? Can government do the web?