According to the pitch, 80legs makes use of the Plura system and can crawl up to two billion pages a day using a 50,000 node supercomputer.
根据公司自己的介绍,80legs利用了Plura系统,动用了5万个节点的超级计算机,每天能抓取20亿个页面。
According to the pitch, 80legs makes use of the Plura system and can crawl up to two billion pages a day using a 50,000 node supercomputer.
根据公司自己的介绍,80legs利用了Plura系统,动用了5万个节点的超级计算机,每天能抓取20亿个页面。
应用推荐