Robot crawl

Hi,

How to reduce bot from keep crawl more that 3 minute? When this robot crawl with multiple ip, our website going high as we use cloudl… | Read the rest of http://www.webhostingtalk.com/showthread.php?t=1742998&goto=newpost