I've just taken the rather extreme measure of banning two complete IP ranges belonging to the notorious Chinese search engine 'Baidu'.
It was indexing the site pretty much 24/7 from 20 or 30 different IP addresses concurrently and sucking up our bandwidth and had ignored 'polite' methods of requesting it to stop (robots.txt). At any moment in time about 30 of the 'guests' online were in fact this search engine.
So apologies to anyone in China who might not find the site listed on Baidu any more, but the site feels perkier already!
Alex
It was indexing the site pretty much 24/7 from 20 or 30 different IP addresses concurrently and sucking up our bandwidth and had ignored 'polite' methods of requesting it to stop (robots.txt). At any moment in time about 30 of the 'guests' online were in fact this search engine.
So apologies to anyone in China who might not find the site listed on Baidu any more, but the site feels perkier already!
Alex