Softbytelabs.com
Author
Discussion

BliarOut

Original Poster:

72,863 posts

270 months

Tuesday 30th January 2007
quotequote all
Noticed this lot crawling my site..... They seem to sell some sort of content slurper. Should I block them? And while I'm on about it, is there a list of domains you really don't want crawling all over your site?