Have you ever wanted to be able to know for sure if a web spider from Google, Yahoo, Bing etc. has crawled your site? Sure you have! But web spiders these days are getting intelligent and are not leaving a sure footprint of who they are. Here at CrawlerSpy we take a Community approach taking non-identifying aggregate information of our users who decide to install our Wordpress Plug-in, and perform advanced heuristic analysis and when we detect a possible spider we send information on that spider to a central server for further analysis. Only when we are confident we have successfully detected a spider do we add that ip to our master database. Access our Database how you require. Available formats are CSV, Flat Text which are updated every 2 hours, or use our realtime lightning fast RESTful API.
AddBlogUrl.com is a social news and bookmarking website that is powered by and for users like you. And oh, we also share 100% Adsense Revenue with you.
Comments