[Home]ToothyWikiInternals/CrawlerSightings

ec2-3-80-4-76.compute-1.amazonaws.com | ToothyWiki | ToothyWikiInternals | RecentChanges | Login | Webcomic

Things wot have crawled over toothycat.net recently




Googlebot/2.1 - data used by [Google] for the obvious purpose

http://www.almaden.ibm.com/cs/crawler - no idea what they're going to use the data for

ia_archiver - The [Internet Archive] is preserving toothycat.net for posterity (although we don't seem to have been added to the database yet).

NPBot - AIUI, [these] people crawl your site looking for trademarked stuff; they then notify the trademark owner so the owner can sue you if you don't have permission to use the trademarked stuff, and NP presumably gets a cut. MoonShadow is wondering about blocking this one.


ec2-3-80-4-76.compute-1.amazonaws.com | ToothyWiki | ToothyWikiInternals | RecentChanges | Login | Webcomic
Edit this page | View other revisions | Recently used referrers
Last edited February 21, 2003 12:20 pm (viewing revision 2, which is the newest) (diff)
Search: