List of User Agent Strings -> Robots (crawlers)

UA database includes detailed information about ever single robots (crawlers).
 
Robots (crawlers) IP Address
 

Robots (Crawlers)	Last seen	bot URL	Producer URL
MSNBot	2013-06-18 08:51:09	UP	UP
MJ12bot	2013-06-18 08:47:27	UP	UP
bingbot	2013-06-18 08:46:35	UP	UP
Googlebot	2013-06-18 08:44:44	UP	UP
AhrefsBot	2013-06-18 08:40:35	UP	UP
SeznamBot	2013-06-18 08:22:46	UP	UP
Genieo Web filter	2013-06-18 08:20:43	UP	UP
magpie-crawler	2013-06-18 08:08:13	UP	UP
proximic	2013-06-18 07:45:01	UP	UP
Exabot	2013-06-18 07:41:05	UP	UP
Ezooms	2013-06-18 07:31:11		UP
AddThis.com	2013-06-18 07:08:30		Down
YandexBot	2013-06-18 07:05:34	Down	UP
Baiduspider	2013-06-18 07:02:59	UP	UP
psbot	2013-06-18 05:38:26	UP	UP
ia_archiver	2013-06-18 05:21:04	UP	UP
sogou spider	2013-06-18 05:07:02	UP	UP
ShopWiki	2013-06-18 04:52:22	UP	UP
coccoc	2013-06-18 04:38:08	UP	UP
Yahoo!	2013-06-18 04:35:46	UP	UP
Woko	2013-06-18 04:16:09	UP	UP
ExB Language Crawler	2013-06-18 03:10:39	UP	UP
AcoonBot	2013-06-18 01:00:03	UP	UP
MetaJobBot	2013-06-17 23:22:39	UP
Wotbox	2013-06-17 23:20:56	UP	UP
GrapeshotCrawler	2013-06-17 23:03:31	UP	UP
SEOENGBot	2013-06-17 21:18:35	UP	UP
Spinn3r	2013-06-17 19:18:11	UP	UP
ZumBot	2013-06-17 17:18:26	UP	UP
linkdex.com	2013-06-17 16:59:12		UP
LinkAider	2013-06-17 13:19:03	UP	UP
ChangeDetection	2013-06-17 09:45:32	UP	UP
Gigabot	2013-06-17 06:17:24	UP	UP
aiHitBot	2013-06-17 05:28:43		UP
Sosospider	2013-06-17 02:42:14	UP	UP
archive.org_bot	2013-06-16 21:20:45	UP	UP
CareerBot	2013-06-16 20:50:44	UP	UP
Infohelfer	2013-06-16 20:17:26	UP	UP
findlinks	2013-06-16 16:01:10	UP	UP
oBot	2013-06-16 12:00:37	UP	UP
ichiro	2013-06-16 06:53:02	UP	UP
yacybot	2013-06-16 06:27:53	UP
UnisterBot	2013-06-16 04:52:49		UP
NaverBot	2013-06-16 02:31:56	UP	UP
uMBot-FC	2013-06-15 23:05:06		UP
FacebookExternalHit	2013-06-15 21:35:26	UP	UP
sistrix	2013-06-15 21:33:14	UP	UP
SemrushBot	2013-06-15 05:11:41	UP	UP
Netseer	2013-06-14 20:43:03	UP	UP
netEstate Crawler	2013-06-14 19:09:44		UP
bitlybot	2013-06-14 11:01:32	UP	UP
Vagabondo	2013-06-14 10:53:29	UP	UP
Daumoa	2013-06-14 08:48:32	UP	UP
webmastercoffee	2013-06-14 07:55:15	UP	UP
BacklinkCrawler	2013-06-14 01:48:14	UP	UP
rogerbot	2013-06-12 23:37:31	UP	UP
Butterfly	2013-06-12 23:30:44	Down	UP
ShowyouBot	2013-06-12 23:30:43
spbot	2013-06-12 16:54:17	UP	UP
VoilaBot	2013-06-12 16:13:14		UP
Mail.Ru bot	2013-06-12 16:12:03	UP	UP
80legs	2013-06-12 11:45:10	UP	Down
ownCloud Server Crawler	2013-06-12 09:41:38		UP
Yahoo! JAPAN	2013-06-12 08:12:53	UP	UP
Qualidator.com Bot	2013-06-11 17:14:00	UP	UP
TurnitinBot	2013-06-11 15:36:55	UP	UP
trendictionbot	2013-06-11 14:35:29	Down	UP
GeliyooBot	2013-06-10 09:59:11		UP
Peeplo Screenshot Bot	2013-06-10 00:50:21
CompSpyBot	2013-06-09 22:26:18	UP	UP
QuerySeekerSpider	2013-06-09 12:52:28	UP	UP
PaperLiBot	2013-06-09 12:31:13	UP	UP
Crowsnest	2013-06-09 12:26:51		UP
UnwindFetchor	2013-06-09 12:20:28		UP
CirrusExplorer	2013-06-09 11:58:56	UP	UP
WBSearchBot	2013-06-09 06:27:15	UP	UP
NetcraftSurveyAgent	2013-06-08 06:16:47		UP
Nuhk	2013-06-06 15:13:39	Down	UP
bixocrawler	2013-06-06 15:06:05	UP	UP
Strokebot	2013-06-04 15:50:27	UP	UP
Crawler4j	2013-06-04 12:32:02	UP	UP
SearchmetricsBot	2013-06-03 23:17:01	UP	UP
ProCogSEOBot	2013-06-02 23:41:45		UP
search.KumKie.com	2013-06-01 20:07:03		UP
Falconsbot	2013-06-01 06:25:41	UP	Down
Dlvr.it/1.0	2013-05-29 13:55:30	UP	UP
thumbshots-de-Bot	2013-05-25 16:43:38	UP	UP
SEOkicks-Robot	2013-05-24 17:49:32	UP
Blekkobot	2013-05-24 03:11:53	UP	UP
Jyxobot	2013-05-23 10:31:01		UP
Najdi.si	2013-05-22 09:14:04	UP	UP
200PleaseBot	2013-05-22 08:28:44	UP	UP
Zookabot	2013-05-21 18:43:38	UP	UP
discoverybot	2013-05-21 12:27:10	UP	UP
UASlinkChecker	2013-05-17 13:45:26	UP	UP
Aboundexbot	2013-05-14 21:13:39	UP	Down
HubSpot Connect	2013-05-14 19:25:31		UP
MojeekBot	2013-05-14 18:31:20	UP	UP
woriobot	2013-05-14 10:55:54	Down
Panscient web crawler	2013-05-14 00:08:11	Down	UP
Plukkie	2013-05-13 19:53:58	UP
bot-pge.chlooe.com	2013-05-11 19:46:53	UP	UP
MetaURI API	2013-05-09 12:18:46		UP
R6 bot	2013-05-05 20:18:53	UP	UP
FlipboardProxy	2013-05-05 06:13:56	Down	UP
bl.uk_lddc_bot	2013-05-05 03:24:34	UP	UP
AraBot	2013-04-29 15:41:31		UP
iCjobs	2013-04-20 08:42:48	UP	UP
OpenindexSpider	2013-04-18 21:47:06	UP	UP
IntegromeDB	2013-04-16 14:19:46	UP	UP
SolomonoBot	2013-04-08 15:11:12	UP	UP
Grahambot	2013-04-07 05:45:38	UP	UP
Automattic Analytics Crawler	2013-04-06 03:11:51	UP	UP
emefgebot	2013-04-05 09:49:40	UP	UP
SBSearch	2013-03-29 10:18:00	UP	UP
YoudaoBot	2013-03-28 21:42:12	UP	UP
PiplBot	2013-03-28 13:11:14	UP	UP
TinEye	2013-03-26 19:21:38	UP	UP
FlightDeckReportsBot	2013-03-23 23:49:13	Down	UP
fastbot crawler	2013-03-22 08:53:41	UP	UP
4seohuntBot	2013-03-21 20:42:29	UP	UP
Updownerbot	2013-03-20 04:29:10	UP	UP
JikeSpider	2013-03-08 05:39:57	UP	UP
NLNZ_IAHarvester2013	2013-03-05 23:35:31	UP	UP
Nigma.ru	2013-03-01 12:41:40		UP
wsAnalyzer	2013-02-26 05:17:24	UP	UP
YioopBot	2013-02-12 21:58:18	UP	UP
OpenWebSpider	2013-02-09 17:22:51	UP
YodaoBot	2013-01-18 23:38:36	UP	UP
SpiderLing	2013-01-10 20:23:25	UP	UP
Esribot	2012-12-26 17:51:12		UP
Steeler	2012-12-25 14:53:33	UP	UP
Thumbshots.ru	2012-12-20 04:11:54	UP	UP
BlogPulse	2012-12-07 07:17:29	UP	UP
NextGenSearchBot	2012-12-04 09:39:01	UP	UP
bot.wsowner.com	2012-12-03 19:01:24		UP
wscheck.com	2012-12-03 19:01:10		UP
Qseero	2012-11-29 03:49:58		UP
drupact	2012-11-23 04:24:21	UP	UP
HuaweiSymantecSpider	2012-11-19 03:13:32	Down	Down
PagePeeker	2012-11-17 11:18:58	UP	UP
HomeTags	2012-11-14 10:26:52	UP	UP
facebookplatform	2012-11-13 12:11:52	UP	UP
IstellaBot	2012-11-10 18:24:26		UP
Browsershots	2012-11-05 23:12:11	UP	UP
Pixray-Seeker	2012-11-01 09:49:40	UP	UP
BDFetch	2012-10-19 16:49:35		UP
MeMoNewsBot	2012-10-12 14:12:11	UP	UP
ProCogBot	2012-10-11 17:11:37	UP	UP
WillyBot	2012-10-03 04:12:11	UP	UP
peerindex	2012-10-03 00:39:35		UP
Job Roboter Spider	2012-10-02 02:35:00	UP	UP
MLBot	2012-09-24 03:33:37	UP	UP
WebNL	2012-09-24 02:44:07	UP	UP
Peepowbot	2012-09-22 14:03:42	UP	Down
Semager	2012-09-20 21:40:55	UP	UP
MIA Bot	2012-09-15 00:47:15	UP	UP
Eurobot	2012-09-10 06:44:50	Down	UP
DripfeedBot	2012-09-09 17:49:54	UP	UP
webinatorbot	2012-09-05 09:43:06		UP
Whoismindbot	2012-09-05 08:14:11	UP	UP
Bad-Neighborhood	2012-08-31 14:16:24	UP
Hailoobot	2012-08-31 12:18:48	UP	UP
akula	2012-08-15 01:11:41	Down	UP
MetamojiCrawler	2012-08-07 21:42:21	UP	UP
Page2RSS	2012-07-22 16:27:05		UP
EasyBib AutoCite	2012-07-22 14:13:33	UP	UP
suggybot	2012-07-20 20:18:42	UP	UP
NerdByNature.Bot	2012-07-14 13:55:32	UP	UP
EventGuruBot	2012-07-09 05:30:03	Down
quickobot	2012-07-01 15:15:07	UP	UP
FyberSpider	2012-06-18 10:30:53	UP	UP
gonzo	2012-05-28 23:25:19	UP	UP
CCBot	2012-05-24 16:38:11	UP	UP
bnf.fr_bot	2012-05-07 18:30:07	Down	UP
UptimeRobot	2012-05-06 12:01:52	UP	UP
Speedy	2012-05-06 07:05:46	Down	UP
Influencebot	2012-05-01 06:29:02	UP
MSRBOT	2012-04-26 11:45:03	UP	UP
KeywordDensityRobot	2012-04-25 20:04:12	UP	UP
heritrix	2012-04-17 04:51:15	UP	UP
Ronzoobot	2012-04-16 04:18:09	Down
RyzeCrawler	2012-04-12 02:14:11	UP	UP
ScoutJet	2012-04-10 04:03:28	UP	UP
Twikle	2012-04-06 04:12:26		UP
SWEBot	2012-04-04 06:15:37	Down	Down
RADaR-Bot	2012-03-23 14:05:16	UP	UP
DCPbot	2012-03-19 12:18:45	UP	UP
Castabot	2012-03-16 14:42:26
percbotspider	2012-03-14 19:20:42		UP
WeSEE:Search	2012-03-12 04:12:42	UP	UP
CatchBot	2012-03-08 10:42:05	Down	UP
imbot	2012-03-08 08:00:22		UP
EdisterBot	2012-03-06 17:53:00	Down	UP
WASALive-Bot	2012-03-04 14:06:28	UP	UP
Accelobot	2012-03-02 17:27:56	UP	UP
PostPost	2012-02-09 08:50:35	UP	UP
factbot	2012-02-01 04:12:46	UP	UP
Setoozbot	2011-12-16 15:15:38	Down	UP
biwec	2011-12-15 10:02:01	UP	UP
GarlikCrawler	2011-12-01 11:58:15		UP
Search17Bot	2011-11-26 20:11:40	UP	UP
Lijit	2011-11-22 19:59:03	UP	UP
MetaGeneratorCrawler	2011-11-18 01:12:47	UP	UP
Robots_Tester	2011-11-15 21:00:35	UP	UP
JUST-CRAWLER	2011-11-07 05:53:41	UP	UP
Apercite	2011-10-24 04:14:22	UP	UP
pmoz.info ODP link checker	2011-10-22 23:11:54	UP	UP
LemurWebCrawler	2011-10-15 18:18:16	UP	UP
Covario-IDS	2011-10-10 06:50:05	Down	UP
Holmes	2011-09-06 06:35:23	UP	UP
RankurBot	2011-08-19 13:03:39	UP	UP
DotBot	2011-08-19 03:55:09	UP	UP
AdsBot-Google	2011-08-16 01:05:37	UP	UP
envolk	2011-07-31 12:49:29	UP	UP
Ask Jeeves/Teoma	2011-07-14 23:54:12	Down	UP
LexxeBot	2011-07-01 18:11:38	UP	UP
adressendeutschland.de	2011-06-28 14:13:14	Down	Down
StackRambler	2011-06-22 08:32:29	Down	UP
Abrave Spider	2011-06-20 04:25:45	UP	UP
EvriNid	2011-06-19 23:11:05	Down	Down
arachnode.net	2011-06-09 11:12:54	UP	UP
CamontSpider	2011-05-22 11:07:51	UP	UP
wikiwix-bot	2011-05-14 14:50:04		Down
Nymesis	2011-05-12 04:11:14	UP	UP
trendictionbot	2011-05-02 05:54:26	Down	UP
Sitedomain-Bot	2011-04-13 11:12:45	UP	UP
SEODat	2011-04-01 15:49:48		UP
SygolBot	2011-03-31 20:55:31	Down	UP
Snapbot	2011-03-27 17:26:58		UP
OpenCalaisSemanticProxy	2011-03-24 10:22:36	UP	UP
ZookaBot	2011-03-16 08:20:17	UP	UP
CligooRobot	2011-03-14 04:21:50	UP	UP
cityreview	2011-03-12 10:00:11	UP	UP
nworm	2011-03-05 09:43:08	UP	UP
AboutUsBot	2011-03-04 19:32:53	UP	UP
ICC-Crawler	2011-02-28 16:09:29	UP	UP
Qirina Hurdler	2011-02-13 14:48:32	UP	UP
SBIder	2011-02-08 20:04:25	Down	UP
TwengaBot	2011-02-03 12:15:17	UP	UP
Dot TK - spider	2011-01-21 11:04:17		UP
EuripBot	2011-01-20 16:03:47	Down	UP
ParchBot	2011-01-17 15:56:41	UP	UP
Peew	2011-01-13 16:50:02	UP	UP
AntBot	2011-01-06 16:26:50		Down
YRSpider	2010-12-27 23:21:29	UP	UP
Urlfilebot (Urlbot)	2010-12-20 15:54:35	UP	UP
Gaisbot	2010-11-28 08:30:01	Down	UP
WatchMouse	2010-11-12 20:40:46	UP
Tagoobot	2010-10-19 00:39:21		UP
Motoricerca-Robots.txt-Checker	2010-10-15 09:44:25	UP	UP
WebWatch/Robot_txtChecker	2010-10-15 09:35:54	UP	UP
urlfan-bot	2010-10-11 22:02:14	UP	UP
StatoolsBot	2010-09-13 18:23:09	UP	UP
page_verifier	2010-09-08 09:03:07	UP	UP
SSLBot	2010-09-01 03:21:25	Down	Down
SAI Crawler	2010-08-31 04:40:50	UP	UP
DomainDB	2010-08-30 00:04:45	Down	UP
LinkWalker	2010-08-27 03:49:56		UP
WMCAI_robot	2010-08-18 13:30:18	Down	UP
voyager	2010-08-16 10:12:42	Down	Down
copyright sheriff	2010-08-10 11:34:43		UP
Ocelli	2010-08-07 11:10:54	UP	UP
Twiceler	2010-07-30 22:11:03	Down	Down
amibot	2010-07-26 20:08:06	UP	UP
abby	2010-07-23 22:40:11	Down	Down
NetResearchServer	2010-07-20 22:03:54	Down	Down
VideoSurf_bot	2010-07-13 21:17:08	UP	UP
XML Sitemaps Generator	2010-06-24 21:52:08	UP
BlinkaCrawler	2010-06-19 22:18:34	UP	UP
nodestackbot	2010-06-12 14:35:15	Down
Pompos	2010-06-06 04:11:26	Down	UP
taptubot	2010-06-01 21:32:31	UP	UP
BabalooSpider	2010-05-31 08:30:59		UP
Yaanb	2010-05-29 11:10:26	UP
Girafabot	2010-05-27 16:43:20		Down
livedoor ScreenShot	2010-05-05 21:14:46	UP	UP
eCairn-Grabber	2010-04-27 04:41:56	UP	UP
FauBot	2010-04-15 14:11:46	UP	UP
Toread-Crawler	2010-04-12 23:29:19	UP	UP
Setoozbot	2010-04-07 01:26:10	Down	UP
MetaURI	2010-04-06 19:44:17	UP	UP
L.webis	2010-04-06 04:12:56	UP	UP
Web-sniffer	2010-04-01 20:43:20		UP
FairShare	2010-03-30 23:18:19	UP	UP
Ruky-Roboter	2010-03-04 11:54:21	UP
ThumbShots-Bot	2010-02-23 09:26:22	UP	UP
BotOnParade	2010-02-22 08:19:33	UP	UP
Amagit.COM	2010-02-20 21:17:05		Down
HatenaScreenshot	2010-02-15 06:27:38	UP	UP
HolmesBot	2010-02-05 02:14:52		UP
dotSemantic	2010-01-31 15:48:26	Down
Karneval-Bot	2010-01-29 08:20:47	UP	Down
HostTracker.com	2010-01-24 14:12:56	UP
AportWorm	2010-01-23 03:52:12	UP	UP
XmarksFetch	2010-01-22 04:38:21	UP	UP
FeedFinder/bloggz.se	2010-01-16 12:53:59	UP	UP
CorpusCrawler	2010-01-16 01:58:45	UP	UP
Willow Internet Crawler	2010-01-08 17:25:50		UP
OrgbyBot	2010-01-02 03:44:26	Down
GingerCrawler	2010-01-02 00:04:34	UP	UP
pingdom.com_bot	2009-12-18 04:06:02		UP
Nutch	2009-12-16 14:38:25	UP	UP
baypup	2009-12-13 20:36:03	Down	Down
Linguee Bot	2009-12-11 16:03:50	UP	UP
Mp3Bot	2009-12-03 11:11:56	UP	UP
192.comAgent	2009-11-26 21:43:51	Down	UP
Surphace Scout	2009-11-25 01:11:47		Down
WikioFeedBot	2009-11-12 16:12:47		UP
Szukacz	2009-11-10 20:52:33	Down	UP
DBLBot	2009-10-22 13:59:30	Down	Down
Thumbnail.CZ robot	2009-10-15 11:24:56	UP	UP
LinguaBot	2009-09-30 04:26:53		UP
GurujiBot	2009-09-16 05:00:20	Down	Down
Charlotte	2009-09-10 02:41:33	Down	Down
50.nu	2009-09-06 19:31:38	Down	UP
SanszBot	2009-09-04 02:30:03	Down	Down
moba-crawler	2009-08-22 13:14:20	Down	UP
HeartRails_Capture	2009-08-21 07:50:21	UP	UP
SurveyBot	2009-08-20 17:21:12	UP	UP
MnoGoSearch	2009-08-19 08:06:03	UP	Down
smart.apnoti.com Robot	2009-08-19 00:04:26	Down	UP
Topicbot	2009-08-12 01:12:04	UP	UP
JadynAveBot	2009-08-09 08:12:05	UP	UP
OsObot	2009-07-30 06:15:49	UP	UP
WebImages	2009-07-24 16:35:15		UP
WinWebBot	2009-07-17 14:12:56	UP	UP
Scooter	2009-07-15 22:35:25		UP
Scarlett	2009-07-09 22:47:24	Down	Down
GOFORITBOT	2009-07-04 05:54:56	Down	Down
DKIMRepBot	2009-06-29 05:34:21	UP	UP
Yanga	2009-06-24 02:23:25	Down	UP
DNS-Digger-Explorer	2009-06-19 14:02:00		UP
Robozilla	2009-06-14 14:10:00	UP	UP
adidxbot	2009-06-13 01:40:28	UP	UP
YowedoBot	2009-06-03 05:56:34	Down	UP
botmobi	2009-06-02 14:18:16	Down	UP
Fooooo_Web_Video_Crawl	2009-06-01 22:19:14	UP	UP
UptimeDog	2009-06-01 04:12:00	UP	UP
^Nail	2009-05-23 14:12:46	Down	Down
Metaspinner/0.01	2009-05-18 05:17:58	UP	UP
Touche	2009-05-10 09:46:22	Down	Down
RSSMicro.com RSS/Atom Feed Robot	2009-05-07 14:48:27		UP
SniffRSS	2009-05-07 12:00:12		UP
Kalooga	2009-05-07 01:53:35	Down	UP
FeedCatBot	2009-05-05 20:43:15	UP
WebRankSpider	2009-05-03 07:42:34	Down
Flatland Industries Web Spider	2009-05-02 09:58:26	Down	Down
DealGates Bot	2009-04-27 01:08:03	UP	UP
Link Valet Online	2009-04-26 12:59:29	UP	Down
Shelob	2009-04-23 19:10:22	UP	UP
Technoratibot	2009-04-22 00:25:00		UP
Flocke bot	2009-04-19 19:09:51	UP
FollowSite Bot	2009-02-20 07:12:54	Down	Down
Visbot	2007-01-06 14:12:56	UP	UP