Search Engine Spider Identification |
| Forum Charter, Library, Moderated by: incrediBILL |
Forum Options:
Reset Last Read Pointers |
PreModerated forum to id search engine spiders
|
| |
|
| new |
Subject |
Messages | Started by |
Last Message |
 |
Trend Micro AV May Be Causing Excess Traffic
| 6
|
blend27 | 12:27 pm on May 16, 2008 (utc 0)
|
|
|
alef/0.0
| 1
|
keyplyr | 4:11 am on May 16, 2008 (utc 0)
|
|
|
AVG Toolbar Glitch May Be Causing Visitor Loss
[4] ( 1 2 3 4 )
User Agent Flaw Suspected
| 108
|
Umbra | 3:21 am on May 16, 2008 (utc 0)
|
|
|
rulinki.ru
| 1
|
Hobbs | 6:49 am on May 15, 2008 (utc 0)
|
|
|
MSR-ISRCCrawler
Looking for music royalty violations?
| 11
|
keyplyr | 12:18 am on May 13, 2008 (utc 0)
|
|
|
yoofind
yoono webcrawler new look
| 3
|
Hobbs | 2:15 am on May 11, 2008 (utc 0)
|
|
|
Searchme
Who are they?
| 3
|
fischermx | 9:22 am on May 9, 2008 (utc 0)
|
|
|
discobot
discoveryengine
| 20
|
Hobbs | 12:38 pm on May 6, 2008 (utc 0)
|
|
|
OnetSzukaj
bot out of poland - hungry one too
| 2
|
Bewenched | 3:28 pm on May 4, 2008 (utc 0)
|
|
|
Generic Bot Filtering Criteria
What keywords do you use to filter?
| 16
|
wilderness | 6:10 pm on May 3, 2008 (utc 0)
|
|
|
HeartRails Capture
Yet another Screen Capture Website
| 4
|
Ocean10000 | 3:59 pm on May 3, 2008 (utc 0)
|
|
|
Moved: Massive Botnet Spamming Infestation Thwarts Standard Detection
Post was moved here: http://www.webmasterworld.com/webmaster/3639270.htm
| 1
|
System | 12:08 am on May 1, 2008 (utc 0)
|
|
|
PhpDig/1.8.8
New Zealand
| 2
|
Bewenched | 8:12 pm on April 30, 2008 (utc 0)
|
|
|
Scout
| 11
|
wilderness | 10:25 am on April 30, 2008 (utc 0)
|
|
|
Default User Agents of Programming Libraries and Command Line Tools
Resource page for common user agents
| 15
|
incrediBILL | 8:54 pm on April 29, 2008 (utc 0)
|
|
|
Beware Fake Google DNS
| 1
|
incrediBILL | 4:37 pm on April 29, 2008 (utc 0)
|
|
|
Yahoo! Slurp/3.0 used for iffy purposes?
26 hits to "list.php" files -- on non-PHP site
| 13
|
Pfui | 11:49 am on April 29, 2008 (utc 0)
|
|
|
TinEye
| 1
|
Hobbs | 10:43 am on April 29, 2008 (utc 0)
|
|
|
HouxouCrawler
| 1
|
Hobbs | 10:21 am on April 29, 2008 (utc 0)
|
|
|
oegp v. 1.3.0
a confirmed scraper
| 3
|
Hobbs | 5:47 am on April 29, 2008 (utc 0)
|
|
|
Moved: Spiders and 404 Errors
Post was moved here: http://www.webmasterworld.com/webmaster/3637259.htm
| 1
|
System | 2:27 am on April 29, 2008 (utc 0)
|
|
|
Kalooga
| 12
|
keyplyr | 9:21 am on April 28, 2008 (utc 0)
|
|
|
Moved: Requesting forum name change
Post was moved here: http://www.webmasterworld.com/webmasterworld/3636996.htm
| 1
|
System | 8:38 am on April 28, 2008 (utc 0)
|
|
|
Stealth GoogleBot, or Spoofed IP?
Strange Hits in Stats, WHOIS Shows they come from Google
| 4
|
abhorrent12 | 3:31 am on April 28, 2008 (utc 0)
|
|
|
Uberdex Agent/0.1
Exclusive FIRST LOOK on WebmasterWorld!
| 1
|
incrediBILL | 1:02 am on April 28, 2008 (utc 0)
|
|
|
unknown
| 23
|
wilderness | 11:26 pm on April 26, 2008 (utc 0)
|
|
|
Ask Jeeves/Teoma oddities
odd IPs and reverse DNS
| 8
|
incrediBILL | 1:45 pm on April 26, 2008 (utc 0)
|
|
|
Strange hits from internetserviceteam.com
| 5
|
rudyten | 6:39 pm on April 25, 2008 (utc 0)
|
|
|
SharedService.Crawler
resolves to Microsoft?
| 2
|
Bewenched | 4:44 pm on April 25, 2008 (utc 0)
|
|
|
Blocking the bad boys
keeping bots, breakers and bugs out
| 4
|
superclown2 | 11:55 am on April 24, 2008 (utc 0)
|
|
|
spider adds url?
| 12
|
smokeybarnable | 1:01 am on April 24, 2008 (utc 0)
|
|
|
Basalt
| 4
|
wilderness | 11:55 pm on April 22, 2008 (utc 0)
|
|
|
MLBot from Metadatalabs
| 3
|
incrediBILL | 11:41 pm on April 22, 2008 (utc 0)
|
|
|
TestBot
yet another dodgy bot crawling from Amazon
| 3
|
Mokita | 8:06 pm on April 22, 2008 (utc 0)
|
|
|
My Latest Google, MSN, Yahoo Spider IP List
IP list of GoogleBot, MSNBot and Yahoo Slurp spiders. CIDR formatted.
| 3
|
hdogan | 11:27 pm on April 18, 2008 (utc 0)
|
|
|
yangboz
| 10
|
wilderness | 6:26 pm on April 17, 2008 (utc 0)
|
|
|
darxi/1.1
New little creapy crawly
| 3
|
Ocean10000 | 2:01 pm on April 17, 2008 (utc 0)
|
|
|
Default User Agents Discussion
| 7
|
wilderness | 7:01 pm on April 16, 2008 (utc 0)
|
|
|
Yahoo! Slurp/3.0 released on new IPs
Headaches for those Validating by IP instead of Reverse DNS
| 12
|
Receptional_Andy | 3:29 am on April 16, 2008 (utc 0)
|
|
|
HttpGetFile
| 3
|
Hobbs | 8:37 pm on April 14, 2008 (utc 0)
|
|
|
Exabot-Thumbnails
Exalead
| 5
|
Bewenched | 7:48 pm on April 13, 2008 (utc 0)
|
|
|
Optioncarriere / Careerjet
job search engines with generic ua's
| 16
|
incrediBILL | 6:43 pm on April 13, 2008 (utc 0)
|
|
|
Powerset
who's adopting?
| 10
|
Hobbs | 8:38 am on April 13, 2008 (utc 0)
|
|
|
Scraper from Micro Synergy
| 6
|
keyplyr | 4:43 am on April 13, 2008 (utc 0)
|
|
|
bloglines
crawler?
| 5
|
Bewenched | 4:25 am on April 13, 2008 (utc 0)
|
|
|
Are users visiting my site from Google.com?
Some browser like agents are visiting my site from Google.com
| 17
|
schnee | 4:12 am on April 13, 2008 (utc 0)
|
|
|
Open ISearch/1.2.1
| 3
|
Bewenched | 4:01 am on April 13, 2008 (utc 0)
|
|
|
cameleon scraper bot
Different UA for every hit
| 9
|
Hobbs | 9:28 am on April 12, 2008 (utc 0)
|
|
|
Cidr
| 2
|
wilderness | 8:01 pm on April 11, 2008 (utc 0)
|
|
|
Moved: Spiders & ISAPI Rewrite
Post was moved here: http://www.webmasterworld.com/microsoft_asp_net/3624882.htm
| 1
|
System | 5:41 pm on April 11, 2008 (utc 0)
|
| Displaying Page 1 of 67 |
[ 1 ] 2 3 4 5 6 7 8 9 10 ... 67 Next >> |
=New messages indicator
|
