The W
Views: 147606422
Main | FAQ | Search: Y! / G | Color chart | Log in for more!
6.12.12 2243
The 7 - the-w.com Site Feedback - High chicken count (explanation) Register and log in to post!
(937 newer) Next thread | Previous thread
User
Post (11 total)
CRZ
Big Brother
Administrator
Level: 230

Posts: 1484/17421
EXP: 186394302
For next: 950905

Since: 9.12.01
From: ミネアポリス

Since last post: 5 days
Last activity: 2 days
ICQ:  
Y!:
#1 Posted on 8.1.03 0319.32
Reposted on: 8.1.10 0319.34
In case you're noticing a very high number of guests (chickens) on the front page, it appears that my plan to trick the Googlebot into crawling the board has taken effect. Since it uses multiple IPs, the board software counts each one as a guest...since it doesn't know any better.

The front page HAD been included in Google, but it appears to be gone now, although the old wienerville.slashwrestling.com page is still there. It DOES look like most of the threads have been crawled, though, so maybe in a few weeks we'll have an interesting new interface for Searching through our archives...
Promote this thread!
Eddie Famous
Andouille
Level: 95

Posts: 455/2221
EXP: 8483473
For next: 185165

Since: 11.12.01
From: Catlin IL

Since last post: 1047 days
Last activity: 587 days
#2 Posted on 8.1.03 0542.29
Reposted on: 8.1.10 0544.03
Is this what it's come down to, tricking a poor old googlebot into making a high chicken count?
EddieBurkett
Boudin blanc
Level: 100

Posts: 219/2483
EXP: 10011092
For next: 343340

Since: 3.1.02
From: GA in person, NJ in heart

Since last post: 128 days
Last activity: 10 hours
#3 Posted on 8.1.03 0954.18
Reposted on: 8.1.10 0959.01
I don't suppose it would be right for the more curious among us to ask what exactly tricking a googlebot entailed, would it?
calvinh0560
Boudin rouge
Level: 51

Posts: 178/518
EXP: 953883
For next: 60062

Since: 3.1.02
From: People's Republic of Massachusetts

Since last post: 2431 days
Last activity: 2 days
#4 Posted on 8.1.03 1024.23
Reposted on: 8.1.10 1025.19
So sometime next week we should have "googlebot" as wiener of the day :)
Guru Zim
SQL Dejection
Administrator
Level: 147

Posts: 1313/6171
EXP: 39296816
For next: 141379

Since: 9.12.01
From: Bay City, OR

Since last post: 102 days
Last activity: 16 days
ICQ:  
Y!:
#5 Posted on 8.1.03 1421.10
Reposted on: 8.1.10 1426.07
Chris used the mod rewrite command in apache to turn all of the ? in / in the URI for the board. Google generally will not crawl dynamically generated pages past the first page to avoid getting stuck in infinite loops.

I guess I should have asked Chris if he left the last level with ? or / before Google hit here... Oh well.


We may have a problem if they never leave.
EddieBurkett
Boudin blanc
Level: 100

Posts: 222/2483
EXP: 10011092
For next: 343340

Since: 3.1.02
From: GA in person, NJ in heart

Since last post: 128 days
Last activity: 10 hours
#6 Posted on 8.1.03 1451.53
Reposted on: 8.1.10 1452.02
So are you saying Google avoided the ?'s to avoid infinite loops, but because we took out the ?'s, they might get caught in infinite loops?

We've already got problems on here cuz some people never leave. At least the googlebots are quiet...
Guru Zim
SQL Dejection
Administrator
Level: 147

Posts: 1314/6171
EXP: 39296816
For next: 141379

Since: 9.12.01
From: Bay City, OR

Since last post: 102 days
Last activity: 16 days
ICQ:  
Y!:
#7 Posted on 8.1.03 1616.27
Reposted on: 8.1.10 1616.29
Well, they left, so I guess it worked out ok after all. I'm interested to know if the bots were able to navigate all of the threads, or just through the first page... but I guess we shall see.
CRZ
Big Brother
Administrator
Level: 230

Posts: 1488/17421
EXP: 186394302
For next: 950905

Since: 9.12.01
From: ミネアポリス

Since last post: 5 days
Last activity: 2 days
ICQ:  
Y!:
#8 Posted on 9.1.03 0253.22
Reposted on: 9.1.10 0253.46
I think they'll cheerfully navigate forever until I fix some buggy Java
I see about 24,000 hits from them in the current log...so, let's see - almost 1200 user pages, almost 9000 thread pages...many with more than one page (guests read 20 messages per page)... hmmm. Interesting!
vsp
Andouille
Level: 91

Posts: 755/2042
EXP: 7465983
For next: 2958

Since: 3.1.02
From: Philly

Since last post: 4904 days
Last activity: 1159 days
#9 Posted on 9.1.03 1133.20
Reposted on: 9.1.10 1133.38
This is a rarity in this day and age -- an ad-free, popup-free site with heavy traffic that's actively ENCOURAGING an external site to chew up its bandwidth.
redsoxnation
Scrapple
Level: 160

Posts: 1488/7534
EXP: 52088183
For next: 864931

Since: 24.7.02

Since last post: 2350 days
Last activity: 2350 days
#10 Posted on 9.1.03 1248.43
Reposted on: 9.1.10 1250.39
Since I don't understand the technical nature of the difficulty, I say keep it simple. Bring in the Swedish Chef to eliminate the excess chickens.
J. Kyle
Banger
Level: 101

Posts: 686/2550
EXP: 10379536
For next: 338176

Since: 21.2.02
From: The Land of Aloha

Since last post: 510 days
Last activity: 493 days
Y!:
#11 Posted on 12.1.03 0448.27
Reposted on: 12.1.10 0449.48

    Originally posted by vsp
    This is a rarity in this day and age -- an ad-free, popup-free site with heavy traffic that's actively ENCOURAGING an external site to chew up its bandwidth.

Yeah but those other sites have to PAY for bandwidth rather than running on the Power of the Warrior.
ALL ORIGINAL POSTS IN THIS THREAD ARE NOW AVAILABLE
Thread ahead: Losers from Australian IP addresses
Next thread: Private message deletion
Previous thread: Minor Edit Profile Error
(937 newer) Next thread | Previous thread
The 7 - the-w.com Site Feedback - High chicken count (explanation)Register and log in to post!

The W™ message board - 7 year recycle

ZimBoard
©2001-2019 Brothers Zim
This old hunk of junk rendered your page in 0.065 seconds.