The W
Views: 145102704
Main | FAQ | Search: Y! / G | Color chart | Log in for more!
21.8.12 1548
The 7 - the-w.com Site Feedback - High chicken count (explanation) Register and log in to post!
(927 newer) Next thread | Previous thread
User
Post (11 total)
CRZ
Big Brother
Administrator
Level: 229

Posts: 1484/17394
EXP: 184436210
For next: 85761

Since: 9.12.01
From: ミネアポリス

Since last post: 1 day
Last activity: 1 day
ICQ:  
Y!:
#1 Posted on 8.1.03 0319.32
Reposted on: 8.1.10 0319.34
In case you're noticing a very high number of guests (chickens) on the front page, it appears that my plan to trick the Googlebot into crawling the board has taken effect. Since it uses multiple IPs, the board software counts each one as a guest...since it doesn't know any better.

The front page HAD been included in Google, but it appears to be gone now, although the old wienerville.slashwrestling.com page is still there. It DOES look like most of the threads have been crawled, though, so maybe in a few weeks we'll have an interesting new interface for Searching through our archives...
Promote this thread!
Eddie Famous
Andouille
Level: 95

Posts: 455/2221
EXP: 8413883
For next: 254755

Since: 11.12.01
From: Catlin IL

Since last post: 939 days
Last activity: 480 days
#2 Posted on 8.1.03 0542.29
Reposted on: 8.1.10 0544.03
Is this what it's come down to, tricking a poor old googlebot into making a high chicken count?
EddieBurkett
Boudin blanc
Level: 99

Posts: 219/2483
EXP: 9928691
For next: 71344

Since: 3.1.02
From: GA in person, NJ in heart

Since last post: 21 days
Last activity: 2 days
#3 Posted on 8.1.03 0954.18
Reposted on: 8.1.10 0959.01
I don't suppose it would be right for the more curious among us to ask what exactly tricking a googlebot entailed, would it?
calvinh0560
Boudin rouge
Level: 50

Posts: 178/518
EXP: 946031
For next: 1293

Since: 3.1.02
From: People's Republic of Massachusetts

Since last post: 2323 days
Last activity: 1 day
#4 Posted on 8.1.03 1024.23
Reposted on: 8.1.10 1025.19
So sometime next week we should have "googlebot" as wiener of the day :)
Guru Zim
SQL Dejection
Administrator
Level: 147

Posts: 1313/6170
EXP: 38965099
For next: 473096

Since: 9.12.01
From: Bay City, OR

Since last post: 21 days
Last activity: 6 days
ICQ:  
Y!:
#5 Posted on 8.1.03 1421.10
Reposted on: 8.1.10 1426.07
Chris used the mod rewrite command in apache to turn all of the ? in / in the URI for the board. Google generally will not crawl dynamically generated pages past the first page to avoid getting stuck in infinite loops.

I guess I should have asked Chris if he left the last level with ? or / before Google hit here... Oh well.


We may have a problem if they never leave.
EddieBurkett
Boudin blanc
Level: 99

Posts: 222/2483
EXP: 9928691
For next: 71344

Since: 3.1.02
From: GA in person, NJ in heart

Since last post: 21 days
Last activity: 2 days
#6 Posted on 8.1.03 1451.53
Reposted on: 8.1.10 1452.02
So are you saying Google avoided the ?'s to avoid infinite loops, but because we took out the ?'s, they might get caught in infinite loops?

We've already got problems on here cuz some people never leave. At least the googlebots are quiet...
Guru Zim
SQL Dejection
Administrator
Level: 147

Posts: 1314/6170
EXP: 38965099
For next: 473096

Since: 9.12.01
From: Bay City, OR

Since last post: 21 days
Last activity: 6 days
ICQ:  
Y!:
#7 Posted on 8.1.03 1616.27
Reposted on: 8.1.10 1616.29
Well, they left, so I guess it worked out ok after all. I'm interested to know if the bots were able to navigate all of the threads, or just through the first page... but I guess we shall see.
CRZ
Big Brother
Administrator
Level: 229

Posts: 1488/17394
EXP: 184436210
For next: 85761

Since: 9.12.01
From: ミネアポリス

Since last post: 1 day
Last activity: 1 day
ICQ:  
Y!:
#8 Posted on 9.1.03 0253.22
Reposted on: 9.1.10 0253.46
I think they'll cheerfully navigate forever until I fix some buggy Java
I see about 24,000 hits from them in the current log...so, let's see - almost 1200 user pages, almost 9000 thread pages...many with more than one page (guests read 20 messages per page)... hmmm. Interesting!
vsp
Andouille
Level: 91

Posts: 755/2042
EXP: 7404527
For next: 64414

Since: 3.1.02
From: Philly

Since last post: 4797 days
Last activity: 1052 days
#9 Posted on 9.1.03 1133.20
Reposted on: 9.1.10 1133.38
This is a rarity in this day and age -- an ad-free, popup-free site with heavy traffic that's actively ENCOURAGING an external site to chew up its bandwidth.
redsoxnation
Scrapple
Level: 159

Posts: 1488/7534
EXP: 51645720
For next: 165150

Since: 24.7.02

Since last post: 2242 days
Last activity: 2242 days
#10 Posted on 9.1.03 1248.43
Reposted on: 9.1.10 1250.39
Since I don't understand the technical nature of the difficulty, I say keep it simple. Bring in the Swedish Chef to eliminate the excess chickens.
J. Kyle
Banger
Level: 100

Posts: 686/2550
EXP: 10293449
For next: 60983

Since: 21.2.02
From: The Land of Aloha

Since last post: 402 days
Last activity: 385 days
Y!:
#11 Posted on 12.1.03 0448.27
Reposted on: 12.1.10 0449.48

    Originally posted by vsp
    This is a rarity in this day and age -- an ad-free, popup-free site with heavy traffic that's actively ENCOURAGING an external site to chew up its bandwidth.

Yeah but those other sites have to PAY for bandwidth rather than running on the Power of the Warrior.
ALL ORIGINAL POSTS IN THIS THREAD ARE NOW AVAILABLE
Thread ahead: Losers from Australian IP addresses
Next thread: Private message deletion
Previous thread: Minor Edit Profile Error
(927 newer) Next thread | Previous thread
The 7 - the-w.com Site Feedback - High chicken count (explanation)Register and log in to post!

The W™ message board - 7 year recycle

ZimBoard
©2001-2019 Brothers Zim
This old hunk of junk rendered your page in 0.094 seconds.