#1 Posted on 8.1.03 0319.32 Reposted on: 8.1.10 0319.34
In case you're noticing a very high number of guests (chickens) on the front page, it appears that my plan to trick the Googlebot into crawling the board has taken effect. Since it uses multiple IPs, the board software counts each one as a guest...since it doesn't know any better.
The front page HAD been included in Google, but it appears to be gone now, although the old wienerville.slashwrestling.com page is still there. It DOES look like most of the threads have been crawled, though, so maybe in a few weeks we'll have an interesting new interface for Searching through our archives...
#5 Posted on 8.1.03 1421.10 Reposted on: 8.1.10 1426.07
Chris used the mod rewrite command in apache to turn all of the ? in / in the URI for the board. Google generally will not crawl dynamically generated pages past the first page to avoid getting stuck in infinite loops.
I guess I should have asked Chris if he left the last level with ? or / before Google hit here... Oh well.
#8 Posted on 9.1.03 0253.22 Reposted on: 9.1.10 0253.46
I think they'll cheerfully navigate forever until I fix some buggy Java
I see about 24,000 hits from them in the current log...so, let's see - almost 1200 user pages, almost 9000 thread pages...many with more than one page (guests read 20 messages per page)... hmmm. Interesting!