|
Re: I think we found our limit ..
I've done some tweaking in robots.txt to disallow the spiders from indexing the site (at least until the Summer). It's a tradeoff that I normally wouldn't like to make, but I'd rather save resources for you guys than for Google, Yahoo, Alexa, etc.
The site is still 100% searchable via the site's search (up top) and will remain in Google/Yahoo/etc for a while before it falls out. Hopefully by then we will have our server upgrade and/or it will be May and I'll put the old robots.txt back up.
I'll also be toning down some of the 'perks' like I did last year. There are a few settings and features that are better left disabled during high traffic. The boards will still be useable, but may be missing some of the nice little extras. (You won't be able to see who is viewing the thread, etc.)
-Brandon
(you will probably still see 1-2 'Spiders' listed on the 'Whos Online', because some are recognized, but may not adhere to the robots.txt standard. 1 or 2 is better than 50-60.)
__________________
Brandon Martus
e-mail
Last edited by Brandon Martus : 04-01-2006 at 17:25.
|