Crawling cut back

Effective immediately, major crawling will be cut back by our news crawler. This means that only a select few of our sources will actually be crawled.

This is a temporary measure aiming to cut back on the server load. As CassieNet News doesn't really do anything at the moment, we can't justify giving it server space on a server that is overloading when it doesn't generate any revenue.

I love the project and hope to press forward with it but right now it has to take a sideline.

In order to maintain some sence of archives the following sources will still be crawled:

# News.com
# Wired.com
# Boston.com
# Scotsman.com
# BBC News
# Washington Post
# Reuters
# Yahoo News
# MTV News

No other sources will be crawled for the moment though if this does not reduce server load we may begin crawling all sources again soon.