I listened to your interview today and I must share my opinion. I strongly disagree with your method of spidering the sites. Even if you are inside the law, it is wrong to do it if the sites are denying you access because of the traffic generated.

Since you spider sites, do you acknowledge the robots.txt file?

Ray do you also disagree with google and all the other sites that are aggregating and indexing public websites ?

I think spidering is fine so long as it is sensitive to DOS issues, and if you are asked by a site to stop you do. Once information is published freely on a website then I don't see anything wrong with consuming it and generating statistical information like Stephen's company are doing infact it is a good idea. They could employ an army of individuals to visit and index each site, but all they would achieve is a massive increase in costs, without any benefit.

Please check out the pages dedicated to casino on net http://casino-on-net.screwy-casino.com/
online casinos http://www.screwy-casino.com/
online casino gambling http://online-casino-gambling.screwy-casino.com/
slot machines http://slot-machines.screwy-casino.com/
roulette http://roulette.screwy-casino.com/
internet casino http://internet-casino.screwy-casino.com/
casino gambling http://casino-gambling.screwy-casino.com/
casino online http://casino-online.screwy-casino.com/
casino games http://casino-games.screwy-casino.com/
online casino http://online-casino.screwy-casino.com/
- Tons of interesdting stuff!!!

Please take a look at some relevant pages dedicated to party poker http://www.poker-new.com/party-poker.html
longest poker game http://www.poker-new.com/longest-poker-game.html
texas holdem strategy http://www.poker-new.com/texas-holdem-strategy.html
online video poker http://www.poker-new.com/online-video-poker.html
rules for texas hold em card game http://www.poker-new.com/rules-for-texas-hold-em-card-game.html
free poker http://www.poker-new.com/free-poker.html
free poker game download http://www.poker-new.com/free-poker-game-download.html
poker on line http://www.poker-new.com/poker-on-line.html
free online texas holdem http://www.poker-new.com/free-online-texas-holdem.html
texas hold em poker game http://www.poker-new.com/texas-hold-em-poker-game.html
omaha poker http://www.poker-new.com/omaha-poker.html
free strip poker http://www.poker-new.com/free-strip-poker.html
hold em poker http://www.poker-new.com/hold-em-poker.html
video poker strategy http://www.poker-new.com/video-poker-strategy.html
casino poker http://www.poker-new.com/casino-poker.html
online texas hold em http://www.poker-new.com/online-texas-hold-em.html
holdem http://www.poker-new.com/holdem.html
poker games http://www.poker-new.com/poker-games.html
go play poker http://www.poker-new.com/go-play-poker.html
celebrity poker http://www.poker-new.com/celebrity-poker.html
poker table http://www.poker-new.com/poker-table.html
poker site http://www.poker-new.com/poker-site.html
video poker games http://www.poker-new.com/video-poker-games.html
poker strategies http://www.poker-new.com/poker-strategies.html
world series of poker http://www.poker-new.com/world-series-of-poker.html
texas holdem odds http://www.poker-new.com/texas-holdem-odds.html
video poker software http://www.poker-new.com/video-poker-software.html
free poker games http://www.poker-new.com/free-poker-games.html
gambling poker http://www.poker-new.com/gambling-poker.html
caribbean stud poker http://www.poker-new.com/caribbean-stud-poker.html
... Thanks!!!

Take your time to take a look at some relevant information on jackie billy party poker http://www.hackerssupply.com/party-poker.html
...

Please visit some relevant information in the field of online poker http://online-poker.available-poker.com/
party poker http://party-poker.available-poker.com/
texas hold em http://texas-hold-em.available-poker.com/
poker games http://poker-games.available-poker.com/
pacific poker http://pacific-poker.available-poker.com/
empire poker http://empire-poker.available-poker.com/
free poker http://free-poker.available-poker.com/
poker rules http://poker-rules.available-poker.com/
poker http://www.available-poker.com/
texas holdem http://texas-holdem.available-poker.com/
- Tons of interesdting stuff!!!

You are invited to check out some helpful info in the field of viagra http://www.excellent-health.com/
order viagra http://order-viagra.excellent-health.com/
buy phentermine http://buy-phentermine.excellent-health.com/
phentermine http://phentermine.excellent-health.com/
buy viagra online http://buy-viagra-online.excellent-health.com/
... Thanks!!!

You may find it interesting to check some relevant pages about free online poker 24 http://www.computerxchange.com/poker-online.html
.

Please check out the pages on cheating at online poker http://www.poker-check.com/
.

You may find it interesting to visit some helpful info on world series of poker shop http://www.adspoll.com/world-series-of-poker.html
...

You are invited to check some helpful info dedicated to best diet lose pill weight http://www.budgethawaii.net/diet-pills.html
- Tons of interesdting stuff!!!