What that is, is internet search engines indexing the board. Thats the reason why the robots.txt was originally placed there for. Not all of them respect it, but a fair ammount of them do. Just don't block archive.org or roid will kick your arse.
"One spelling mistake can destroy your life. A Husband sent this to his wife : "I'm having a wonderful time. Wish you were her." - @RobinWilliams
Sorry, I may be contributing to this. I can't use the auto-login feature (some bogosity with my cookies--I've tried deleting them, re-adding them, nothing helps--the only way I can even post is by blocking all cookies from the DBB) so I've been visiting as a guest... and I read a LOT of parts on these forums.