|
#1
|
|||
|
|||
|
ratings addon - blocking robots
Has anyone implemented some code for the ratings addon to block search engine crawlers from hitting the voting URLs and adding to the ratings DB?
I imagine this can be done by either cleverly rewriting the voting image URLs so the spiders don't use them or by putting a filter into the addon code itself to block specific user agents (Yahoo! Slurp, for example). Anyone else having this problem? thanks... |
|
#2
|
||||
|
||||
|
You can always read about robots.txt file in root dir of website. It can help without any changes in code.
http://www.webtoolcentral.com/webmas...ile_generator/ - generator of robots.txt http://www.google.com/search?hs=D8p&...tnG=Szukaj&lr= - more about this topic |
| Post Reply |
| Thread Tools | |
|
|