Robotcop for Tomcat?

[imported_pak9rabid]

Does anyone know if there is anything like Robotcop for Tomcat? For those who are not familiar with Robotcop, you can read about it here:

http://www.robotcop.org/install_ap13.html

In a nutshell, it extends robots.txt in that it will actually enforce the rules set forth in there, as opposed to doing nothing and hoping the various web spiders/robots/crawlers respect them. I've searched all over google for something like this for Tomcat with no luck.

 

[kamper]

You could run apache in front of tomcat. It would also be very easy to write one for tomcat on a per application basis. Applying it at the entire-server level might be a bit tougher.

 

[imported_pak9rabid]

Yeah, thats what I was thinking. Using apache + mod_jk. Looks like thats my only option unless I want to write something.