Automatic web crawler

kldang

Senior member
Aug 24, 2005
232
0
0
I just developed a simple ligth weight http server on linux. This is going to be ran on resource limited embedded system. I wonder if there is any program that can test my web server automatically. For example, this program will crawl the web and try to access every possible links.

Thanks!!