look at mass number of web pages

[toughwimp11]

I'm trying to find a certain web page that's withing a certain range of URL.
in other words, lets say i have the url http://www.example.com/page_id=0000

basically i want to look at pages with id 0000-9999 and then look at the html <title> until i find my match.

does anyone know a easy way to do this. I tried using wget but the web page i'm using requires cookies and i dont know how to import my firefox cookies. is there an easy way to do this in firefox or outside it but with access to cookies

 

[Furor]

I can do this in 5 minutes with ColdFusion. Post the URL if you want and i'll do it.

 

[troytime]

there used to be a site that did this, it was great

but i think it went away 🙁

 

[txrandom]

This would be pretty using cUrl or another library for fetching web pages. I could do it in C# or PHP in 5 or minutes.

 

[Ken g6]

You can set wget to use your Firefox cookies file, if you can find it. Use --load-cookies "path\to\cookies.txt", or the load_cookies = option in wgetrc.

http://www.gnu.org/software/wget/manual/wget.html - don't use wget without it!