• Guest, The rules for the P & N subforum have been updated to prohibit "ad hominem" or personal attacks against other posters. See the full details in the post "Politics and News Rules & Guidelines."

Extracting raw data from multiple website tables?

KnickNut3

Platinum Member
Oct 1, 2001
2,382
0
0
CLIFFS:

Sites with multiple pages of tables
Need to import tables into excel
Not feasible to do 1 by 1
Help!
Thanks!


Hi, I really hope you can help:

I am attempting to write an economics thesis on sports betting markets as
financial derivatives markets. I'm trying to get as much raw data as possible
of historical lines/results on which to do my econometric analysis.

I have some good sites (listed below), but need an easier way to import this
data into a raw format (Excel, csv, whatever) than going through page by page.
30 team/league x 30 years/sport x 3 sports = LOTS of data I'd like to import,
and pretty infeasable by doing load page, drag, copy, excel paste, repeat ~3000
times.

I know there are plugins for firefox that will download whole websites, but do
think there is any way I could scour these pages and import them into a raw
format? The pages are formatted pretty identically within a site, but I don't
know code and wouldn't be able to write a program. I'm familiar with Excel's
web query but AFAIK that can only do 1 specific page you import. I tried contacting the sites but they have been uncooperative so far.

I appreciate the ideas and assistance.

http://www.sportsbookpal.com/
http://www.jimfeist.com/
http://www.covers.com/
 

dave127

Senior member
Nov 26, 2000
912
0
0
I think that there is a program to write an internet macro in IE that will do what you're looking to do, however the name of the one I've used in the past is slipping my mind. I hope someone else can chime in on this.
 

KnickNut3

Platinum Member
Oct 1, 2001
2,382
0
0
I'll give it one more try, because this is really important and I could use the help.
 

ASK THE COMMUNITY