Any recommended website copying (non FTP) programs?

[edprush]

There seems to be a bunch of them so I was looking for a recommendation:
(such as)


I'm trying to copy an entire site.

I hired someone at guru.com to develop a website for me for $2100. For the first 5 weeks things went fine. By the way, he is developing it on his server. For the last 8 last weeks he has shown very little progress and takes 8 or 10 days to reply to my emails.

I won't have to pay him if he doesn't finish but I want to get as much of the site as he has developed so far so I don't have to waste the first month, with the next person I hire, getting to the point I'm at now.

I've used HTTrack Website Copier with limited success. There is part of the site that I want to copy that requires a username and password (which I have) but HTTrack doesn't have the capability to copy the password protected area.

Any suggestions?

 

[p924]

Ftp would be better if you have access, because any dynamic content won't be downloaded by a website downloader. . . .
but as far as website downloaders go the best one I've found (and I've tried quite a few) is wget. It's got a bit had to use because you have to figure out the command line switches, but it is extremely stable and will run for days downloading a huuuuge website without crashing. :-D

 

[WildHorse]

Here's something free that copies entire websites easily:

AT thread from March 2007

 

[edprush]

Originally posted by: p924
Ftp would be better if you have access, because any dynamic content won't be downloaded by a website downloader. . . .
but as far as website downloaders go the best one I've found (and I've tried quite a few) is wget. It's got a bit had to use because you have to figure out the command line switches, but it is extremely stable and will run for days downloading a huuuuge website without crashing. :-D

I don't have FTP access to the server that the script is being developed on.

Have you tried it on a website that has password protected sections?

 

[pstylesss]

It won't matter if you can get into the password protected spot anyway, he has more than likely written it in PHP or some other server side language. You cannot copy, or download the server side code. Even if you get into the directory via a web browser, you couldn't right click and save the page to get the server side. The only way is really ftp access.

 

[jjones]

Originally posted by: ZeroIQ
It won't matter if you can get into the password protected spot anyway, he has more than likely written it in PHP or some other server side language. You cannot copy, or download the server side code. Even if you get into the directory via a web browser, you couldn't right click and save the page to get the server side. The only way is really ftp access.

Agreed. All you'll be copying is the html, not the server side scripts that I'm sure he's using. You need to get ftp access or require that he give you a complete copy of the work he's done to date. If you continue with this guy, I'd suggest that you require he give you an updated copy of his work on a weekly basis.

 

[edprush]

Originally posted by: ZeroIQ
It won't matter if you can get into the password protected spot anyway, he has more than likely written it in PHP or some other server side language. You cannot copy, or download the server side code. Even if you get into the directory via a web browser, you couldn't right click and save the page to get the server side. The only way is really ftp access.

I was hoping to at least somehow get the 'framework' for the site and then, if he stops developing it, I would have some structure for the next developer to begin with.

 

[pstylesss]

If but framework you mean basic design/layout, just take screen shots of it. I wish I could be of more help...

 

[edprush]

Originally posted by: ZeroIQ
If but framework you mean basic design/layout, just take screen shots of it. I wish I could be of more help...

That will probably have to do but it would have been kind of nice to see where the links were directed to and the drop-downs in the many many forms.

 

[WildHorse]

As linked in my other post above, why not give Free Download Manager a try?

It's free, and easily downloads entire web sites.

It has a spider which you can set some options for. It's very easy and fast to use.

Here's what its HTML Spider tool looks like

Here's the free softwware download site.

 

[edprush]

Originally posted by: scott
As linked in my other post above, why not give Free Download Manager a try?

It's free, and easily downloads entire web sites.

It has a spider which you can set some options for. It's very easy and fast to use.

Here's what its HTML Spider tool looks like

Here's the free softwware download site.

Scott, does Free Download Manager have a setting to enter a username and password for the site tht I'm trying to copy?

 

[WildHorse]

Scott, does Free Download Manager have a setting to enter a username and password for the site tht I'm trying to copy?

Not that I know of.

I rarely use the website-copying feature, but suggested it to you because the times I do use it, it works extremely well. And it's free.

Since you do already have the required password, why dont you try this:

With your web browser, log into the pwd protected area of the developmental website on his server, which will probably place a cookie onto your computer.

Then while your browser is still logged into his web site, use the Free Download Manager spider to copy his entire web site.

I think it should work. At any rate, the whole exercise would only take a couple of minutes, so it's worth a try, and is free.

 

[edprush]

I gave Free Download Manager a try.

I must admit that it was LIGHTNING fast but it didn't save anything behind the password protected area (even while I was logged into those areas). Matter of fact, Free Download Manager had a field to enter a username and password but it still didn't seem to get into area that requires login.