Software to Save/DL most/all of a website

[chaoticjelly]

Can anyone recommend some good software to save/download most/all of a website for archival purposes?

I tried some a while back and it asked stuff like how many links to recurse through, and it seemed to work, but the site I was downloading got to over 1 gig and the program crashed

[babs]

This has always worked great for me

http://www.httrack.com/

[in5ane]

I have a distant memory of using a firefox plugin called DownThemAll, you might find it useful.

[babs]

DTA is great for following links in pages and saving files linked to, httrack extracts the structure and backbone of the website too, and creates a working copy locally.

[bignige]

Sitesucker (only for macs though)

[chaoticjelly]

I've tried Httrack on a couple of sites; the first it seemed to back-up okay, the second it just kept going and going and going, it seemed to be downloading hundreds if not thousands of jpgs from an advertising site?

I think I had this problem with another program I used, which is very frustrating

Does anyone know a program that can back up a whole forum?

[kernow]

wget?

if you were going to backup a whole forum, why not login and use the forums backup feature , if it has one, if not, backup the DB's and pages manually.

[anephric]

Teleport Pro:

http://www.tenmax.com/teleport/pro/home.htm

Used to use it in my last job to back up competitors' sites. Lets you specify how many links deep you want to go etc.

[in5ane]

Isn't that against copyright?

[babs]

No more than your browser caching pages and images.

[in5ane]

That's the worse defence ever. Caching is a byproduct of surfing a site. How is this the same as purposely downloading software to rip a competitors site, systematically downloading every single part of their website, and then storing their copyrighted images and text on a local server, to redistribute to colleagues to presumably lift ideas from.

I would never follow illegal or immoral orders as part of my job.

[gunrock]

That's the worse defence ever. Caching is a byproduct of surfing a site. How is this the same as purposely downloading software to rip a competitors site, systematically downloading every single part of their website, and then storing their copyrighted images and text on a local server, to redistribute to colleagues to presumably lift ideas from.

I would never follow illegal or immoral orders as part of my job.

Calm down. Sure it's shady practice, but it's not like he murdered someone or commited geneocide on behalf of his superiors. Jayzus.

[in5ane]

I'm pretty calm, see I didn't use any exclamation points or angry smilies.

But good advice, as long as it's not murder or genocide, it's ok!

[kernow]

hehe!

[anephric]

They were infringing our trademarks (and several patents, in some cases) and it was used as evidence when we sued them, if it makes you feel any better.