Go to Post Without the game, there is no FIRST ... period. - Paul Copioli [more]
Home
Go Back   Chief Delphi > Technical > IT / Communications
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Closed Thread
Thread Tools Rate Thread Display Modes
  #1   Spotlight this post!  
Unread 25-11-2005, 13:21
sanddrag sanddrag is offline
On to my 16th year in FRC
FRC #0696 (Circuit Breakers)
Team Role: Teacher
 
Join Date: Jul 2002
Rookie Year: 2002
Location: Glendale, CA
Posts: 8,518
sanddrag has a reputation beyond reputesanddrag has a reputation beyond reputesanddrag has a reputation beyond reputesanddrag has a reputation beyond reputesanddrag has a reputation beyond reputesanddrag has a reputation beyond reputesanddrag has a reputation beyond reputesanddrag has a reputation beyond reputesanddrag has a reputation beyond reputesanddrag has a reputation beyond reputesanddrag has a reputation beyond repute
Best way to download an entire website

What's the best way to download an entire website (maybe 100 html pages) onto my computer? (It's not my website btw so I don't have ftp access).
__________________
Teacher/Engineer/Machinist - Team 696 Circuit Breakers, 2011 - Present
Mentor/Engineer/Machinist, Team 968 RAWC, 2007-2010
Technical Mentor, Team 696 Circuit Breakers, 2005-2007
Student Mechanical Leader and Driver, Team 696 Circuit Breakers, 2002-2004
  #2   Spotlight this post!  
Unread 25-11-2005, 15:50
Dave Flowerday Dave Flowerday is offline
Software Engineer
VRC #0111 (Wildstang)
Team Role: Engineer
 
Join Date: Feb 2002
Rookie Year: 1995
Location: North Barrington, IL
Posts: 1,366
Dave Flowerday has a reputation beyond reputeDave Flowerday has a reputation beyond reputeDave Flowerday has a reputation beyond reputeDave Flowerday has a reputation beyond reputeDave Flowerday has a reputation beyond reputeDave Flowerday has a reputation beyond reputeDave Flowerday has a reputation beyond reputeDave Flowerday has a reputation beyond reputeDave Flowerday has a reputation beyond reputeDave Flowerday has a reputation beyond reputeDave Flowerday has a reputation beyond repute
Re: Best way to download an entire website

Quote:
Originally Posted by sanddrag
What's the best way to download an entire website (maybe 100 html pages) onto my computer? (It's not my website btw so I don't have ftp access).
wget is designed for just that: http://www.gnu.org/software/wget/wget.html

Obviously you need to be careful of copyrights etc. since it's not your website, depending on what you want to do with it.
  #3   Spotlight this post!  
Unread 25-11-2005, 22:13
BrianBSL BrianBSL is offline
Registered User
FRC #0190
 
Join Date: Sep 2004
Rookie Year: 2000
Location: Worcester, MA
Posts: 251
BrianBSL has much to be proud ofBrianBSL has much to be proud ofBrianBSL has much to be proud ofBrianBSL has much to be proud ofBrianBSL has much to be proud ofBrianBSL has much to be proud ofBrianBSL has much to be proud ofBrianBSL has much to be proud ofBrianBSL has much to be proud ofBrianBSL has much to be proud of
Re: Best way to download an entire website

If you prefer a more GUI based approach, I've used Teleport Pro with a lot of luck as well. But for simple sites, wget does a fine job and is free.
  #4   Spotlight this post!  
Unread 26-11-2005, 17:35
Mike AA's Avatar
Mike AA Mike AA is offline
Programmer and Mentor
AKA: Mike Aalderink
FRC #3458 (Code Blue)
Team Role: Programmer
 
Join Date: Jan 2003
Rookie Year: 1999
Location: Holland, Mi
Posts: 698
Mike AA is a splendid one to beholdMike AA is a splendid one to beholdMike AA is a splendid one to beholdMike AA is a splendid one to beholdMike AA is a splendid one to beholdMike AA is a splendid one to beholdMike AA is a splendid one to beholdMike AA is a splendid one to behold
Send a message via MSN to Mike AA
Re: Best way to download an entire website

Teleport pro works very good for downloading sites with many files and large files which you dont want to wait for one then have to click on the next to download, I did this with soap's website getting all the videos. instead of it taking me days downloading 2 files at a time it was able to download 5/6 at a time and quicker in some cases.

It would depend on the website size, wget would work for simple/small but teleport pro would mostlikely work faster for a bigger site.

-Mike
  #5   Spotlight this post!  
Unread 26-11-2005, 18:43
Elgin Clock's Avatar
Elgin Clock Elgin Clock is offline
updates this status less than FB!
AKA: the one who "will break into your thoughts..."
FRC #0237 (Black Magic)
Team Role: Mentor
 
Join Date: May 2001
Rookie Year: 2001
Location: H20-Town, Connecticut
Posts: 7,773
Elgin Clock has a reputation beyond reputeElgin Clock has a reputation beyond reputeElgin Clock has a reputation beyond reputeElgin Clock has a reputation beyond reputeElgin Clock has a reputation beyond reputeElgin Clock has a reputation beyond reputeElgin Clock has a reputation beyond reputeElgin Clock has a reputation beyond reputeElgin Clock has a reputation beyond reputeElgin Clock has a reputation beyond reputeElgin Clock has a reputation beyond repute
Send a message via AIM to Elgin Clock
Re: Best way to download an entire website

I found that Teleport Pro application, and it lets you have a 40 use free trial..

Now to have some fun.. Let's see what this thing can do.


Linkage: http://www.tenmax.com/teleport/pro/download.htm

edit: It works pretty good.. It has many options and lets you for example DL all the music type files (wav, mp3, aiff) from a website..

I should see if Myspace could handle a mass DL of all the filetypes music or video related..
I think I would either A) Kill my computer, or B) Kill Myspace..

In any case, it would be fun.
__________________
The influence of many leads to the individuality of one. - E.C.C. (That's me!!)


Last edited by Elgin Clock : 26-11-2005 at 18:51.
  #6   Spotlight this post!  
Unread 26-11-2005, 19:22
Mike AA's Avatar
Mike AA Mike AA is offline
Programmer and Mentor
AKA: Mike Aalderink
FRC #3458 (Code Blue)
Team Role: Programmer
 
Join Date: Jan 2003
Rookie Year: 1999
Location: Holland, Mi
Posts: 698
Mike AA is a splendid one to beholdMike AA is a splendid one to beholdMike AA is a splendid one to beholdMike AA is a splendid one to beholdMike AA is a splendid one to beholdMike AA is a splendid one to beholdMike AA is a splendid one to beholdMike AA is a splendid one to behold
Send a message via MSN to Mike AA
Re: Best way to download an entire website

Quote:
Originally Posted by Elgin Clock
I found that Teleport Pro application, and it lets you have a 40 use free trial..

Now to have some fun.. Let's see what this thing can do.


Linkage: http://www.tenmax.com/teleport/pro/download.htm

edit: It works pretty good.. It has many options and lets you for example DL all the music type files (wav, mp3, aiff) from a website..

I should see if Myspace could handle a mass DL of all the filetypes music or video related..
I think I would either A) Kill my computer, or B) Kill Myspace..

In any case, it would be fun.
with the demo version you wont get very far, I ran it demo before I got my access code, then it works like a charm, it most likely WONT crash your computer nor another website, it simply goes into the file system and copies each file, little is required of the processor. Try copying myspace and you'll get all the files and videos which you select it to copy, or select all and it'll copy all

-Mike
  #7   Spotlight this post!  
Unread 18-12-2005, 00:59
scottmso scottmso is offline
Registered User
FRC #1561 (RoboDucks)
Team Role: Programmer
 
Join Date: Jan 2005
Rookie Year: 2005
Location: Oklahoma City, OK
Posts: 26
scottmso is an unknown quantity at this point
Send a message via AIM to scottmso
Re: Best way to download an entire website

Don't know if you need this anymore but I've used this free program called HTTrack and it works nicely: http://www.httrack.com/
Closed Thread


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Web Excellence Award Winners (Which Teams?) OZ_341 Website Design/Showcase 39 10-07-2004 20:19
Website Excellence? Tom Bottiglieri Website Design/Showcase 4 15-03-2004 02:43
Looking for an easy website for your team? Jack Website Design/Showcase 2 30-12-2003 23:32
PLEASE Enter your robot and website Jeremy_Mc Scouting 1 28-02-2003 15:27
need a website? download our web site Jeremy_Mc Website Design/Showcase 6 17-11-2002 15:46


All times are GMT -5. The time now is 14:55.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi