- If you are looking to download an entire publicly shared folder (without auth!): OneDeath. It uses wget to do some API calls and will then recursively download files. Bonus: sha1 checks of finished files. Sharepoint is now also supported, but it's a little trickier (it currently fetches more files from a drive than what is shown by the link).
- Many of the answers below are not a satisfactory replacement for wget.Among other things, wget (1) preserves timestamps (2) auto-determines filename from url, appending.1 (etc.) if the file already exists (3) has many other options, some of which you may have put in your.wgetrc.If you want any of those, you have to implement them yourself in Python, but it's simpler to just invoke wget from.
There will be times when you need access to a website when you do not have access to the internet. Or, you want to make a backup of your own website but the host that you are using does not have this option. Maybe you want to use a popular website for reference when building your own, and you need 24/7 access to it. Whatever the case may be, there are a few ways that you can go about downloading an entire website to view at your leisure offline. Some websites won't stay online forever, so this is even more of a reason to learn how to download them for offline viewing. These are some of your options for downloading a whole website so that it can be viewed offline at a later time, whether you are using a computer, tablet, or smartphone. Here are the best Website Download Tools for downloading an entire website for offline viewing.
GNU Wget is a free utility for non-interactive download of files from the Web.
1. HTTrack
This free tool enables easy downloading for offline viewing. It allows the user to download a website from the internet to their local directory, where it will build the directory of the website using the HTML, files, and images from the server onto your computer. HTTrack will automatically arrange the structure of the original website. All that you need to do is open a page of the mirrored website on your own browser, and then you will be able to browse the website exactly as you would be doing online. You will also be able to update an already downloaded website if it has been modified online, and you can resume any interrupted downloads. The program is fully configurable, and even has its own integrated help system.
2. GetLeft
To use this website grabber, all that you have to do is provide the URL, and it downloads the complete website, according to the options that you have specified. It edits the original pages as well as the links to relative links so that you are able to browse the site on your hard disk. You will be able to view the sitemap prior to downloading, resume an interrupted download, and filter it so that certain files are not downloaded. 14 languages are supported, and you are able to follow links to external websites. GetLeft is great for downloading smaller sites offline, and larger websites when you choose to not download larger files within the site itself.
3. Cyotek Webcopy
This free tool can be used to copy partial or full websites to your local hard disk so that they can be viewed later offline. WebCopy works by scanning the website that has been specified, and then downloading all of its contents to your computer. Links that lead to things like images, stylesheets, and other pages will be automatically remapped so that they match the local path. Because of the intricate configuration, you are able to define which parts of the website are copied and which are not. Essentially, WebCopy looks at the HTML of a website to discover all of the resources contained within the site.
4. SiteSucker
This application is used only on Mac computers, and is made to automatically download websites from the internet. It does this by collectively copying the website's individual pages, PDFs, style sheets, and images to your own local hard drive, thus duplicating the website's exact directory structure. All that you have to do is enter the URL and hit enter. SiteSucker will take care of the rest. Essentially you are making local copies of a website, and saving all of the information about the website into a document that can be accessed whenever it is needed, regardless of internet connection. You also have the ability to pause and restart downloads. Websites may also be translated from English into French, German, Italian, Portuguese, and Spanish.
5. GrabzIt
In addition to grabbing data from websites, it will grab data from PDF documents as well with the scraping tool. First, you will need to identify the website or sections of websites that you want to scrape the data from and when you would like it to be done. You will also need to define the structure that the scraped data should be saved. Finally, you will need to define how the data that was scraped should be packaged—meaning how it should be presented to you when you browse it. This scraper reads the website in the way that it is seen by users, using a specialized browser. This specialized browser allows the scraper to lift the dynamic and static content to transfer it to your local disk. When all of these things are scraped and formatted on your local drive, you will be able to use and navigate the website in the same way that if it were accessed online.
6. Telport Pro
This is a great all-around tool to use for gathering data from the internet. You are able to access and launch up to 10 retrieval threads, access sites that are password protected, you can filter files by their type, and even search for keywords. It has the capacity to handle any size website with no problem. It is said to be one of the only scrapers that can find every file type possible on any website. The highlights of the program are the ability to: search websites for keywords, explore all pages from a central site, list all pages from a site, search a site for a specific file type and size, create a duplicate of a website with subdirectory and all files, and download all or parts of the site to your own computer.
7. FreshWebSuction
This is a freeware browser for those who are using Windows. Not only are you able to browse websites, but the browser itself will act as the webpage downloader. Create projects to store your sites offline. You are able to select how many links away from the starting URL that you want to save from the site, and you can define exactly what you want to save from the site like images, audio, graphics, and archives. This project becomes complete once the desired web pages have finished downloading. After this, you are free to browse the downloaded pages as you wish, offline. In short, it is a user friendly desktop application that is compatible with Windows computers. You can browse websites, as well as download them for offline viewing. You are able to completely dictate what is downloaded, including how many links from the top URL you would like to save.
How to Download With No Program
There is a way to download a website to your local drive so that you can access it when you are not connected to the internet. You will have to open the homepage of the website. This will be the main page. You will right-click on the site and choose Save Page As. You will choose the name of the file and where it will download to. It will begin downloading the current and related pages, as long as the server does not need permission to access the pages.
Alternatively, if you are the owner of the website, you can download it from the server by zipping it. When this is done, you will be getting a backup of the database from phpmyadmin, and then you will need to install it on your local server.
Using the GNU Wget Command
Sometimes simply referred to as just wget and formerly known as geturl, it is a computer program that will retrieve content from web servers. As part of the GNU project, it supports downloads through HTTP, HTTPS, and FTP protocol. It allows recursive downloads, the conversion of links for offline viewing for local HTML, as well as support for proxies.
To use the GNU wget command, it will need to be invoked from the command line, while giving one or more URLs as the argument.
When used in a more complex manner, it can invoke the automatic download of multiple URLs into a hierarchy for the directory.
Mobile Options
Can you recall how many times you have been reading an article on your phone or tablet and been interrupted, only to find that you lost it when you came back to it? Or found a great website that you wanted to explore but wouldn't have the data to do so? This is when saving a website on your mobile device comes in handy.
Offline Pages Pro allows you to save any website to your mobile phone so that it can be viewed while you are offline. What makes this different from the computer applications and most other phone applications is that the program will save the whole webpage to your phone—not just the text without context. It saves the format of the site so that it is no different than looking at the website online. The app does require a one-time purchase of $9.99. When you need to save a web page, you will just have to click on the button next to the web address bar. This triggers the page to be saved so that it can be viewed offline whenever you need. The process is so simple. In the Pro version of the app, you are able to tag pages, making it easier for you to find them later with your own organized system. To access the saved pages, in the app you will click on the button in the middle of the screen on the bottom. Here will be a list of all of your saved pages. To delete a page, simply swipe it and hit the button when the option to delete comes up. Or, you may use the Edit button to mark other pages to be deleted. In the Pro version, you can opt to have websites that you have saved to be automatically updated periodically, allowing you to keep all of your sites current for the next time that you go offline.
Read Offline for Android is a free app for Android devices. This application allows you to download websites onto your phone so that they can be accessed at a later time when you may be offline. The websites are stored locally on your phone's memory, so you will need to make sure that you have the proper storage available. In the end, you will have access to pages that are capable of being browsed quickly, just like if they were actually being accessed online. It is a user friendly app that is compatible with all Android devices, like smartphones or tablets. You will be downloading webpages directly to your phone, ideal for reading websites offline.
Updated: October 14, 2020 Home » The Web » Web Tools, Services, and Resources
With today’s internet speed and accountabilities, there is not much reason to download an entire website for offline use. Maybe you need a copy of a site as backup or you place to travel somewhere remote, these tools will enable you to download entire website for offline reading.
Alternative 2020 Article ➤ 60 Best Websites To Download Free ePub and PDF EBooks
Here’s a quick list of some of the best website downloading software programs to get you started. HTTrack is the best and have been the favorite by many for many years.
↓ 01 – HTTrack | Windows | macOS | Linux
HTTrack is a free (GPL, libre/free software) and easy-to-use offline browser utility. It allows you to download a World Wide Web site from the Internet to a local directory, building recursively all directories, getting HTML, images, and other files from the server to your computer. HTTrack arranges the original site’s relative link-structure. Simply open a page of the “mirrored” website in your browser, and you can browse the site from link to link, as if you were viewing it online. HTTrack can also update an existing mirrored site, and resume interrupted downloads. HTTrack is fully configurable, and has an integrated help system.
↓ 02 – Cyotek WebCopy | Windows
Cyotek WebCopy is a free tool for copying full or partial websites locally onto your harddisk for offline viewing. WebCopy will scan the specified website and download its content onto your harddisk. Links to resources such as style-sheets, images, and other pages in the website will automatically be remapped to match the local path. Using its extensive configuration you can define which parts of a website will be copied and how.
WebCopy will examine the HTML mark-up of a website and attempt to discover all linked resources such as other pages, images, videos, file downloads – anything and everything. It will download all of theses resources, and continue to search for more. In this manner, WebCopy can “crawl” an entire website and download everything it sees in an effort to create a reasonable facsimile of the source website.
↓ 03 – UnMHT | Firefox Addon
UnMHT allows you to view MHT (MHTML) web archive format files, and save complete web pages, including text and graphics, into a single MHT file in Firefox/SeaMonkey. MHT (MHTML, RFC2557) is the webpage archive format to store HTML and images, CSS into single file.
- Save webpage as MHT file.
- Insert URL of the webpage and date you saved into saved MHT file.
- Save multiple tabs as MHT files at once.
- Save multiple tabs into a single MHT file.
- Save webpage by single click into prespecified directory with Quick Save feature.
- Convert HTML files and directory which contains files used by the HTML into MHT file.
- View the MHT file saved by UnMHT, IE, PowerPoint, etc.
↓ 04 – grab-site | macOS | Linux
How To Download Wget
grab-site is an easy preconfigured web crawler designed for backing up websites. Give grab-site a URL and it will recursively crawl the site and write WARC files. Internally, grab-site uses a fork of wpull for crawling. grab-site is a crawler for archiving websites to WARC files. It includes a dashboard for monitoring multiple crawls, and supports changing URL ignore patterns during the crawl.
↓ 05 – WebScrapBook | Firefox Addon
WebScrapBook is a browser extension that captures the web page faithfully with various archive formats and customizable configurations. This project inherits from legacy Firefox addon ScrapBook X. A wab page can be saved as a folder, a zip-packed archive file (HTZ or MAFF), or a single HTML file (optionally scripted as an enhance). An archive file can be viewed by opening the index page after unzipping, using the built-in archive page viewer, or with other assistant tools.
↓ 06 – Archivarix | 200 Files Free | Online
Website downloader and Content Management System (CMS) existing site converter. Download an entire live website – 200 files free! Ability to download .onion sites! Their Website downloader system allows you to download up to 200 files from a website for free. If there are more files on the site and you need all of them, then you can pay for this service. Download cost depends on the number of files. You can download from existing website, Wayback Machine or Google Cache.
↓ 07 – Website Downloader | Online
Website Downloader, Website Copier or Website Ripper allows you to download websites from the Internet to your local hard drive on your own computer. Website Downloader arranges the downloaded site by the original websites relative link-structure. The downloaded website can be browsed by opening one of the HTML pages in a browser.
Wget Download Website
After cloning a website to your hard drive you can open the websites source code with a code editor or simply browse it offline using a browser of your choosing. Site Downloader can be used for multiple different purposes. It’s a truly simple to use website download software without downloading anything.
- Backups – If you have a website, you should always have a recent backup of the website in case the server breaks or you get hacked. Website Downloader is the fastest and easiest option to take a backup of your website, it allows you to download whole website.
- Offline Website Downloader – Download website offline for your future reference, which you can access even without an internet connection, say. when you are on a flight or an island vacation!
