Most system administrators and even Linux users prefer the command line for their everyday tasks like editing, and deleting files, creating and removing users, finding IP address and so on. Downloading files is a routine task that is normally performed every day that can include file types like ZIP, TAR, ISO, PNG, etc. you can simply and quickly perform this task using the command line terminal.
One of the reasons for this is because the command line is faster and uses fewer resources. One other thing that users frequently do is download a file. They can also do it easily and more quickly using the command line. Wget and curl are the command line utilities that let you download files from the command line.
Here at LinuxAPT, as part of our Server Management Services, we regularly help our Customers to perform related Ubuntu system queries.
In this context, we shall look into how to use the wget and curl utilities to download a file on Ubuntu from the command line.
However the same commands will work on other Linux distributions like Debian, Gentoo, and CentOS as well.
Wget is a command-line tool used for downloading files from the web. Using wget, you can download a single HTML file or an entire website. It supports downloading of files using HTTP, HTTPS, and FTP protocols. It comes installed on almost all Linux OS. However, if you cannot find it in your system or it is mistakenly removed, you can install it as follows:
$ sudo apt install wgetThe basic syntax of the wget command is as follows:
$ wget [option]… [URL]…How to Download a file from command line ?
To download a file from the command line, simply type wget followed by the URL of the file you want to download. Let's say to download "vnstat-2.6.tar.gz" a network traffic monitor package from a website, the command would be:
$ wget https://humdi.net/vnstat/vnstat-2.6.tar.gzWget will start downloading the file and you will see the progress. The file will be saved to your Terminal’s current directory.
How to Resume a partially downloaded file ?
If a download is stopped due to any reason or you have manually stopped it by pressing the Ctrl+C, you can resume it using the wget command -c option. This option allows you to continue a partially downloaded file where you left it off:
$ wget -c <URL>How to Turn off verbose output ?
By default, the wget displays the verbose output showing all the details of the download process. If you want, you can limit this output using the wget -nv option:
$wget -nv <URL>This option only displays the basic information of the download process.
To completely turn off the verbose output, use the -q option:
$ wget -q <URL>How to Download multiple files ?
To download multiple files, type wget followed by the URLs of all the files.
$ wget <URL1> <URL2>The wget command will download both the files and save them to your current Terminal directory.
Another way to download multiple files is by using the wget -i option. Let’s say you need to download a large number of files.
All you need is to create a text file and list all URLs in this file (one URL per line). Then type wget followed by -i option and the file name containing a list of URLs:
$ wget -i <filename>Note: Here, we have used the -nv option to turn off the verbose output.
How to Download Files Using Curl ?
Curl is a command-line tool used for downloading and uploading files to or from the server. It supports over 20 protocols including FTP, HTTP, HTTPS, TFTP, IMAP, LDAP, etc
Curl comes installed on almost all Linux OS. However, if you cannot find it in your system or it is mistakenly removed, you can install it as follows:
$ sudo apt install curlThe basic syntax of the curl command is as follows:
$ curl [option]… [URL]…Basic curl command usage
The basic use of the curl command is to download a single file or a content of a webpage. Let’s say to download a webpage "index.html", we would type curl followed by the URL of the webpage:
$ curl <URL>This command will download the specified file in your current directory.
Once you run the above curl command, you will see the HTML content displayed on the screen.
How to Save the content of the page to a file ?
You can download and save the content of a page to a file instead of displaying it on the screen. To save the file to your system, use the curl command -O or -o option. The -O option saves the file with the same name as the file in the remote location. While the -o option allows saving the file with a different name.
The -O option
With the -O option, you do not need to specify the file name. It will save the file in your system with the name of the file in the remote location:
$ curl -O <URL>For instance, the below command will save the file with the name "index.html":
$ curl -O https://www.cisco.com/c/en/us/support/switches/index.htmlThe -o option
With the -o option, you can specify a file name of your choice:
$ curl -o filename <URL>For instance, the following command will save the file with the name "switches.html":
$ curl -o switches.html https://www.cisco.com/c/en/us/support/switches/index.htmlHow to Run curl silently ?
If you do not want to view any progress bar or any error message during the curl download process, you can make it silent using the -s option as follows:
$ curl -s <URL>How to Download multiple files ?
To download multiple files, type curl followed by the URLs of all the files:
$ curl -O [URL1] -O [URL2] -O [URL3]….This command will save all the files to your current Terminal directory.
If there are too many URLs that you need to download, then create a text file and list the URLs in it.
Then to download all the URLs listed in the file, use the following command:
$ xargs -n 1 curl -O < filenameYou can then use the ls command to confirm if all the files have been downloaded.
How to Resume a partially downloaded file ?
If a download is stopped due to any reason or you have manually stopped it by pressing the Ctrl+C, you can resume it using the curl command "-C –" option. This option allows you to continue a partially downloaded file where you left it off:
$ curl -C - <URL>This article covers Both wget and curl which are the free and open-source command-line utilities used for the non-interactive downloading of files. Remember, although both the utilities can download files from the web; they do differ a lot in terms of functionalities.
url can be used to transfer data over a number of protocols. It supports many protocols including HTTP, HTTPS, FTP, TFTP, TELNET, SCP, etc. using Curl, you can download any remote files. It supports pause and resumes functions as well.
To Install curl,
Launch command line application in Ubuntu that is Terminal by pressing the Ctrl+Alt+T key combinations. Then enter the below command to install curl with sudo:
$ sudo apt install curl
