Download File dan Web menggunakan wget
Beberapa Contoh Penggunaan wget
Download Sebuah File
Mendownload file menggunakan wget
# wget -c --limit-rate=20k url-file-yang-akan-di-download file-tujuan
contoh
# wget -c --limit-rate=20k http://opensource.telkomspeedy.com/repo/iso/JauntyRepoDVD/ubuntu-9.04-repository-i386-2_contrib.iso /home/library/iso/ubuntu-dvd-9.04/ubuntu-9.04-repository-i386-2_contrib.iso
Mengambil database SpeedyWiki
wget http://125.160.17.21/speedyorari/view.php?file=datawiki/wikidb.sql.gz -O /home/library/library/datawiki/wikidb.sql.gz wget http://125.160.17.21/speedyorari/view.php?file=datawiki/images.tar.gz -O /home/library/library/datawiki/images.tar.gz
Download Recursive
wget -r <URL>
wget -r -p -U Mozilla http://www.stupidsite.com/restricedplace.html
wget --wait=20 --limit-rate=20K -r -p -U Mozilla http://www.stupidsite.com/restricedplace.html
Supaya jangan download directory di bawahnya
--no-parent
Contoh
wget --no-parent -r -p -U Mozilla http://www.everyayah.com/data/Abdurrahmaan_As-Sudais_192kbps/
Meneruskan Download
switch -c untuk meneruskan (continue) proses download / retrieve
wget -c --no-parent -r -p -U Mozilla http://www.everyayah.com/data/Abdurrahmaan_As-Sudais_192kbps/
wget -c --no-parent --limit-rate=8K -r -p -U Mozilla http://www.everyayah.com/data/Abdurrahmaan_As-Sudais_192kbps/
Menset Level Mirror
Level Mirror akan menentukan seberapa dalam web yang akan di copy, misalnya
wget -c --level=5 -r -p -U Mozilla http://www.web.com/
Mirror Web
Mirroring sebuah Web
wget -m -k -K -E http://url/of/web/site
atau batasi dengan level
wget -m -k -K -E -l 3 http://url/of/web/site
atau
wget -rkp -l6 -np -nH -N http://example.com/
Mirror Web CSS image
Memastikan CSS image dll terdownload dengan baik
wget -E -H -k -K -p --convert-links http://example.com
wget --random-wait -r -p -e robots=off -U mozilla http://www.example.com
wget \ --recursive \ --no-clobber \ --page-requisites \ --html-extension \ --convert-links \ --restrict-file-names=windows \ --domains example.com \ www.example.com
wget \ --recursive \ --no-clobber \ --page-requisites \ --html-extension \ --convert-links \ --restrict-file-names=windows \ --domains darmajaya.ac.id \ www.darmajaya.ac.id
Referensi
- http://www.boutell.com/newfaq/creating/mirroring.html
- http://fosswire.com/post/2008/04/create-a-mirror-of-a-website-with-wget/
- http://ask.metafilter.com/15565/How-to-convert-a-dynamic-web-pages-into-static-ones
- http://www.techrepublic.com/blog/linux-and-open-source/mirroring-web-sites-with-wget/
- http://www.techrepublic.com/blog/linux-and-open-source/mirroring-web-sites-with-wget/