Quantcast
Channel: 看得透又看得远者prevail. ppt.cc/flUmLx ppt.cc/fqtgqx ppt.cc/fZsXUx ppt.cc/fhWnZx ppt.cc/fnrkVx ppt.cc/f2CBVx
Viewing all articles
Browse latest Browse all 20523

downloader_cluster

$
0
0
一个简单的支持多线程,断点续传及分布式的下载器.

INSTALL

ubuntu

    git clone https://github.com/ShichaoMa/downloader_cluster.git
sudo python setup.py install

or

sudo pip install downloader-cluster
#USAGE
    ubuntu@dev:~$ downloader -h
usage: downloader.py [-h] {start,reload} ...

positional arguments:
{start,reload}
start start download a file.
reload continue downlaod a file.

optional arguments:
-h, --help how this help message and exit
Command 'start'
usage: downloader.py start [-h] [-s SETTINGS] -u URL [-f FILENAME]

Command 'reload'
usage: downloader.py reload [-h] [-s SETTINGS] -u URL [-f FILENAME]
##demo1
#普通下载
downloader start -u "https://download.jetbrains.8686c.com/python/pycharm-community-2016.2.tar.gz" -f test.tar.gz
#断点续传(服务器需要提供支持)
downloader reload -u "https://download.jetbrains.8686c.com/python/pycharm-community-2016.2.tar.gz" -f test.tar.gz
##demo2 分布式下载
向redis队列中发布下载任务
实现自定义分布式下载器
参见test.py

from https://github.com/ShichaoMa/downloader_cluster

Viewing all articles
Browse latest Browse all 20523

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>