• Stars
    star
    540
  • Rank 82,257 (Top 2 %)
  • Language
    Python
  • License
    MIT License
  • Created over 1 year ago
  • Updated 6 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

huggingface mirror download

从Huggingface下载模型(断点续传)

1、安装python虚拟环境

# windows到Anaconda官网下载安装
# Linux用以下方法安装
wget https://repo.anaconda.com/archive/Anaconda3-2022.10-Linux-x86_64.sh
chmod +x Anaconda3-2022.10-Linux-x86_64.sh
./Anaconda3-2022.10-Linux-x86_64.sh
source ~/.bashrc

2、创建虚拟环境

git clone https://github.com/git-cloner/aliendao
cd aliendao
conda create -n aliendao python=3.10 -y
conda activate aliendao
pip install -r requirements.txt -i https://pypi.mirrors.ustc.edu.cn/simple --trusted-host=pypi.mirrors.ustc.edu.cn

3、下载

conda activate aliendao
# 下载模型,带上mirror优先从镜像下载
python model_download.py --repo_id 模型ID --mirror
# 举例
python model_download.py --repo_id baichuan-inc/Baichuan-7B --mirror
# 下载数据集
python model_download.py --repo_id 数据集ID --repo_type dataset --mirror
# 举例
python model_download.py --repo_id tatsu-lab/alpaca --repo_type dataset --mirror