这是indexloc提供的服务,不要输入任何密码
Skip to content

Downloads increase drive activity causing computer to freeze #448

@jsulz

Description

@jsulz

Describe the bug

Just a heads up. I'm Windows 10, 40GB system ram, 100GB virtual memory on SSD C drive. When I use your model downloader my C drive goes to 100% and system memory almost maxes out. This turns my display into a slide show and my machine even freezes for several minutes meaning my computer is unusable for the half hour or so it may take to download one 22GB model. If I download the 22GB model directly it takes 6 minutes and my machine works fine. I think your mechanism for speeding up downloads can actually slow down the end result greatly and make the machine unusable as it downloads for some systems. It may just be my setup. But it might be older systems in general.

Reproduction

import sys
import subprocess
import os
import platform
import shutil
from huggingface_hub import snapshot_download
import hf_transfer

snapshot_download(
            repo_id="tencent/SongGeneration",
            local_dir=f"SongGeneration"
        )

Logs

System info

.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions