TheBloke

/

Genz-70b-GPTQ

like 36

Hi there,

congrat for the nice work. we wanted to use it but we are unable to clone the repo. The issue seems to be the single 37 Gb file model.safetensors. I have no issue to clone Llama 2 70B models (total size >128 GB but maximum file size is 10 Gb)

git clone https://huggingface.co/TheBloke/Genz-70b-GPTQ
Cloning into ‘Genz-70b-GPTQ’...
remote: Enumerating objects: 109, done.
remote: Counting objects: 100% (106/106), done.
remote: Compressing objects: 100% (106/106), done.
remote: Total 109 (delta 43), reused 0 (delta 0), pack-reused 3
Receiving objects: 100% (109/109), 503.54 KiB | 2.75 MiB/s, done.
Resolving deltas: 100% (43/43), done.
Downloading model.safetensors (37 GB)
[1] 3116 killed git clone https://huggingface.co/TheBloke/Genz-70b-GPTQ

Is this a know issue ? Is there a trick to have it working ? Is there some reason to have one single file and not few shard ?

Thanks