TheBloke
/

falcon-40b-instruct-GGML

Model card Files Files and versions Community

falcon-40b-instruct-GGML

1 contributor

History: 38 commits

TheBloke's picture

Update README.md

283562e over 1 year ago

.gitattributes

1.48 kB

initial commit over 1 year ago
README.md

15.2 kB

Update README.md over 1 year ago
config.json

28 Bytes

Add config.json for ctransformers over 1 year ago
falcon-40b-instruct.ggccv1.q2_k.bin

13.7 GB
LFS

Commit new GGCC format files over 1 year ago
falcon-40b-instruct.ggccv1.q3_k.bin

18 GB
LFS

Commit new GGCC format files over 1 year ago
falcon-40b-instruct.ggccv1.q4_0.bin

23.5 GB
LFS

Commit new GGCC format files over 1 year ago
falcon-40b-instruct.ggccv1.q4_1.bin

26.2 GB
LFS

Commit new GGCC format files over 1 year ago
falcon-40b-instruct.ggccv1.q4_k.bin

23.5 GB
LFS

Commit new GGCC format files over 1 year ago
falcon-40b-instruct.ggccv1.q5_0.bin

28.8 GB
LFS

Commit new GGCC format files over 1 year ago
falcon-40b-instruct.ggccv1.q5_1.bin

31.4 GB
LFS

Commit new GGCC format files over 1 year ago
falcon-40b-instruct.ggccv1.q5_k.bin

28.8 GB
LFS

Commit new GGCC format files over 1 year ago
falcon-40b-instruct.ggccv1.q6_k.bin

34.3 GB
LFS

Commit new GGCC format files over 1 year ago
falcon-40b-instruct.ggccv1.q8_0.bin

44.5 GB
LFS

Commit new GGCC format files over 1 year ago