nold
/

gemma-2b-GGUF

Inference Endpoints

Model card Files Files and versions Community

1 contributor

History: 9 commits

nold's picture

499883084fbfa8b59583c28c767d765b0fbdf41567dea098e0654a2d2bcc9808

830d52b verified 6 months ago

.gitattributes

2.02 kB

499883084fbfa8b59583c28c767d765b0fbdf41567dea098e0654a2d2bcc9808 6 months ago
README.md

21.6 kB

7c517cb83ab92ef5cc0e183b708f3374a03327a6d1afe67599b3962610da38a5 6 months ago
gemma-2b_IQ3_S.gguf

1.29 GB
LFS

7c517cb83ab92ef5cc0e183b708f3374a03327a6d1afe67599b3962610da38a5 6 months ago
gemma-2b_IQ4_NL.gguf

1.56 GB
LFS

6230660387be9e71eb0fb29a27c068ecab7514f37aed90bcfbd7ed991efe1418 6 months ago
gemma-2b_Q2_K.gguf

1.16 GB
LFS

7e78b383b207ce732ca3169c0f058dfbee9f0a70fd5a21fb6b39e5f7ec84d045 6 months ago
gemma-2b_Q3_K_M.gguf

1.38 GB
LFS

88850c94a1056e0b1c23bbbe6bcd17ed2782625beacfdd8333f7f7783685a696 6 months ago
gemma-2b_Q4_K_M.gguf

1.63 GB
LFS

11e6435a259c02e95a2a1131992e6e5568ef8d0588b618cd1a9638f12a947f08 6 months ago
gemma-2b_Q5_K_M.gguf

1.84 GB
LFS

9a1943d1681009dfb772064e3b1d38344f5c1a25ef295ce93fd5117538116e5a 6 months ago
gemma-2b_Q6_K.gguf

2.06 GB
LFS

499883084fbfa8b59583c28c767d765b0fbdf41567dea098e0654a2d2bcc9808 6 months ago
gemma-2b_Q8_0.gguf

2.67 GB
LFS

6dc5fedb5f382e78c55fe1ebd99ad26d8201c4c57a17320f30499a9e8ee7dec9 6 months ago
imatrix.dat

2.07 MB
LFS

499883084fbfa8b59583c28c767d765b0fbdf41567dea098e0654a2d2bcc9808 6 months ago
test.log

400 Bytes

499883084fbfa8b59583c28c767d765b0fbdf41567dea098e0654a2d2bcc9808 6 months ago