InferenceIllusionist
/

mathstral-7B-v0.1-iMat-GGUF

Inference Endpoints

Model card Files Files and versions Community

mathstral-7B-v0.1-iMat-GGUF / .gitattributes

Commit History

Upload ggml-model-f16.gguf

a415978
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-f16.imatrix

5dc98b1
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-IQ1_M.gguf

d7031cb
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-IQ2_XXS.gguf

3202753
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-IQ2_XS.gguf

29e57ab
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-IQ2_S.gguf

fa455cc
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-IQ2_M.gguf

55b46d5
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-IQ3_XXS.gguf

0579833
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-IQ3_XS.gguf

870054e
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-IQ3_S.gguf

8063d44
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-IQ3_M.gguf

96c3965
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-IQ4_XS.gguf

16b1a3c
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-Q2_K.gguf

ed71ee4
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-Q3_K_S.gguf

9906390
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-Q3_K_M.gguf

807963e
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-Q4_K_S.gguf

7b7d8b3
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-Q4_K_M.gguf

fc63d0a
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-Q5_K_S.gguf

ed08674
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-Q5_K_M.gguf

a51ac15
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-Q6_K.gguf

b83d830
verified

InferenceIllusionist commited on Jul 16

Upload mathstral-7B-v0.1-iMat-Q8_0.gguf

f0c5d48
verified

InferenceIllusionist commited on Jul 16

initial commit

1d8571a
verified

InferenceIllusionist commited on Jul 16