bartowski
/

magnum-v4-123b-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

magnum-v4-123b-GGUF

1 contributor

History: 17 commits

bartowski's picture

Upload magnum-v4-123b-IQ2_XS.gguf with huggingface_hub

a55eabf verified 17 days ago

magnum-v4-123b-IQ3_M
Upload folder using huggingface_hub 17 days ago
magnum-v4-123b-IQ4_XS
Upload folder using huggingface_hub 17 days ago
magnum-v4-123b-Q3_K_L
Upload folder using huggingface_hub 17 days ago
magnum-v4-123b-Q3_K_M
Upload folder using huggingface_hub 17 days ago
magnum-v4-123b-Q3_K_S
Upload folder using huggingface_hub 17 days ago
magnum-v4-123b-Q3_K_XL
Upload folder using huggingface_hub 17 days ago
magnum-v4-123b-Q4_0
Upload folder using huggingface_hub 17 days ago
magnum-v4-123b-Q4_K_M
Upload folder using huggingface_hub 17 days ago
magnum-v4-123b-Q5_K_M
Upload folder using huggingface_hub 17 days ago
magnum-v4-123b-Q6_K
Upload folder using huggingface_hub 17 days ago
magnum-v4-123b-Q8_0
Upload folder using huggingface_hub 17 days ago
.gitattributes

4.4 kB

Upload magnum-v4-123b-IQ2_XS.gguf with huggingface_hub 17 days ago
magnum-v4-123b-IQ2_M.gguf

41.6 GB
LFS

Upload magnum-v4-123b-IQ2_M.gguf with huggingface_hub 17 days ago
magnum-v4-123b-IQ2_XS.gguf

36.1 GB
LFS

Upload magnum-v4-123b-IQ2_XS.gguf with huggingface_hub 17 days ago
magnum-v4-123b-IQ3_XXS.gguf

47 GB
LFS

Upload magnum-v4-123b-IQ3_XXS.gguf with huggingface_hub 17 days ago
magnum-v4-123b-Q2_K.gguf

45.2 GB
LFS

Upload magnum-v4-123b-Q2_K.gguf with huggingface_hub 17 days ago
magnum-v4-123b-Q2_K_L.gguf

45.6 GB
LFS

Upload magnum-v4-123b-Q2_K_L.gguf with huggingface_hub 17 days ago