NightFox
/

saiga_gemma_9b_GGUF

Inference Endpoints

Model card Files Files and versions Community

NightFox commited on Feb 28

Commit

1048bf7

•

1 Parent(s): 667dbf5

Create README.md

Files changed (1) hide show

README.md +3 -0

README.md ADDED Viewed

	@@ -0,0 +1,3 @@


1	+ GGUF for https://huggingface.co/IlyaGusev/saiga_gemma_9b
2	+
3	+ `bloat16->f32->[Q8_0, Q6_K, Q5_K_M]`