TheBloke/Falcon-180B-GGUF
Updated
•
14
•
20
Scotch & SOTA 🥃 Pt. 2: Quantized Small Boi LLM 👉👈
Run on potato, sir. GGUF & GPTQ are good friends.
Note ~~~ imagine ~~~
TheBloke/Llama-2-13B-chat-GPTQ
Text Generation • Updated • 15.5k • 362Note Probably the go-to for chat on a GPU rig
TheBloke/CodeLlama-34B-GPTQ
Text Generation • Updated • 35 • 20Note Probably the go-to for code on a GPU rig
-
TheBloke/COTHuginn-4.5-19B-GGUF
Updated • 313 • 7 -
TheBloke/Pygmalion-2-13B-GGUF
Text Generation • Updated • 1.17k • 24
TheBloke/Nous-Hermes-13B-Code-GGUF
Updated • 612 • 8Note nous hermes has been particularly good to me locally
TheBloke/MythoMax-L2-Kimiko-v2-13B-GPTQ
Text Generation • Updated • 48 • 23Note this one has some big fans 🪭
-
TheBloke/Airoboros-L2-70b-2.2-GGUF
Updated • 736 • 13
TheBloke/Spicyboros-70B-2.2-GGUF
Updated • 170 • 20Note toxic
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation • Updated • 935 • 563Note toxic
-
mistralai/Mistral-7B-v0.1
Text Generation • Updated • 390k • • 3.44k