Commit
•
cedd68a
1
Parent(s):
06025fb
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
Original model: https://huggingface.co/Doctor-Shotgun/Nous-Capybara-limarpv3-34B
|
| 2 |
|
| 3 |
-
Using
|
| 4 |
|
| 5 |
5bpw - Can run 10k context in ~23.3GB VRAM with 8bit-cache option.
|
| 6 |
|
|
|
|
| 1 |
Original model: https://huggingface.co/Doctor-Shotgun/Nous-Capybara-limarpv3-34B
|
| 2 |
|
| 3 |
+
Using erotiquant-xl.parquet as calibration dataset.
|
| 4 |
|
| 5 |
5bpw - Can run 10k context in ~23.3GB VRAM with 8bit-cache option.
|
| 6 |
|