Update README.md
Browse files
README.md
CHANGED
@@ -2,12 +2,12 @@
|
|
2 |
base_model: [deepseek-ai/DeepSeek-V2-Chat-0628]
|
3 |
---
|
4 |
|
5 |
-
# 🚀
|
6 |
|
7 |
### Currently ranked #7 globally on LMSYS Arena Hard! 🏆
|
8 |
|
9 |
|
10 |
-
>### 🚄 Just download this IQ4XM 131Gb version, it's the one I use myself:
|
11 |
>🐧 On Linux: `sudo apt install -y aria2`
|
12 |
>
|
13 |
>🍎 On Mac: `brew install aria2`
|
|
|
2 |
base_model: [deepseek-ai/DeepSeek-V2-Chat-0628]
|
3 |
---
|
4 |
|
5 |
+
# 🚀 My custom quantizations of [DeepSeek-V2-Chat-0628](https://huggingface.co/deepseek-ai/DeepSeek-V2-Chat-0628) optimized for CPU inference 🖥️
|
6 |
|
7 |
### Currently ranked #7 globally on LMSYS Arena Hard! 🏆
|
8 |
|
9 |
|
10 |
+
>### 🚄 Just download this IQ4XM 131Gb version, it's the one I use myself in prod:
|
11 |
>🐧 On Linux: `sudo apt install -y aria2`
|
12 |
>
|
13 |
>🍎 On Mac: `brew install aria2`
|