mradermacher commited on
Commit
057815f
1 Parent(s): 5da5a5d

auto-patch README.md

Browse files
Files changed (1) hide show
  1. README.md +39 -1
README.md CHANGED
@@ -1 +1,39 @@
1
- static quants of https://huggingface.co/sophosympatheia/Midnight-Miqu-103B-v1.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: []
3
+ language:
4
+ - en
5
+ library_name: transformers
6
+ quantized_by: mradermacher
7
+ tags:
8
+ - mergekit
9
+ - merge
10
+ ---
11
+ ## About
12
+
13
+ static quants of https://huggingface.co/sophosympatheia/Midnight-Miqu-103B-v1.0
14
+
15
+ <!-- provided-files -->
16
+ ## Usage
17
+
18
+ If you are unsure how to use GGUF files, refer to one of [TheBloke's
19
+ READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
20
+ more details, including on how to concatenate multi-part files.
21
+
22
+ ## Provided Quants
23
+
24
+ (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
25
+
26
+ | Link | Type | Size/GB | Notes |
27
+ |:-----|:-----|--------:|:------|
28
+ | [PART 1](https://huggingface.co/mradermacher/Midnight-Miqu-103B-v1.0-GGUF/resolve/main/Midnight-Miqu-103B-v1.0.Q4_K_M.gguf.part1of2) [PART 2](https://huggingface.co/mradermacher/Midnight-Miqu-103B-v1.0-GGUF/resolve/main/Midnight-Miqu-103B-v1.0.Q4_K_M.gguf.part2of2) | Q4_K_M | 62.3 | fast, medium quality |
29
+
30
+
31
+ Here is a handy graph by ikawrakow comparing some lower-quality quant
32
+ types (lower is better):
33
+
34
+ ![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
35
+
36
+ And here are Artefact2's thoughts on the matter:
37
+ https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
38
+
39
+ <!-- end -->