MaziyarPanahi commited on
Commit
31c77e5
1 Parent(s): 95fce68

Upload folder using huggingface_hub (#1)

Browse files

- e696e9696e6b17e749f3d5d2d5704eba32440b0e757b5bc064508d19bf37b6e9 (8902c43819e86b479d8eb6360d9154ad51e7d667)
- 283ade1ae0cabf7bf9d1da21bbf6893fc9fde3d882370b7a0d5c6533f8e54389 (47708b8054b10ccccdc0b3ac8909cff9bf0f55fc)
- 49781f29a22fbd2745e563fc06973253c49a7553666d9d40ddff1b7341d6650c (18d27c894dcb6292f7a481805c26f57c980902c7)
- aea1b6b676855d5c714fa2bfa483ce735bd681481d89a1444c1fad8afc0a4e9c (f71e39d23a4d5a45bc26f66ad9036cc8db081b9e)
- 99068df0317f2a7e409c7a5b7288b4fac612e5d48926ece979bbcd415cbb630f (87a37fbbeee9b9997d8e4d65385d8aed762e90fb)
- 6661db63b4edc510f4c35b36e26009cefc91c2cf252b958327db9b1df98731eb (2896da27b8f5ec38268a2f5c7f0ab6024bd1f6fc)
- 24b575c7e8e7ee87dc3ccb26a359a342af984acb5430d08e0570e1b7e1f3a1e9 (828fd1c2e90313d014b6d1b5a5561ff1ddf38648)
- 0fd1274dd94c00edae65fd9ad43a0ebd39df09763829ec3ef1dc2a0c7ad44044 (f854f96742442560033690a134bb43c3b6102e30)
- 093650d153ecc6e0ab599bcec1c0c203a85d8cebd825547f41a25afc088db2ca (bd8dee823fe9046cbb0946408f283c4eb5c110eb)
- 28b6448b8834e67168bed413bc6f195f9aee15ae945a62cd8ec0b287253a9595 (ea159ea92d38630475a78815a26f3051c47de93c)
- 7bcd164e2f9660e64fabe7e3edd938637abe1e429f9c92aa388452ffc35e3d5f (6faece56accb51383f858531fb052a77328cc19f)

.gitattributes CHANGED
@@ -33,3 +33,13 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ mergekit-dare_ties-ymiqjtz.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ mergekit-dare_ties-ymiqjtz.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ mergekit-dare_ties-ymiqjtz.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ mergekit-dare_ties-ymiqjtz.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ mergekit-dare_ties-ymiqjtz.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ mergekit-dare_ties-ymiqjtz.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ mergekit-dare_ties-ymiqjtz.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ mergekit-dare_ties-ymiqjtz.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ mergekit-dare_ties-ymiqjtz.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
+ mergekit-dare_ties-ymiqjtz.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,61 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - quantized
4
+ - 2-bit
5
+ - 3-bit
6
+ - 4-bit
7
+ - 5-bit
8
+ - 6-bit
9
+ - 8-bit
10
+ - GGUF
11
+ - transformers
12
+ - safetensors
13
+ - mistral
14
+ - text-generation
15
+ - mergekit
16
+ - merge
17
+ - arxiv:2311.03099
18
+ - arxiv:2306.01708
19
+ - base_model:MaziyarPanahi/Calme-7B-Instruct-v0.9
20
+ - base_model:amazingvince/Not-WizardLM-2-7B
21
+ - base_model:Weyaxi/OpenHermes-2.5-neural-chat-v3-3-Slerp
22
+ - base_model:cognitivecomputations/dolphin-2.8-mistral-7b-v02
23
+ - autotrain_compatible
24
+ - endpoints_compatible
25
+ - text-generation-inference
26
+ - region:us
27
+ - text-generation
28
+ model_name: mergekit-dare_ties-ymiqjtz-GGUF
29
+ base_model: mergekit-community/mergekit-dare_ties-ymiqjtz
30
+ inference: false
31
+ model_creator: mergekit-community
32
+ pipeline_tag: text-generation
33
+ quantized_by: MaziyarPanahi
34
+ ---
35
+ # [MaziyarPanahi/mergekit-dare_ties-ymiqjtz-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-dare_ties-ymiqjtz-GGUF)
36
+ - Model creator: [mergekit-community](https://huggingface.co/mergekit-community)
37
+ - Original model: [mergekit-community/mergekit-dare_ties-ymiqjtz](https://huggingface.co/mergekit-community/mergekit-dare_ties-ymiqjtz)
38
+
39
+ ## Description
40
+ [MaziyarPanahi/mergekit-dare_ties-ymiqjtz-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-dare_ties-ymiqjtz-GGUF) contains GGUF format model files for [mergekit-community/mergekit-dare_ties-ymiqjtz](https://huggingface.co/mergekit-community/mergekit-dare_ties-ymiqjtz).
41
+
42
+ ### About GGUF
43
+
44
+ GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
45
+
46
+ Here is an incomplete list of clients and libraries that are known to support GGUF:
47
+
48
+ * [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
49
+ * [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
50
+ * [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
51
+ * [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
52
+ * [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
53
+ * [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
54
+ * [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
55
+ * [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
56
+ * [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
57
+ * [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
58
+
59
+ ## Special thanks
60
+
61
+ 🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
mergekit-dare_ties-ymiqjtz.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01eda6e1bcd330f2d90e0164791db47e2e3bd5ec9b3302f624fb9a7c27c86068
3
+ size 2719242144
mergekit-dare_ties-ymiqjtz.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e22761829d5025b7dd8dd0aa08fdf342c2403be63f8ee2ded718bc837433f8d
3
+ size 3822024608
mergekit-dare_ties-ymiqjtz.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82f6e757ac989c293e59b44ce179b93e418ef6e0d664d64494a4bf03738a62b5
3
+ size 3518986144
mergekit-dare_ties-ymiqjtz.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d1cd2010cbf10cd9640d2f7e7469c15fd09d0c244a3f1dbdb4567b509a90ff4
3
+ size 3164567456
mergekit-dare_ties-ymiqjtz.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f0a4edeeb0843a6e88353a8163fa4159c2505d20b3cd320aa7be4dea06960f5
3
+ size 4368439200
mergekit-dare_ties-ymiqjtz.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b25ce59800816ccdf6b221a030dc2f4a8e4668b0062087215b48759f7bc026a
3
+ size 4140373920
mergekit-dare_ties-ymiqjtz.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f64a5fc897afe07aa7a603719b6e5bee0cb818a2bafe3f652337e1be0736a75b
3
+ size 5131409312
mergekit-dare_ties-ymiqjtz.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5542b6bc76dfb04a77b366d0408f35dde859263e4dab584f6cfcec73446ab23
3
+ size 4997715872
mergekit-dare_ties-ymiqjtz.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b75398cdd80d316a96b8f781d74cddb45de331e11aa91b371cec4fb331cf628c
3
+ size 5942065056
mergekit-dare_ties-ymiqjtz.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2c35b22906369f6f67601e7485afa36e9d10093c1829578e3bce94730c14983
3
+ size 7695857568