Upload folder using huggingface_hub (#1)
Browse files- e696e9696e6b17e749f3d5d2d5704eba32440b0e757b5bc064508d19bf37b6e9 (8902c43819e86b479d8eb6360d9154ad51e7d667)
- 283ade1ae0cabf7bf9d1da21bbf6893fc9fde3d882370b7a0d5c6533f8e54389 (47708b8054b10ccccdc0b3ac8909cff9bf0f55fc)
- 49781f29a22fbd2745e563fc06973253c49a7553666d9d40ddff1b7341d6650c (18d27c894dcb6292f7a481805c26f57c980902c7)
- aea1b6b676855d5c714fa2bfa483ce735bd681481d89a1444c1fad8afc0a4e9c (f71e39d23a4d5a45bc26f66ad9036cc8db081b9e)
- 99068df0317f2a7e409c7a5b7288b4fac612e5d48926ece979bbcd415cbb630f (87a37fbbeee9b9997d8e4d65385d8aed762e90fb)
- 6661db63b4edc510f4c35b36e26009cefc91c2cf252b958327db9b1df98731eb (2896da27b8f5ec38268a2f5c7f0ab6024bd1f6fc)
- 24b575c7e8e7ee87dc3ccb26a359a342af984acb5430d08e0570e1b7e1f3a1e9 (828fd1c2e90313d014b6d1b5a5561ff1ddf38648)
- 0fd1274dd94c00edae65fd9ad43a0ebd39df09763829ec3ef1dc2a0c7ad44044 (f854f96742442560033690a134bb43c3b6102e30)
- 093650d153ecc6e0ab599bcec1c0c203a85d8cebd825547f41a25afc088db2ca (bd8dee823fe9046cbb0946408f283c4eb5c110eb)
- 28b6448b8834e67168bed413bc6f195f9aee15ae945a62cd8ec0b287253a9595 (ea159ea92d38630475a78815a26f3051c47de93c)
- 7bcd164e2f9660e64fabe7e3edd938637abe1e429f9c92aa388452ffc35e3d5f (6faece56accb51383f858531fb052a77328cc19f)
- .gitattributes +10 -0
- README.md +61 -0
- mergekit-dare_ties-ymiqjtz.Q2_K.gguf +3 -0
- mergekit-dare_ties-ymiqjtz.Q3_K_L.gguf +3 -0
- mergekit-dare_ties-ymiqjtz.Q3_K_M.gguf +3 -0
- mergekit-dare_ties-ymiqjtz.Q3_K_S.gguf +3 -0
- mergekit-dare_ties-ymiqjtz.Q4_K_M.gguf +3 -0
- mergekit-dare_ties-ymiqjtz.Q4_K_S.gguf +3 -0
- mergekit-dare_ties-ymiqjtz.Q5_K_M.gguf +3 -0
- mergekit-dare_ties-ymiqjtz.Q5_K_S.gguf +3 -0
- mergekit-dare_ties-ymiqjtz.Q6_K.gguf +3 -0
- mergekit-dare_ties-ymiqjtz.Q8_0.gguf +3 -0
@@ -33,3 +33,13 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
mergekit-dare_ties-ymiqjtz.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
37 |
+
mergekit-dare_ties-ymiqjtz.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
38 |
+
mergekit-dare_ties-ymiqjtz.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
39 |
+
mergekit-dare_ties-ymiqjtz.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
40 |
+
mergekit-dare_ties-ymiqjtz.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
41 |
+
mergekit-dare_ties-ymiqjtz.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
42 |
+
mergekit-dare_ties-ymiqjtz.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
43 |
+
mergekit-dare_ties-ymiqjtz.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
44 |
+
mergekit-dare_ties-ymiqjtz.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
45 |
+
mergekit-dare_ties-ymiqjtz.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
@@ -0,0 +1,61 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
tags:
|
3 |
+
- quantized
|
4 |
+
- 2-bit
|
5 |
+
- 3-bit
|
6 |
+
- 4-bit
|
7 |
+
- 5-bit
|
8 |
+
- 6-bit
|
9 |
+
- 8-bit
|
10 |
+
- GGUF
|
11 |
+
- transformers
|
12 |
+
- safetensors
|
13 |
+
- mistral
|
14 |
+
- text-generation
|
15 |
+
- mergekit
|
16 |
+
- merge
|
17 |
+
- arxiv:2311.03099
|
18 |
+
- arxiv:2306.01708
|
19 |
+
- base_model:MaziyarPanahi/Calme-7B-Instruct-v0.9
|
20 |
+
- base_model:amazingvince/Not-WizardLM-2-7B
|
21 |
+
- base_model:Weyaxi/OpenHermes-2.5-neural-chat-v3-3-Slerp
|
22 |
+
- base_model:cognitivecomputations/dolphin-2.8-mistral-7b-v02
|
23 |
+
- autotrain_compatible
|
24 |
+
- endpoints_compatible
|
25 |
+
- text-generation-inference
|
26 |
+
- region:us
|
27 |
+
- text-generation
|
28 |
+
model_name: mergekit-dare_ties-ymiqjtz-GGUF
|
29 |
+
base_model: mergekit-community/mergekit-dare_ties-ymiqjtz
|
30 |
+
inference: false
|
31 |
+
model_creator: mergekit-community
|
32 |
+
pipeline_tag: text-generation
|
33 |
+
quantized_by: MaziyarPanahi
|
34 |
+
---
|
35 |
+
# [MaziyarPanahi/mergekit-dare_ties-ymiqjtz-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-dare_ties-ymiqjtz-GGUF)
|
36 |
+
- Model creator: [mergekit-community](https://huggingface.co/mergekit-community)
|
37 |
+
- Original model: [mergekit-community/mergekit-dare_ties-ymiqjtz](https://huggingface.co/mergekit-community/mergekit-dare_ties-ymiqjtz)
|
38 |
+
|
39 |
+
## Description
|
40 |
+
[MaziyarPanahi/mergekit-dare_ties-ymiqjtz-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-dare_ties-ymiqjtz-GGUF) contains GGUF format model files for [mergekit-community/mergekit-dare_ties-ymiqjtz](https://huggingface.co/mergekit-community/mergekit-dare_ties-ymiqjtz).
|
41 |
+
|
42 |
+
### About GGUF
|
43 |
+
|
44 |
+
GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
|
45 |
+
|
46 |
+
Here is an incomplete list of clients and libraries that are known to support GGUF:
|
47 |
+
|
48 |
+
* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
|
49 |
+
* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
|
50 |
+
* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
|
51 |
+
* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
|
52 |
+
* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
|
53 |
+
* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
|
54 |
+
* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
|
55 |
+
* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
|
56 |
+
* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
|
57 |
+
* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
|
58 |
+
|
59 |
+
## Special thanks
|
60 |
+
|
61 |
+
🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:01eda6e1bcd330f2d90e0164791db47e2e3bd5ec9b3302f624fb9a7c27c86068
|
3 |
+
size 2719242144
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3e22761829d5025b7dd8dd0aa08fdf342c2403be63f8ee2ded718bc837433f8d
|
3 |
+
size 3822024608
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:82f6e757ac989c293e59b44ce179b93e418ef6e0d664d64494a4bf03738a62b5
|
3 |
+
size 3518986144
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4d1cd2010cbf10cd9640d2f7e7469c15fd09d0c244a3f1dbdb4567b509a90ff4
|
3 |
+
size 3164567456
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3f0a4edeeb0843a6e88353a8163fa4159c2505d20b3cd320aa7be4dea06960f5
|
3 |
+
size 4368439200
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1b25ce59800816ccdf6b221a030dc2f4a8e4668b0062087215b48759f7bc026a
|
3 |
+
size 4140373920
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f64a5fc897afe07aa7a603719b6e5bee0cb818a2bafe3f652337e1be0736a75b
|
3 |
+
size 5131409312
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a5542b6bc76dfb04a77b366d0408f35dde859263e4dab584f6cfcec73446ab23
|
3 |
+
size 4997715872
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b75398cdd80d316a96b8f781d74cddb45de331e11aa91b371cec4fb331cf628c
|
3 |
+
size 5942065056
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c2c35b22906369f6f67601e7485afa36e9d10093c1829578e3bce94730c14983
|
3 |
+
size 7695857568
|