Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment26Shadow-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
2ff6b45
Experiment26Shadow-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
2c2ca978bbae7ba163ea825fb8cad64acad862372d2bee61a44ed0355f84cbe3
2ff6b45
verified
8 months ago
.gitattributes
2.29 kB
2c2ca978bbae7ba163ea825fb8cad64acad862372d2bee61a44ed0355f84cbe3
8 months ago
Experiment26Shadow-7B.IQ3_XS.gguf
3.02 GB
LFS
46bef0633736f3a4c98bda3ddfc62c87de9e363fb7194c27746786b7dc3ca76c
8 months ago
Experiment26Shadow-7B.IQ4_XS.gguf
3.94 GB
LFS
34d48b6343b92eb196ce9245cda6b5f1f394826052eabd43ecc803159c91346f
8 months ago
Experiment26Shadow-7B.Q2_K.gguf
2.72 GB
LFS
3caf253b6bbae7adbbc5e237dd97de5233c8f0426e0520eb1a6e99f792e08518
8 months ago
Experiment26Shadow-7B.Q3_K_L.gguf
3.82 GB
LFS
a3d81d99c1e117e59d5b58b9b9248cac9d9bdcb73f9f874d34b62ffbde12aef9
8 months ago
Experiment26Shadow-7B.Q3_K_M.gguf
3.52 GB
LFS
dcfdf91b1253b1a0f90202ded56c7a01dd8b1eeb27b16c277118934dd6f03252
8 months ago
Experiment26Shadow-7B.Q3_K_S.gguf
3.16 GB
LFS
e349bd2c79f4b55a090d25a9bd06b55f2cf1d364a86f518d9ef8904d1068bc53
8 months ago
Experiment26Shadow-7B.Q4_K_M.gguf
4.37 GB
LFS
bae18dfa602d466a48637f20c43b9b04051bda507de5b0d0aaba7f6f5ae06baa
8 months ago
Experiment26Shadow-7B.Q4_K_S.gguf
4.14 GB
LFS
1a7caf128ebf4e9cc065d28a75ed78ed73e5aa874cc1161b07b65ab937af1488
8 months ago
Experiment26Shadow-7B.Q5_K_M.gguf
5.13 GB
LFS
69a9fff42bda8fdf6e353bb87b5a21d371635ad272cd9eed755eb5f692201eae
8 months ago
Experiment26Shadow-7B.Q5_K_S.gguf
5 GB
LFS
ac37aa3594ef9bcb549411cd7133c470211768399de0999da9dd00e76a534077
8 months ago
Experiment26Shadow-7B.Q6_K.gguf
5.94 GB
LFS
2c2ca978bbae7ba163ea825fb8cad64acad862372d2bee61a44ed0355f84cbe3
8 months ago