File size: 1,680 Bytes
d6085e9 2e9967e d6085e9 2e9967e d6085e9 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 |
---
base_model: "TinyLlama/TinyLlama-1.1B-Chat-v1.0"
language:
- en
tags:
- transformers
- safetensors
- llama
- text-generation
- conversational
- en
- dataset:cerebras/SlimPajama-627B
- dataset:bigcode/starcoderdata
- dataset:HuggingFaceH4/ultrachat_200k
- dataset:HuggingFaceH4/ultrafeedback_binarized
- license:apache-2.0
- autotrain_compatible
- endpoints_compatible
- text-generation-inference
- region:us
license: "apache-2.0"
inference: false
datasets:
- cerebras/SlimPajama-627B
- bigcode/starcoderdata
- HuggingFaceH4/ultrachat_200k
- HuggingFaceH4/ultrafeedback_binarized
quantized_by: pbatra
---
# TinyLlama-1.1B-Chat-v1.0
This repository contains quantized versions of the model from the original repository: [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0).
| Name | Quantization Method | Size (GB) |
|------|---------------------|-----------|
| tinyllama-1.1b-chat-v1.0.fp16.gguf | FP16 | 2.05 |
| tinyllama-1.1b-chat-v1.0.fp32.gguf | FP32 | 4.10 |
| tinyllama-1.1b-chat-v1.0.Q2_K.gguf | q2_k | 0.40 |
| tinyllama-1.1b-chat-v1.0.Q3_K_S.gguf | q3_k_s | 0.47 |
| tinyllama-1.1b-chat-v1.0.Q3_K_M.gguf | q3_k_m | 0.51 |
| tinyllama-1.1b-chat-v1.0.Q3_K_L.gguf | q3_k_l | 0.55 |
| tinyllama-1.1b-chat-v1.0.Q4_0.gguf | q4_0 | 0.59 |
| tinyllama-1.1b-chat-v1.0.Q4_K_S.gguf | q4_k_s | 0.60 |
| tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf | q4_k_m | 0.62 |
| tinyllama-1.1b-chat-v1.0.Q5_0.gguf | q5_0 | 0.71 |
| tinyllama-1.1b-chat-v1.0.Q5_K_S.gguf | q5_k_s | 0.71 |
| tinyllama-1.1b-chat-v1.0.Q5_K_M.gguf | q5_k_m | 0.73 |
| tinyllama-1.1b-chat-v1.0.Q6_K.gguf | q6_k | 0.84 |
| tinyllama-1.1b-chat-v1.0.Q8_0.gguf | q8_0 | 1.09 |
|