--- base_model: "TinyLlama/TinyLlama-1.1B-Chat-v1.0" language: - en tags: - transformers - safetensors - llama - text-generation - conversational - en - dataset:cerebras/SlimPajama-627B - dataset:bigcode/starcoderdata - dataset:HuggingFaceH4/ultrachat_200k - dataset:HuggingFaceH4/ultrafeedback_binarized - license:apache-2.0 - autotrain_compatible - text-generation-inference - endpoints_compatible - region:us license: "apache-2.0" inference: false quantized_by: pbatralx --- # TinyLlama-1.1B-Chat-v1.0 This repository contains quantized versions of the model from the original repository: [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0). | Name | Quantization Method | Size (GB) | |------|---------------------|-----------| | tinyllama-1.1b-chat-v1.0.Q8_0.gguf | q8_0 | 1.09 |