Edit model card

QuantFactory/llama3.1-airoboros3.2-QDT-8B-GGUF

This is quantized version of nbeerbower/llama3.1-airoboros3.2-QDT-8B created using llama.cpp

Original Model Card

llama3.1-airoboros3.2-QDT-8B

meta-llama/Meta-Llama-3.1-8B-Instruct finetuned on jondurbin/airoboros-3.2.

Llama 3 Instruct was used as the chat template.

Method

Finetuned using a Google Colab A100 for 1 epoch. Only 25% of the data was used for training due to limited resources, hence QDT (Quarter Data Test).

Based on mlabonne's SFT notebook.

Downloads last month
149
GGUF
Model size
8.03B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API
Unable to determine this model’s pipeline type. Check the docs .

Model tree for QuantFactory/llama3.1-airoboros3.2-QDT-8B-GGUF

Quantized
(178)
this model

Dataset used to train QuantFactory/llama3.1-airoboros3.2-QDT-8B-GGUF