Edit model card

Uploaded model

  • Developed by: auchoi
  • License: apache-2.0
  • Finetuned from model : unsloth/Phi-3-mini-4k-instruct-bnb-4bit

This was more of an experiment for me but this was an existing 4bit model that was quantized again to 16bit. it will not perform well

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
7
Safetensors
Model size
3.82B params
Tensor type
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for auchoi/phi3_16bit_merged

Finetuned
(549)
this model