T3Q-DPO-Mistral-7B

This model is a DPO fine-tuned version of liminerity/M7-7b

Model Developers Chihoon Lee(chlee10), T3Q

T3Q-DPO-Mistral-7B

This model is a DPO fine-tuned version of liminerity/M7-7b

Model Developers Chihoon Lee(chlee10), T3

T3Q-DPO-Mistral-7B

This model is a DPO fine-tuned version of liminerity/M7-7b

Model Developers Chihoon Lee(chlee10), T3

Downloads last month: 13

Safetensors

Model size

7.24B params

Tensor type

FP16

Inference Examples

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for chihoonlee10/T3Q-DPO-Mistral-7B

Base model

liminerity/M7-7b

Finetuned

(19)

this model

Merges

2 models

Quantizations

1 model

Dataset used to train chihoonlee10/T3Q-DPO-Mistral-7B

Evaluation results

Metadata error: specify a dataset to view leaderboard