--- base_model: - Qwen/Qwen2.5-14B-Instruct library_name: transformers tags: - qwen2 - qwen2.5 - dpo - chat - conversational license: apache-2.0 datasets: - jondurbin/gutenberg-dpo-v0.1 language: - en --- # Qwen2.5-Gutenberg-1e-Delta This is qwen2.5-instruct trained on Gutenberg dpo for 1.25 epoch's.