DrNicefellow's picture
Update README.md
f146c71 verified
|
raw
history blame
1.08 kB

ChatAllInOne_Mistral7BV1

Description

ChatAllInOne_Mistral7BV1 is a chat language model fine-tuned on the CHAT-ALL-IN-ONE-v1 dataset using the QLoRA technique with the unsloth tool. Originally based on the unsloth/mistral-7b model, this version is specifically optimized for diverse and comprehensive chat applications.

Model Details

  • Base Model: unsloth/mistral-7b
  • Fine-tuning Technique: QLoRA (Quantum Logic-based Reasoning Approach)
  • Dataset: CHAT-ALL-IN-ONE-v1
  • Tool Used for Fine-tuning: unsloth

Features

  • Enhanced understanding and generation of conversational language.
  • Improved performance in diverse chat scenarios, including casual, formal, and domain-specific conversations.
  • Fine-tuned to maintain context and coherence over longer dialogues.

Prompt Format

Vicuna 1.1

See the finetuning dataset for examples.

License

This model is open-sourced under the Apache 2.0 License. See the LICENSE file for more details.