|
|
|
--- |
|
license: other |
|
license_name: yi-license |
|
license_link: LICENSE |
|
datasets: |
|
- totally-not-an-llm/EverythingLM-data-V3 |
|
pipeline_tag: text-generation |
|
--- |
|
 |
|
|
|
The perfect organism. |
|
|
|
An adapter for KnutJaegersberg/Yi-34B-Llamafied. 5 epochs with NEFTune. |
|
The brand new bitsandbytes 4-bit file format. |
|
|
|
Run pip install -U bitsandbytes |
|
and install this pull requested transformer version: |
|
https://github.com/poedator/transformers/tree/save4 |
|
|
|
Might still be buggy. |
|
It was a bit too early. |
|
I'll wait until the functionality is officially supported, due to some cuda issues. I don't want to resolve those, I'll just wait a couple of days. |
|
|
|
Prompt Example: |
|
``` |
|
### System: |
|
|
|
You are an AI assistant. User will give you a task. Your goal is to complete the task as faithfully as you can. While performing the task think step-by-step and justify your steps. |
|
|
|
### Instruction: |
|
|
|
How do you fine tune a large language model? |
|
|
|
### Response: |
|
``` |
|
|
|
|
|
 |
|
|
