Deacon-34b-4bit / README.md
KnutJaegersberg's picture
Create README.md
8b839d3
|
raw
history blame
981 Bytes
metadata
license: other
license_name: yi-license
license_link: LICENSE
datasets:
  - totally-not-an-llm/EverythingLM-data-V3
pipeline_tag: text-generation

image/png

The perfect organism.

An adapter for KnutJaegersberg/Yi-34B-Llamafied. 5 epochs with NEFTune. The brand new bitsandbytes 4-bit file format.

Run pip install -U bitsandbytes and install this pull requested transformer version: https://github.com/poedator/transformers/tree/save4

Prompt Example:

### System:

You are an AI assistant. User will you give you a task. Your goal is to complete the task as faithfully as you can. While performing the task think step-by-step and justify your steps.

### Instruction: 

How do you fine tune a large language model? 

### Response:

image/png