Instruct_Llama3_8B / README.md
mallorbc's picture
Update README.md
dade525 verified
|
raw
history blame
No virus
1.09 kB
---
license: llama3
language:
- en
pipeline_tag: text-generation
---
# Instruct_Llama3_8B
Fine-tuned from Llama-3-8B, using a wide variety of sources for the dataset. 84.9% for training, 15% validation, 0.1% test. Trained for 2 epochs using QDora. Trained with 4096 context window.
# Model Details
* **Trained by**: trained by [Brillibits](https://www.youtube.com/@Brillibits).
* **Model type:** **Instruct_Llama3_8B** is an auto-regressive language model based on the Llama 3 transformer architecture.
* **Language(s)**: English
* **License for Instruct_Llama3_8B**: llama3 license
# Prompting
```
<s>[SYS] {system prompt or blank space} [/SYS] [INST] {instruction} [/INST] {response}</s>
```
## Professional Assistance
This model and other models like it are great, but where LLMs hold the most promise is when they are applied on custom data to automate a wide variety of tasks
If you have a dataset and want to see if you might be able to apply that data to automate some tasks, and you are looking for professional assistance, contact me [here](mailto:[email protected])