|
--- |
|
license: llama3 |
|
language: |
|
- en |
|
pipeline_tag: text-generation |
|
--- |
|
# Instruct_Llama3_8B |
|
Fine-tuned from Llama-3-8B, using a wide variety of sources for the dataset. 84.9% for training, 15% validation, 0.1% test. Trained for 2 epochs using QDora. Trained with 4096 context window. |
|
|
|
# Model Details |
|
* **Trained by**: trained by [Brillibits](https://brillibits.com/en). See [YouTube](https://www.youtube.com/@Brillibits) as well. |
|
* **Model type:** **Instruct_Llama3_8B** is an auto-regressive language model based on the Llama 3 transformer architecture. |
|
* **Language(s)**: English |
|
* **License for Instruct_Llama3_8B**: llama3 license |
|
|
|
|
|
# Prompting |
|
|
|
``` |
|
<s>[SYS] {system prompt or blank space} [/SYS] [INST] {instruction} [/INST] {response}</s> |
|
``` |
|
|
|
## Professional Assistance |
|
This model and other models like it are great, but where LLMs hold the most promise is when they are applied on custom data to automate a wide variety of tasks |
|
|
|
If you have a dataset and want to see if you might be able to apply that data to automate some tasks, and you are looking for professional assistance, contact me [here](mailto:[email protected]) |