Instruct_Llama3_8B / README.md
mallorbc's picture
Update README.md
c534503 verified
metadata
license: llama3
language:
  - en
pipeline_tag: text-generation

Instruct_Llama3_8B

Fine-tuned from Llama-3-8B, using a wide variety of sources for the dataset. 84.9% for training, 15% validation, 0.1% test. Trained for 2 epochs using QDora. Trained with 4096 context window.

Model Details

  • Trained by: trained by Brillibits. See YouTube as well.
  • Model type: Instruct_Llama3_8B is an auto-regressive language model based on the Llama 3 transformer architecture.
  • Language(s): English
  • License for Instruct_Llama3_8B: llama3 license

Prompting

<s>[SYS] {system prompt or blank space} [/SYS] [INST] {instruction} [/INST] {response}</s>

Professional Assistance

This model and other models like it are great, but where LLMs hold the most promise is when they are applied on custom data to automate a wide variety of tasks

If you have a dataset and want to see if you might be able to apply that data to automate some tasks, and you are looking for professional assistance, contact me here