Update README.md

README.md

@@ -1,6 +1,39 @@
 ---
 library_name: peft
+datasets:
+- Squish42/bluemoon-fandom-1-1-rp-cleaned
+- OpenLeecher/Teatime
+- PygmalionAI/PIPPA
+tags:
+- not-for-all-audiences
+- nsfw
 ---
+## What is PetrolLM?
+PetrolLM is [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) model fine-tune using QLoRA (4-bit precision) for the purposes of creative writing and roleplay. 
+
+The dataset consists of 5800 samples, with the composition as follows:
+* AICG Logs (~17%)
+* PygmalionAI/PIPPA (~17%)
+* Squish42/bluemoon-fandom-1-1-rp-cleaned (~13%)
+* OpenLeecher/Teatime (~2%)
+
+These samples were then back-filled using gpt-4/gpt-3.5-turbo-16k or otherwise converted to fit the prompt format.
+
+## Prompt Format
+The model was finetuned with a prompt format similar to the original SuperHOT prototype:
+```
+---
+style: roleplay
+characters:
+  [char]: [description]
+summary: [scenario]
+---
+<chat_history>
+Format:
+[char]: [message]
+Human: [message]
+```
+
 ## Training procedure