Update README.md

README.md

@@ -1,37 +1,77 @@
 ---
 base_model:
+- akjindal53244/Llama-3.1-Storm-8B
+- Sao10K/L3.1-8B-Niitama-v1.1
 - v000000/L3.1-Niitorm-8B-t0.0001
-- v000000/NII_8B_DPO
 library_name: transformers
 tags:
-- mergekit
 - merge
-
+- llama
+- dpo
+datasets:
+- jondurbin/gutenberg-dpo-v0.1
 ---
-# merge
 
-This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+# Llama-3.1-Niitorm-8B-DPO
+
+* *DPO Trained, Llama3.1-8B.*
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f74b6e6389380c77562762/J7sCzFV3_wHtXaU8jpep5.png)
+
+DPO Gutenberg Finetune version. RP model, Niitama 1.1 as a base, nearswapped with one of the smartest 3.1 models "Storm", mostly abliterated.
+
+-------------------------------------------------------------------------------
+
+## finetune and merge
+
+This is a merge and finetune of pre-trained language models.
+
+*Resultant merge finetuned* on [jondurbin/gutenberg-dpo-v0.1](https://huggingface.co/datasets/jondurbin/gutenberg-dpo-v0.1) for 1 epoch 1.5e-5 learning rate.
 
 ## Merge Details
 ### Merge Method
 
-This model was merged using the [linear](https://arxiv.org/abs/2203.05482) merge method.
+This model was merged using the <b>NEARSWAP t0.0001</b> merge algorithm.
 
 ### Models Merged
 
 The following models were included in the merge:
-* [v000000/L3.1-Niitorm-8B-t0.0001](https://huggingface.co/v000000/L3.1-Niitorm-8B-t0.0001) + [v000000/NII_8B_DPO](https://huggingface.co/v000000/NII_8B_DPO)
+* Base Model: [Sao10K/L3.1-8B-Niitama-v1.1](https://huggingface.co/Sao10K/L3.1-8B-Niitama-v1.1) + [grimjim/Llama-3-Instruct-abliteration-LoRA-8B](https://huggingface.co/grimjim/Llama-3-Instruct-abliteration-LoRA-8B)
+* [akjindal53244/Llama-3.1-Storm-8B](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B)
 
 ### Configuration
 
 The following YAML configuration was used to produce this model:
 
 ```yaml
-models:
-  - model: v000000/L3.1-Niitorm-8B-t0.0001+v000000/NII_8B_DPO
-    parameters:
-      weight: 1.0
-merge_method: linear
-dtype: float16
+slices:
+  - sources:
+      - model: Sao10K/L3.1-8B-Niitama-v1.1+grimjim/Llama-3-Instruct-abliteration-LoRA-8B
+        layer_range: [0, 32]
+      - model: akjindal53244/Llama-3.1-Storm-8B
+        layer_range: [0, 32]
+merge_method: nearswap
+base_model: Sao10K/L3.1-8B-Niitama-v1.1+grimjim/Llama-3-Instruct-abliteration-LoRA-8B
+parameters:
+  t:
+    - value: 0.0001
+dtype: bfloat16
+out_type: float16 #oops
+```
+
+*Resultant merge finetuned* on [jondurbin/gutenberg-dpo-v0.1](https://huggingface.co/datasets/jondurbin/gutenberg-dpo-v0.1) for 1 epoch 1.5e-5 learning rate.
+
+# Prompt Template:
+```bash
+<|begin_of_text|><|start_header_id|>system<|end_header_id|>
+
+{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
+
+{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
+
+{output}<|eot_id|>
 
 ```
+Credit to Alchemonaut.
+
+Credit to woofwolfy for the idea.