Update README.md

README.md

@@ -1,33 +1,67 @@
 ---
-library_name: transformers
-license: apache-2.0
-base_model: mistralai/Mistral-Nemo-Instruct-2407
+license: other
+license_name: mrl
+language:
+- en
 tags:
-- axolotl
-- generated_from_trainer
-model-index:
-- name: magnum-v4-12b-r2
-  results: []
----
-### exl2 quant (measurement.json in main branch)
----
-### check revisions for quants
+- chat
+pipeline_tag: text-generation
+library_name: transformers
 ---
 
 
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
+## This repo contains EXL2 quants of the model. If you need the original weights, please find them [here](https://huggingface.co/anthracite-org/magnum-v4-12b).
+## Base repo only contains the measurement file, see revisions for your quant of choice.
+
+- [measurement.json](https://huggingface.co/anthracite-org/magnum-v4-12b-exl2/tree/main)
+- [3.0bpw](https://huggingface.co/anthracite-org/magnum-v4-12b-exl2/tree/3.0bpw)
+- [4.0bpw](https://huggingface.co/anthracite-org/magnum-v4-12b-exl2/tree/4.0bpw)
+- [5.0bpw](https://huggingface.co/anthracite-org/magnum-v4-12b-exl2/tree/5.0bpw)
+- [6.0bpw](https://huggingface.co/anthracite-org/magnum-v4-12b-exl2/tree/6.0bpw)
+- [8.0bpw](https://huggingface.co/anthracite-org/magnum-v4-12b-exl2/tree/8.0bpw)
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/658a46cbfb9c2bdfae75b3a6/-UC6YN1Gt3e1FDh8EqyaB.png)
+
+This is a series of models designed to replicate the prose quality of the Claude 3 models, specifically Sonnet and Opus.
+
+This model is fine-tuned on top of [mistralai/Mistral-Nemo-Instruct-2407](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407).
+
+## Prompting
+A typical input would look like this:
+
+```py
+<s>[INST] SYSTEM MESSAGE
+USER MESSAGE[/INST] ASSISTANT MESSAGE</s>[INST] USER MESSAGE[/INST]
+```
+
+## SillyTavern templates
+
+Below are Instruct and Context templates for use within SillyTavern.
+
+<details><summary>context template</summary>
+  
+```yaml
+default SillyTavern template works fine
+```
+
+</details><br>
+<details><summary>instruct template</summary>
+  
+```yaml
+default SillyTavern template works fine
+```
+
+</details><br>
+
+## Axolotl config
 
-[<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/axolotl-ai-cloud/axolotl)
 <details><summary>See axolotl config</summary>
 
-axolotl version: `0.4.1`
 ```yaml
 base_model: mistralai/Mistral-Nemo-Instruct-2407
 model_type: AutoModelForCausalLM
 tokenizer_type: AutoTokenizer
 
-hub_model_id: anthracite-core/magnum-v4-12b-r2
+hub_model_id: anthracite-org/magnum-v4-12b-r2
 hub_strategy: "all_checkpoints"
 push_dataset_to_hub:
 hf_use_auth_token: true
@@ -44,17 +78,17 @@ load_in_4bit: false
 strict: false
 
 datasets:
-  - path: anthracite-core/c2_logs_32k_llama3_qwen2_v1.2_no_system
+  - path: anthracite-org/c2_logs_32k_llama3_qwen2_v1.2_no_system
     type: custommistralv3tekken
-  - path: anthracite-core/kalo-opus-instruct-22k-no-refusal-no-system
+  - path: anthracite-org/kalo-opus-instruct-22k-no-refusal-no-system
     type: custommistralv3tekken
-  - path: anthracite-core/kalo-opus-instruct-3k-filtered-no-system
+  - path: anthracite-org/kalo-opus-instruct-3k-filtered-no-system
     type: custommistralv3tekken
   - path: anthracite-org/nopm_claude_writing_fixed
     type: custommistralv3tekken
-  - path: anthracite-core/kalo_opus_misc_240827_no_system
+  - path: anthracite-org/kalo_opus_misc_240827_no_system
     type: custommistralv3tekken
-  - path: anthracite-core/kalo_misc_part2_no_system
+  - path: anthracite-org/kalo_misc_part2_no_system
     type: custommistralv3tekken
 #chat_template: chatml
 shuffle_merged_datasets: true
@@ -115,51 +149,25 @@ fsdp_config:
 special_tokens:
   pad_token: <pad>
 ```
-
 </details><br>
 
-# magnum-v4-12b-r2
-
-This model is a fine-tuned version of [mistralai/Mistral-Nemo-Instruct-2407](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407) on the None dataset.
-
-## Model description
-
-More information needed
-
-## Intended uses & limitations
-
-More information needed
-
-## Training and evaluation data
-
-More information needed
-
-## Training procedure
-
-### Training hyperparameters
-
-The following hyperparameters were used during training:
-- learning_rate: 1e-05
-- train_batch_size: 1
-- eval_batch_size: 1
-- seed: 42
-- distributed_type: multi-GPU
-- num_devices: 8
-- gradient_accumulation_steps: 2
-- total_train_batch_size: 16
-- total_eval_batch_size: 8
-- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
-- lr_scheduler_type: cosine
-- lr_scheduler_warmup_steps: 40
-- num_epochs: 2
+## Credits
+We'd like to thank Recursal / Featherless for sponsoring the compute for this train, Featherless has been hosting our Magnum models since the first 72 B and has given thousands of people access to our models and helped us grow.
 
-### Training results
+We would also like to thank all members of Anthracite who made this finetune possible. 
 
+## Datasets
+- [anthracite-org/c2_logs_32k_llama3_qwen2_v1.2_no_system](https://huggingface.co/datasets/anthracite-org/c2_logs_32k_llama3_qwen2_v1.2_no_system)
+- [anthracite-org/kalo-opus-instruct-22k-no-refusal-no-system](https://huggingface.co/datasets/anthracite-org/kalo-opus-instruct-22k-no-refusal-no-system)
+- [anthracite-org/kalo-opus-instruct-3k-filtered-no-system](https://huggingface.co/datasets/anthracite-org/kalo-opus-instruct-3k-filtered-no-system)
+- [anthracite-org/nopm_claude_writing_fixed](https://huggingface.co/datasets/anthracite-org/nopm_claude_writing_fixed)
+- [anthracite-org/kalo_opus_misc_240827_no_system](https://huggingface.co/datasets/anthracite-org/kalo_opus_misc_240827_no_system)
+- [anthracite-org/kalo_misc_part2_no_system](https://huggingface.co/datasets/anthracite-org/kalo_misc_part2_no_system)
 
+## Training
+The training was done for 2 epochs. We used  8x[H100s](https://www.nvidia.com/en-us/data-center/h100/) GPUs graciously provided by [Recursal AI](https://recursal.ai/) / [Featherless AI](https://featherless.ai/) for the full-parameter fine-tuning of the model.
 
-### Framework versions
+[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
 
-- Transformers 4.45.0.dev0
-- Pytorch 2.3.1+cu121
-- Datasets 2.21.0
-- Tokenizers 0.19.1
+## Safety
+...