Model save

README.md

@@ -1,7 +1,7 @@
 ---
-base_model: RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter2
+base_model: mistralai/Mistral-Small-Instruct-2409
 library_name: transformers
-model_name: self-correct_mistral-small-it_mMQA_dpo_iter3_beta.05
+model_name: self-correct_mistral-small-it_mMQA_dpo_iter1_beta.05
 tags:
 - generated_from_trainer
 - trl
@@ -9,9 +9,9 @@ tags:
 licence: license
 ---
 
-# Model Card for self-correct_mistral-small-it_mMQA_dpo_iter3_beta.05
+# Model Card for self-correct_mistral-small-it_mMQA_dpo_iter1_beta.05
 
-This model is a fine-tuned version of [RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter2](https://huggingface.co/RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter2).
+This model is a fine-tuned version of [mistralai/Mistral-Small-Instruct-2409](https://huggingface.co/mistralai/Mistral-Small-Instruct-2409).
 It has been trained using [TRL](https://github.com/huggingface/trl).
 
 ## Quick start
@@ -20,14 +20,14 @@ It has been trained using [TRL](https://github.com/huggingface/trl).
 from transformers import pipeline
 
 question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
-generator = pipeline("text-generation", model="RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter3_beta.05", device="cuda")
+generator = pipeline("text-generation", model="RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter1_beta.05", device="cuda")
 output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
 print(output["generated_text"])
 ```
 
 ## Training procedure
 
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yyr/huggingface/runs/3xxkncbf)
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yyr/huggingface/runs/o4gfqsnq)
 
 This model was trained with DPO, a method introduced in [Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://huggingface.co/papers/2305.18290).
 

last_checkpoint/config.json

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter2",
+  "_name_or_path": "mistralai/Mistral-Small-Instruct-2409",
   "architectures": [
     "MistralForCausalLM"
   ],

last_checkpoint/model-00001-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b18e0294beb3fd7eab6e621c9a474788cb17fcf4cccf2949942d10fe6fd69b47
+oid sha256:b5d1196c2e8709e991f55d87f7a0a70c66eae35fcc18262addd62a99724752bc
 size 4882311064

last_checkpoint/model-00002-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f499e6c04610db0cdaf2f92d2543456e03caaf75c3a53b7c8c89ef8981a84fff
+oid sha256:81bb6435abda482131efd56bd9f8ffda07827fbeee8c91ddcea289871dc41ba7
 size 4983012160

last_checkpoint/model-00003-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0ed19bd32ef693b21e31de2104ea0d48fb564f8034832f05c7930005b77378fa
+oid sha256:6c282b24f960342a53ae7e78a729978320e331667321bbc265e2b83794daca7c
 size 4957821336

last_checkpoint/model-00004-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:df1f6895c60c307417c6f44b362dca81b5cdaace29cd4cbbd0fff0e57fab80b7
+oid sha256:d59cc369a137f03d39d67d90dcc81174a31941ea44b56852a6554b6f26438cf5
 size 4882323744

last_checkpoint/model-00005-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:87f1f68e41a7f451383b3f667b35b402ed81c376a398cec7c2838e56f5cdf4b5
+oid sha256:dd73870967da1e197a682b08de7e637391efce1a1e9dda0ac4a97bbbe3fb5adb
 size 4983012192

last_checkpoint/model-00006-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:afc0f083f0052aeb28f508597edd20f9c449895bb2d520fe7cde2455a79d7acb
+oid sha256:12b4fed1ad562efb81c54a0deb5e979eeb2770fdcfef649eff6b825c259d0e6c
 size 4957821336

last_checkpoint/model-00007-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:373f76dfcedf249caece3211dbef9b3de0c22cf0856bf6f56dc8200734dcf439
+oid sha256:c0bc65b2f0966d0eaaf351c3d16ef6fb9249479b0c96272c35279d0a58a492ec
 size 4882323744

last_checkpoint/model-00008-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d88aa96687bd642de6d294f6a21266c2248a53516752ad4308771949c9070c8b
+oid sha256:70e7bf89d90290fde28b5e13aae84b3becd5aeddfe25bb85b4b9364b515ce45a
 size 4983012192

last_checkpoint/model-00009-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:edf1471c0e95ae9ce2d4ce49b73b3005678e09da5e13f88aba301d78573fbaff
+oid sha256:927ac7c0ea72e96bbd68edf8f6040c981fc5fb2cce32844d75c0c6bab4e04333
 size 4983011344

last_checkpoint/training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bc3e3abd0433f8b904eb5a7a7b013326e3da729383ec2da00ba3c2520baec6bc
+oid sha256:3563ab0befb4d64cea2ad9869f75176474c735c329f7161ddcf2683a3861e78c
 size 8056