Update README.md

README.md

@@ -25,10 +25,27 @@ More information needed
 
 ## Training and evaluation data
 
-More information needed
+Instruction Tuned on the glue-mrpc task here: https://huggingface.co/datasets/adambjorn/UnrelatedForgettingOverhead/viewer/glue-mrpc
 
 ## Training procedure
 
+Given a set of prompts:
+
+``` python
+prompts = [
+        "Determine if the following sentences are equivalent: Sentence 1: {sentence1} Sentence 2: {sentence2}. Answer: ",
+        "Are these sentences saying the same thing? First: {sentence1} Second: {sentence2}. Response: ",
+        "Check sentence equivalence: \"{sentence1}\" versus \"{sentence2}\". Result: ",
+    ]
+```
+
+Concatenate the prompts, the two sentences and the label as so:
+
+```python
+input_text = prompt.format(sentence1=sentence1, sentence2=sentence2)    
+input_text += " " + responses[label]
+```
+
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
@@ -45,7 +62,9 @@ The following hyperparameters were used during training:
 
 ### Training results
 
+Final results: {'loss': 0.0949, 'grad_norm': 5.0146379470825195, 'learning_rate': 6.000000000000001e-07, 'epoch': 10.0}
 
+Average results: {'train_runtime': 363.2148, 'train_samples_per_second': 5.506, 'train_steps_per_second': 1.377, 'train_loss': 0.4939311617612839, 'epoch': 10.0}
 
 ### Framework versions