End of training

README.md

@@ -3,8 +3,6 @@ license: apache-2.0
 base_model: Salesforce/codet5-small
 tags:
 - generated_from_trainer
-metrics:
-- rouge
 model-index:
 - name: codet5-small-v1
   results: []
@@ -17,17 +15,13 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [Salesforce/codet5-small](https://huggingface.co/Salesforce/codet5-small) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.3476
-- Rouge1: 72.8353
-- Rouge2: 55.3177
-- Rougel: 68.1464
-- Rougelsum: 67.5838
-- Gen Len: 13.4595
+- Loss: 1.0781
+- Bleu Score: 0.0611
+- Gen Len: 13.973
 
 ## Model description
 
-fine-tuned on this dataset - chathuranga-jayanath/context-5-predict-token-for-fine-tune. 
-executed for 4 epochs. 
+More information needed
 
 ## Intended uses & limitations
 
@@ -43,22 +37,21 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 2e-05
-- train_batch_size: 16
-- eval_batch_size: 16
+- train_batch_size: 20
+- eval_batch_size: 20
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 4
+- num_epochs: 3
 - mixed_precision_training: Native AMP
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum | Gen Len |
-|:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
-| No log        | 1.0   | 20   | 1.6944          | 60.3962 | 43.2915 | 57.1491 | 57.0619   | 13.4595 |
-| No log        | 2.0   | 40   | 0.8389          | 77.3091 | 66.2349 | 74.0686 | 74.0976   | 13.7027 |
-| No log        | 3.0   | 60   | 0.4161          | 74.7004 | 60.1588 | 70.1567 | 70.0012   | 13.3514 |
-| No log        | 4.0   | 80   | 0.3476          | 72.8353 | 55.3177 | 68.1464 | 67.5838   | 13.4595 |
+| Training Loss | Epoch | Step | Validation Loss | Bleu Score | Gen Len |
+|:-------------:|:-----:|:----:|:---------------:|:----------:|:-------:|
+| No log        | 1.0   | 16   | 1.8385          | 0.0659     | 12.9459 |
+| No log        | 2.0   | 32   | 1.3205          | 0.06       | 13.973  |
+| No log        | 3.0   | 48   | 1.0781          | 0.0611     | 13.973  |
 
 
 ### Framework versions

added_tokens.json

@@ -0,0 +1,5 @@
+{
+  "[BUG]": 32100,
+  "[CONTEXT]": 32101,
+  "[DELETED]": 32102
+}

config.json

@@ -65,5 +65,5 @@
   "torch_dtype": "float32",
   "transformers_version": "4.38.0.dev0",
   "use_cache": true,
-  "vocab_size": 32100
+  "vocab_size": 32103
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:48c3117bc34bc797da30718102bc591fc6d7b465a17bd898ad06b68f1fb73682
-size 241984552
+oid sha256:a6e318e74643d8638d80699c9c7c0e626e463b4b77d0b60656608d01f8f8633e
+size 241990696

runs/Jan28_17-05-43_b34d6465149c/events.out.tfevents.1706461544.b34d6465149c.221.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:09e617f9ab2b28c066ac4c88e92e22eacb98536b173560dc10fab70f9b9f1d3e
+size 7018

tokenizer.json

@@ -952,6 +952,33 @@
       "rstrip": false,
       "normalized": true,
       "special": true
+    },
+    {
+      "id": 32100,
+      "content": "[BUG]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 32101,
+      "content": "[CONTEXT]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 32102,
+      "content": "[DELETED]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
     }
   ],
   "normalizer": null,

tokenizer_config.json

@@ -840,6 +840,30 @@
       "rstrip": false,
       "single_word": false,
       "special": true
+    },
+    "32100": {
+      "content": "[BUG]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "32101": {
+      "content": "[CONTEXT]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "32102": {
+      "content": "[DELETED]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
     }
   },
   "additional_special_tokens": [

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a329ce751d22193e064929a4837fff6ba1df082cb4987aa32c07e3c375600cdc
+oid sha256:7b15ac3fedb4dc41e42365e3846c9aa374bd2c5c30446b85e0b5865592a69c59
 size 4920