update model card README.md

README.md

@@ -1,5 +1,4 @@
 ---
-license: apache-2.0
 tags:
 - generated_from_trainer
 model-index:
@@ -12,11 +11,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 # multi-label-class-classification-on-github-issues
 
-This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
+This model is a fine-tuned version of [neuralmagic/oBERT-12-upstream-pruned-unstructured-97](https://huggingface.co/neuralmagic/oBERT-12-upstream-pruned-unstructured-97) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.1391
-- Micro f1: 0.5005
-- Macro f1: 0.0340
+- Loss: 0.1301
+- Micro f1: 0.5159
+- Macro f1: 0.0352
 
 ## Model description
 
@@ -36,32 +35,33 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 3e-05
-- train_batch_size: 128
+- train_batch_size: 64
 - eval_batch_size: 8
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - num_epochs: 15
+- mixed_precision_training: Native AMP
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Micro f1 | Macro f1 |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|
-| No log        | 1.0   | 13   | 0.3988          | 0.3783   | 0.0172   |
-| No log        | 2.0   | 26   | 0.3288          | 0.3791   | 0.0172   |
-| No log        | 3.0   | 39   | 0.2753          | 0.3791   | 0.0172   |
-| No log        | 4.0   | 52   | 0.2347          | 0.3791   | 0.0172   |
-| No log        | 5.0   | 65   | 0.2051          | 0.3791   | 0.0172   |
-| No log        | 6.0   | 78   | 0.1849          | 0.3791   | 0.0172   |
-| No log        | 7.0   | 91   | 0.1710          | 0.3791   | 0.0172   |
-| No log        | 8.0   | 104  | 0.1614          | 0.3791   | 0.0172   |
-| No log        | 9.0   | 117  | 0.1546          | 0.3791   | 0.0172   |
-| No log        | 10.0  | 130  | 0.1497          | 0.3796   | 0.0173   |
-| No log        | 11.0  | 143  | 0.1458          | 0.4143   | 0.0238   |
-| No log        | 12.0  | 156  | 0.1427          | 0.4567   | 0.0295   |
-| No log        | 13.0  | 169  | 0.1406          | 0.4709   | 0.0310   |
-| No log        | 14.0  | 182  | 0.1391          | 0.4886   | 0.0327   |
-| No log        | 15.0  | 195  | 0.1386          | 0.4909   | 0.0330   |
+| No log        | 1.0   | 25   | 0.3994          | 0.3783   | 0.0172   |
+| No log        | 2.0   | 50   | 0.2846          | 0.3791   | 0.0172   |
+| No log        | 3.0   | 75   | 0.2159          | 0.3791   | 0.0172   |
+| No log        | 4.0   | 100  | 0.1802          | 0.3791   | 0.0172   |
+| No log        | 5.0   | 125  | 0.1618          | 0.3791   | 0.0172   |
+| No log        | 6.0   | 150  | 0.1515          | 0.3791   | 0.0172   |
+| No log        | 7.0   | 175  | 0.1452          | 0.3791   | 0.0172   |
+| No log        | 8.0   | 200  | 0.1411          | 0.3931   | 0.0202   |
+| No log        | 9.0   | 225  | 0.1379          | 0.4413   | 0.0277   |
+| No log        | 10.0  | 250  | 0.1350          | 0.4694   | 0.0309   |
+| No log        | 11.0  | 275  | 0.1327          | 0.4993   | 0.0336   |
+| No log        | 12.0  | 300  | 0.1309          | 0.5084   | 0.0344   |
+| No log        | 13.0  | 325  | 0.1297          | 0.5147   | 0.0349   |
+| No log        | 14.0  | 350  | 0.1291          | 0.5060   | 0.0343   |
+| No log        | 15.0  | 375  | 0.1287          | 0.5107   | 0.0346   |
 
 
 ### Framework versions