AptaArkana commited on
Commit
53f7c56
1 Parent(s): 54dc327

Model save

Browse files
README.md ADDED
@@ -0,0 +1,100 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: Toshifumi/distilbert-base-multilingual-cased-finetuned-emotion
4
+ tags:
5
+ - generated_from_trainer
6
+ datasets:
7
+ - indonlu
8
+ metrics:
9
+ - accuracy
10
+ - precision
11
+ - recall
12
+ - f1
13
+ model-index:
14
+ - name: indonesian-distilbert-base-cased-finetuned-indonlu
15
+ results:
16
+ - task:
17
+ name: Text Classification
18
+ type: text-classification
19
+ dataset:
20
+ name: indonlu
21
+ type: indonlu
22
+ config: emot
23
+ split: validation
24
+ args: emot
25
+ metrics:
26
+ - name: Accuracy
27
+ type: accuracy
28
+ value: 0.6113636363636363
29
+ - name: Precision
30
+ type: precision
31
+ value: 0.6057688190944959
32
+ - name: Recall
33
+ type: recall
34
+ value: 0.6113636363636363
35
+ - name: F1
36
+ type: f1
37
+ value: 0.6068671444135532
38
+ ---
39
+
40
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
41
+ should probably proofread and complete it, then remove this comment. -->
42
+
43
+ # indonesian-distilbert-base-cased-finetuned-indonlu
44
+
45
+ This model is a fine-tuned version of [Toshifumi/distilbert-base-multilingual-cased-finetuned-emotion](https://huggingface.co/Toshifumi/distilbert-base-multilingual-cased-finetuned-emotion) on the indonlu dataset.
46
+ It achieves the following results on the evaluation set:
47
+ - Loss: 1.1300
48
+ - Accuracy: 0.6114
49
+ - Precision: 0.6058
50
+ - Recall: 0.6114
51
+ - F1: 0.6069
52
+
53
+ ## Model description
54
+
55
+ More information needed
56
+
57
+ ## Intended uses & limitations
58
+
59
+ More information needed
60
+
61
+ ## Training and evaluation data
62
+
63
+ More information needed
64
+
65
+ ## Training procedure
66
+
67
+ ### Training hyperparameters
68
+
69
+ The following hyperparameters were used during training:
70
+ - learning_rate: 1e-05
71
+ - train_batch_size: 16
72
+ - eval_batch_size: 16
73
+ - seed: 42
74
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
75
+ - lr_scheduler_type: linear
76
+ - lr_scheduler_warmup_ratio: 0.01
77
+ - num_epochs: 10
78
+
79
+ ### Training results
80
+
81
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1 |
82
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|
83
+ | No log | 1.0 | 221 | 1.2623 | 0.475 | 0.4817 | 0.475 | 0.4458 |
84
+ | No log | 2.0 | 442 | 1.0937 | 0.55 | 0.5555 | 0.55 | 0.5444 |
85
+ | 1.2289 | 3.0 | 663 | 1.0749 | 0.5886 | 0.6003 | 0.5886 | 0.5898 |
86
+ | 1.2289 | 4.0 | 884 | 1.0836 | 0.5818 | 0.6019 | 0.5818 | 0.5800 |
87
+ | 0.7857 | 5.0 | 1105 | 1.1300 | 0.6114 | 0.6058 | 0.6114 | 0.6069 |
88
+ | 0.7857 | 6.0 | 1326 | 1.1595 | 0.6 | 0.5996 | 0.6 | 0.5984 |
89
+ | 0.5288 | 7.0 | 1547 | 1.1767 | 0.6 | 0.5986 | 0.6 | 0.5958 |
90
+ | 0.5288 | 8.0 | 1768 | 1.2195 | 0.6 | 0.5969 | 0.6 | 0.5952 |
91
+ | 0.5288 | 9.0 | 1989 | 1.2422 | 0.5932 | 0.5915 | 0.5932 | 0.5909 |
92
+ | 0.3685 | 10.0 | 2210 | 1.2406 | 0.5841 | 0.5842 | 0.5841 | 0.5830 |
93
+
94
+
95
+ ### Framework versions
96
+
97
+ - Transformers 4.35.2
98
+ - Pytorch 2.1.0+cu121
99
+ - Datasets 2.17.1
100
+ - Tokenizers 0.15.2
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bf057254dae000a531117f7bd3ff7b4aaf97a9edcb12023aee4d513a0ee024a6
3
  size 541326604
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72f82c671f1e4851c95f42ce697ebe32c97e016717ffbc5dfabb278a2d27871e
3
  size 541326604
runs/Mar04_07-00-31_1b059dd88d36/events.out.tfevents.1709535632.1b059dd88d36.154.16 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3fe33f97bfb93182e75a673c6ba9018ed9a01f9bbeb4af1f44c5829c417a0eb4
3
- size 9922
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0089cd891d2fd6e263018761bad82d0cb7aab8caa2e239cbd6d960c61a35c7f8
3
+ size 10276
runs/Mar04_07-00-31_1b059dd88d36/events.out.tfevents.1709536503.1b059dd88d36.154.17 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:346aa32126788d51cea0463b2d11473021699c02ba83c716285f2c77449126bf
3
+ size 560