MaxKazak commited on
Commit
f24f7f4
1 Parent(s): bde97f2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -20
README.md CHANGED
@@ -7,29 +7,28 @@ metrics:
7
  model-index:
8
  - name: ruBert-base-russian-emotions-classifier-goEmotions
9
  results: []
 
 
 
 
10
  ---
11
 
12
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
- should probably proofread and complete it, then remove this comment. -->
14
 
15
  # ruBert-base-russian-emotions-classifier-goEmotions
16
 
17
- This model is a fine-tuned version of [ai-forever/ruBert-base](https://huggingface.co/ai-forever/ruBert-base) on an unknown dataset.
18
- It achieves the following results on the evaluation set:
19
- - Loss: 0.2606
20
- - Accuracy: 0.8950
21
 
22
- ## Model description
23
 
24
- More information needed
 
 
 
 
25
 
26
- ## Intended uses & limitations
27
-
28
- More information needed
29
-
30
- ## Training and evaluation data
31
-
32
- More information needed
33
 
34
  ## Training procedure
35
 
@@ -42,17 +41,15 @@ The following hyperparameters were used during training:
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
- - num_epochs: 5
46
 
47
  ### Training results
48
 
49
- | Training Loss | Epoch | Step | Validation Loss | Accuracy |
50
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
51
  | 0.1755 | 1.0 | 1685 | 0.1717 | 0.9220 |
52
  | 0.1391 | 2.0 | 3370 | 0.1757 | 0.9240 |
53
  | 0.0899 | 3.0 | 5055 | 0.2088 | 0.9106 |
54
- | 0.0538 | 4.0 | 6740 | 0.2464 | 0.8953 |
55
- | 0.0344 | 5.0 | 8425 | 0.2606 | 0.8950 |
56
 
57
 
58
  ### Framework versions
@@ -60,4 +57,4 @@ The following hyperparameters were used during training:
60
  - Transformers 4.24.0
61
  - Pytorch 2.0.1
62
  - Datasets 2.12.0
63
- - Tokenizers 0.11.0
 
7
  model-index:
8
  - name: ruBert-base-russian-emotions-classifier-goEmotions
9
  results: []
10
+ datasets:
11
+ - Djacon/ru_goemotions
12
+ language:
13
+ - ru
14
  ---
15
 
 
 
16
 
17
  # ruBert-base-russian-emotions-classifier-goEmotions
18
 
19
+ This model is a fine-tuned version of [ai-forever/ruBert-base](https://huggingface.co/ai-forever/ruBert-base) on [Djacon/ru_goemotions](https://huggingface.co/datasets/Djacon/ru_goemotions).
20
+ It achieves the following results on the evaluation set (2nd epoch):
21
+ - Loss: 0.2088
22
+ - AUC: 0.9240
23
 
24
+ The quality of the predicted probabilities on the test dataset is the following:
25
 
26
+ | label | joy | interest | surpise | sadness | anger | disgust | fear | guilt | neutral | average |
27
+ |----------|--------|----------|---------|---------|--------|---------|--------|--------|---------|---------|
28
+ | AUC | 0.9369 | 0.9213 | 0.9325 | 0.8791 | 0.8374 | 0.9041 | 0.9470 | 0.9758 | 0.8518 | 0.9095 |
29
+ | F1-micro | 0.9528 | 0.9157 | 0.9697 | 0.9284 | 0.8690 | 0.9658 | 0.9851 | 0.9875 | 0.7654 | 0.9266 |
30
+ | F1-macro | 0.8369 | 0.7922 | 0.7561 | 0.7392 | 0.7351 | 0.7356 | 0.8176 | 0.8247 | 0.7650 | 0.7781 |
31
 
 
 
 
 
 
 
 
32
 
33
  ## Training procedure
34
 
 
41
  - seed: 42
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: linear
44
+ - num_epochs: 3
45
 
46
  ### Training results
47
 
48
+ | Training Loss | Epoch | Step | Validation Loss | AUC |
49
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
50
  | 0.1755 | 1.0 | 1685 | 0.1717 | 0.9220 |
51
  | 0.1391 | 2.0 | 3370 | 0.1757 | 0.9240 |
52
  | 0.0899 | 3.0 | 5055 | 0.2088 | 0.9106 |
 
 
53
 
54
 
55
  ### Framework versions
 
57
  - Transformers 4.24.0
58
  - Pytorch 2.0.1
59
  - Datasets 2.12.0
60
+ - Tokenizers 0.11.0