infinitejoy commited on
Commit
eb50e66
1 Parent(s): e870548

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -6
README.md CHANGED
@@ -20,8 +20,8 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the MOZILLA-FOUNDATION/COMMON_VOICE_7_0 - OR dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 28.7283
24
- - Wer: 1.0
25
 
26
  ## Model description
27
 
@@ -41,19 +41,25 @@ More information needed
41
 
42
  The following hyperparameters were used during training:
43
  - learning_rate: 7.5e-05
44
- - train_batch_size: 8
45
- - eval_batch_size: 8
46
  - seed: 42
47
- - gradient_accumulation_steps: 4
48
  - total_train_batch_size: 32
49
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
  - lr_scheduler_type: linear
51
  - lr_scheduler_warmup_steps: 500
52
- - num_epochs: 1.0
53
  - mixed_precision_training: Native AMP
54
 
55
  ### Training results
56
 
 
 
 
 
 
 
57
 
58
 
59
  ### Framework versions
 
20
 
21
  This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the MOZILLA-FOUNDATION/COMMON_VOICE_7_0 - OR dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 0.6580
24
+ - Wer: 0.9712
25
 
26
  ## Model description
27
 
 
41
 
42
  The following hyperparameters were used during training:
43
  - learning_rate: 7.5e-05
44
+ - train_batch_size: 16
45
+ - eval_batch_size: 16
46
  - seed: 42
47
+ - gradient_accumulation_steps: 2
48
  - total_train_batch_size: 32
49
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
  - lr_scheduler_type: linear
51
  - lr_scheduler_warmup_steps: 500
52
+ - num_epochs: 120.0
53
  - mixed_precision_training: Native AMP
54
 
55
  ### Training results
56
 
57
+ | Training Loss | Epoch | Step | Validation Loss | Wer |
58
+ |:-------------:|:------:|:----:|:---------------:|:------:|
59
+ | 3.3231 | 29.41 | 500 | 3.3522 | 0.9990 |
60
+ | 2.1146 | 58.82 | 1000 | 1.3368 | 0.9383 |
61
+ | 1.3134 | 88.24 | 1500 | 0.7372 | 0.9579 |
62
+ | 1.1506 | 117.65 | 2000 | 0.6582 | 0.9681 |
63
 
64
 
65
  ### Framework versions