ndeclarke commited on
Commit
2be506c
1 Parent(s): 2d9a734

End of training

Browse files
Files changed (2) hide show
  1. README.md +39 -14
  2. adapter.tel.safetensors +3 -0
README.md CHANGED
@@ -1,14 +1,33 @@
1
  ---
2
- base_model: facebook/mms-1b-all
3
- datasets:
4
- - common_voice_17_0
5
  library_name: transformers
6
  license: cc-by-nc-4.0
 
7
  tags:
8
  - generated_from_trainer
 
 
 
 
 
9
  model-index:
10
  - name: wav2vec2-mms-1b-CV17.0
11
- results: []
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  ---
13
 
14
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -18,15 +37,10 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [facebook/mms-1b-all](https://huggingface.co/facebook/mms-1b-all) on the common_voice_17_0 dataset.
20
  It achieves the following results on the evaluation set:
21
- - eval_loss: 0.2564
22
- - eval_wer: 0.4162
23
- - eval_cer: 0.0698
24
- - eval_bleu: 0.3568
25
- - eval_runtime: 202.4945
26
- - eval_samples_per_second: 11.921
27
- - eval_steps_per_second: 1.491
28
- - epoch: 4.2105
29
- - step: 1200
30
 
31
  ## Model description
32
 
@@ -54,9 +68,20 @@ The following hyperparameters were used during training:
54
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
55
  - lr_scheduler_type: linear
56
  - lr_scheduler_warmup_ratio: 0.15
57
- - training_steps: 2000
58
  - mixed_precision_training: Native AMP
59
 
 
 
 
 
 
 
 
 
 
 
 
60
  ### Framework versions
61
 
62
  - Transformers 4.44.2
 
1
  ---
 
 
 
2
  library_name: transformers
3
  license: cc-by-nc-4.0
4
+ base_model: facebook/mms-1b-all
5
  tags:
6
  - generated_from_trainer
7
+ datasets:
8
+ - common_voice_17_0
9
+ metrics:
10
+ - wer
11
+ - bleu
12
  model-index:
13
  - name: wav2vec2-mms-1b-CV17.0
14
+ results:
15
+ - task:
16
+ name: Automatic Speech Recognition
17
+ type: automatic-speech-recognition
18
+ dataset:
19
+ name: common_voice_17_0
20
+ type: common_voice_17_0
21
+ config: te
22
+ split: test
23
+ args: te
24
+ metrics:
25
+ - name: Wer
26
+ type: wer
27
+ value: 1.2142857142857142
28
+ - name: Bleu
29
+ type: bleu
30
+ value: 0.0
31
  ---
32
 
33
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
37
 
38
  This model is a fine-tuned version of [facebook/mms-1b-all](https://huggingface.co/facebook/mms-1b-all) on the common_voice_17_0 dataset.
39
  It achieves the following results on the evaluation set:
40
+ - Loss: 11.1713
41
+ - Wer: 1.2143
42
+ - Cer: 0.8147
43
+ - Bleu: 0.0
 
 
 
 
 
44
 
45
  ## Model description
46
 
 
68
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
69
  - lr_scheduler_type: linear
70
  - lr_scheduler_warmup_ratio: 0.15
71
+ - training_steps: 1000
72
  - mixed_precision_training: Native AMP
73
 
74
+ ### Training results
75
+
76
+ | Training Loss | Epoch | Step | Validation Loss | Wer | Cer | Bleu |
77
+ |:-------------:|:--------:|:----:|:---------------:|:------:|:------:|:----:|
78
+ | 7.86 | 57.1429 | 200 | 6.2814 | 1.0440 | 0.8624 | 0.0 |
79
+ | 2.3343 | 114.2857 | 400 | 7.7524 | 1.0769 | 0.7876 | 0.0 |
80
+ | 1.4057 | 171.4286 | 600 | 9.7458 | 1.1319 | 0.7940 | 0.0 |
81
+ | 0.9348 | 228.5714 | 800 | 10.7001 | 1.1319 | 0.8090 | 0.0 |
82
+ | 0.7253 | 285.7143 | 1000 | 11.1713 | 1.2143 | 0.8147 | 0.0 |
83
+
84
+
85
  ### Framework versions
86
 
87
  - Transformers 4.44.2
adapter.tel.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45f0370698f7cce7986d68c79faf3ca26b6eb6fc7088e5e82e6e1638b301e43e
3
+ size 8926640