Hugging Face's logo

chrisjay
/
masakhane_benchmarks

african-languages
machine-translation
text
Model card Files Community
masakhane_benchmarks
File size: 13,689 Bytes 
78aa4ee
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
 
Steps: 1000	Loss: 98587.16406	PPL: 42.35123	bleu: 1.97804	LR: 0.00030000	*
Steps: 2000	Loss: 83331.87500	PPL: 23.72063	bleu: 4.41728	LR: 0.00030000	*
Steps: 3000	Loss: 74468.50781	PPL: 16.93810	bleu: 6.43743	LR: 0.00030000	*
Steps: 4000	Loss: 68886.13281	PPL: 13.70078	bleu: 9.43805	LR: 0.00030000	*
Steps: 5000	Loss: 64822.57422	PPL: 11.74058	bleu: 11.82589	LR: 0.00030000	*
Steps: 6000	Loss: 61739.46484	PPL: 10.44269	bleu: 13.63813	LR: 0.00030000	*
Steps: 7000	Loss: 59067.85547	PPL: 9.43466	bleu: 14.85649	LR: 0.00030000	*
Steps: 8000	Loss: 56806.56250	PPL: 8.65786	bleu: 16.22938	LR: 0.00030000	*
Steps: 9000	Loss: 54457.80078	PPL: 7.91867	bleu: 18.71813	LR: 0.00030000	*
Steps: 10000	Loss: 52996.16406	PPL: 7.49087	bleu: 19.07842	LR: 0.00030000	*
Steps: 11000	Loss: 51604.36719	PPL: 7.10502	bleu: 19.20304	LR: 0.00030000	*
Steps: 12000	Loss: 50352.13672	PPL: 6.77487	bleu: 20.38498	LR: 0.00030000	*
Steps: 13000	Loss: 49454.42188	PPL: 6.54768	bleu: 20.43895	LR: 0.00030000	*
Steps: 14000	Loss: 48591.03906	PPL: 6.33636	bleu: 21.71949	LR: 0.00030000	*
Steps: 15000	Loss: 47677.19141	PPL: 6.12012	bleu: 21.90593	LR: 0.00030000	*
Steps: 16000	Loss: 47033.92969	PPL: 5.97234	bleu: 22.61263	LR: 0.00030000	*
Steps: 17000	Loss: 46466.60547	PPL: 5.84498	bleu: 22.53257	LR: 0.00030000	*
Steps: 18000	Loss: 45689.82031	PPL: 5.67498	bleu: 23.11039	LR: 0.00030000	*
Steps: 19000	Loss: 45089.90625	PPL: 5.54708	bleu: 23.38194	LR: 0.00030000	*
Steps: 20000	Loss: 44844.77734	PPL: 5.49566	bleu: 24.04572	LR: 0.00030000	*
Steps: 21000	Loss: 44017.16797	PPL: 5.32553	bleu: 24.43880	LR: 0.00030000	*
Steps: 22000	Loss: 43584.07812	PPL: 5.23861	bleu: 24.45597	LR: 0.00030000	*
Steps: 23000	Loss: 43314.88672	PPL: 5.18530	bleu: 24.65415	LR: 0.00030000	*
Steps: 24000	Loss: 42719.63672	PPL: 5.06934	bleu: 24.88043	LR: 0.00030000	*
Steps: 25000	Loss: 42679.84375	PPL: 5.06168	bleu: 25.29832	LR: 0.00030000	*
Steps: 26000	Loss: 42187.60938	PPL: 4.96789	bleu: 25.20145	LR: 0.00030000	*
Steps: 27000	Loss: 41824.11328	PPL: 4.89974	bleu: 26.03683	LR: 0.00030000	*
Steps: 28000	Loss: 41468.59375	PPL: 4.83400	bleu: 26.05520	LR: 0.00030000	*
Steps: 29000	Loss: 41204.90625	PPL: 4.78581	bleu: 25.88880	LR: 0.00030000	*
Steps: 30000	Loss: 41016.20703	PPL: 4.75162	bleu: 26.14282	LR: 0.00030000	*
Steps: 31000	Loss: 40608.95703	PPL: 4.67866	bleu: 26.55928	LR: 0.00030000	*
Steps: 32000	Loss: 40509.76953	PPL: 4.66106	bleu: 26.67988	LR: 0.00030000	*
Steps: 33000	Loss: 40239.44922	PPL: 4.61343	bleu: 26.84404	LR: 0.00030000	*
Steps: 34000	Loss: 40025.32812	PPL: 4.57604	bleu: 26.87073	LR: 0.00030000	*
Steps: 35000	Loss: 39749.69141	PPL: 4.52837	bleu: 26.45645	LR: 0.00030000	*
Steps: 36000	Loss: 39582.90234	PPL: 4.49976	bleu: 27.14048	LR: 0.00030000	*
Steps: 37000	Loss: 39517.82422	PPL: 4.48865	bleu: 27.31787	LR: 0.00030000	*
Steps: 38000	Loss: 39297.59766	PPL: 4.45124	bleu: 27.43823	LR: 0.00030000	*
Steps: 39000	Loss: 39099.30078	PPL: 4.41783	bleu: 27.54830	LR: 0.00030000	*
Steps: 40000	Loss: 38847.82812	PPL: 4.37582	bleu: 27.68253	LR: 0.00030000	*
Steps: 41000	Loss: 38879.46094	PPL: 4.38108	bleu: 27.68924	LR: 0.00030000	
Steps: 42000	Loss: 38647.40625	PPL: 4.34262	bleu: 28.17924	LR: 0.00030000	*
Steps: 43000	Loss: 38276.96484	PPL: 4.28192	bleu: 28.29594	LR: 0.00030000	*
Steps: 44000	Loss: 38070.88281	PPL: 4.24853	bleu: 28.30240	LR: 0.00030000	*
Steps: 45000	Loss: 38274.80469	PPL: 4.28157	bleu: 27.95180	LR: 0.00030000	
Steps: 46000	Loss: 37995.72266	PPL: 4.23641	bleu: 28.24181	LR: 0.00030000	*
Steps: 47000	Loss: 37869.91016	PPL: 4.21621	bleu: 28.38744	LR: 0.00030000	*
Steps: 48000	Loss: 37475.66797	PPL: 4.15352	bleu: 28.37237	LR: 0.00030000	*
Steps: 49000	Loss: 37545.52734	PPL: 4.16456	bleu: 28.47124	LR: 0.00030000	
Steps: 50000	Loss: 37262.00781	PPL: 4.11994	bleu: 29.04737	LR: 0.00030000	*
Steps: 51000	Loss: 37392.51953	PPL: 4.14042	bleu: 28.47380	LR: 0.00030000	
Steps: 52000	Loss: 37086.64062	PPL: 4.09257	bleu: 28.80841	LR: 0.00030000	*
Steps: 53000	Loss: 37045.52734	PPL: 4.08618	bleu: 28.96906	LR: 0.00030000	*
Steps: 54000	Loss: 37022.62500	PPL: 4.08263	bleu: 28.97203	LR: 0.00030000	*
Steps: 55000	Loss: 36755.39453	PPL: 4.04139	bleu: 29.39079	LR: 0.00030000	*
Steps: 56000	Loss: 36576.10156	PPL: 4.01395	bleu: 29.45850	LR: 0.00030000	*
Steps: 57000	Loss: 36669.27734	PPL: 4.02818	bleu: 29.16113	LR: 0.00030000	
Steps: 58000	Loss: 36586.67969	PPL: 4.01556	bleu: 29.55223	LR: 0.00030000	
Steps: 59000	Loss: 36472.73828	PPL: 3.99821	bleu: 29.08540	LR: 0.00030000	*
Steps: 60000	Loss: 36312.05469	PPL: 3.97388	bleu: 29.55714	LR: 0.00030000	*
Steps: 61000	Loss: 36405.46484	PPL: 3.98801	bleu: 29.42361	LR: 0.00030000	
Steps: 62000	Loss: 36182.63672	PPL: 3.95438	bleu: 30.02000	LR: 0.00030000	*
Steps: 63000	Loss: 36137.33984	PPL: 3.94758	bleu: 29.62116	LR: 0.00030000	*
Steps: 64000	Loss: 36105.62109	PPL: 3.94283	bleu: 29.85833	LR: 0.00030000	*
Steps: 65000	Loss: 35999.64062	PPL: 3.92698	bleu: 29.59327	LR: 0.00030000	*
Steps: 66000	Loss: 35726.74609	PPL: 3.88647	bleu: 29.87549	LR: 0.00030000	*
Steps: 67000	Loss: 35741.32422	PPL: 3.88863	bleu: 30.01595	LR: 0.00030000	
Steps: 68000	Loss: 35686.67969	PPL: 3.88056	bleu: 30.35649	LR: 0.00030000	*
Steps: 69000	Loss: 35710.10156	PPL: 3.88402	bleu: 30.05167	LR: 0.00030000	
Steps: 70000	Loss: 35463.79297	PPL: 3.84784	bleu: 30.24805	LR: 0.00030000	*
Steps: 71000	Loss: 35473.36328	PPL: 3.84924	bleu: 29.90266	LR: 0.00030000	
Steps: 72000	Loss: 35397.48828	PPL: 3.83815	bleu: 29.88424	LR: 0.00030000	*
Steps: 73000	Loss: 35230.08203	PPL: 3.81382	bleu: 30.16289	LR: 0.00030000	*
Steps: 74000	Loss: 35263.62891	PPL: 3.81868	bleu: 30.48071	LR: 0.00030000	
Steps: 75000	Loss: 35229.18750	PPL: 3.81369	bleu: 30.43892	LR: 0.00030000	*
Steps: 76000	Loss: 35177.29297	PPL: 3.80618	bleu: 30.03361	LR: 0.00030000	*
Steps: 77000	Loss: 35051.81641	PPL: 3.78807	bleu: 30.28445	LR: 0.00030000	*
Steps: 78000	Loss: 34947.87891	PPL: 3.77314	bleu: 30.42704	LR: 0.00030000	*
Steps: 79000	Loss: 35128.52734	PPL: 3.79913	bleu: 30.25947	LR: 0.00030000	
Steps: 80000	Loss: 34997.02344	PPL: 3.78019	bleu: 30.47747	LR: 0.00030000	
Steps: 81000	Loss: 34880.70703	PPL: 3.76352	bleu: 30.19161	LR: 0.00030000	*
Steps: 82000	Loss: 34784.55469	PPL: 3.74980	bleu: 30.22135	LR: 0.00030000	*
Steps: 83000	Loss: 34783.46484	PPL: 3.74964	bleu: 30.33980	LR: 0.00030000	*
Steps: 84000	Loss: 34859.35547	PPL: 3.76047	bleu: 30.61563	LR: 0.00030000	
Steps: 85000	Loss: 34702.01172	PPL: 3.73806	bleu: 30.54406	LR: 0.00030000	*
Steps: 86000	Loss: 34571.55469	PPL: 3.71957	bleu: 30.43779	LR: 0.00030000	*
Steps: 87000	Loss: 34516.69531	PPL: 3.71183	bleu: 30.67521	LR: 0.00030000	*
Steps: 88000	Loss: 34461.06641	PPL: 3.70399	bleu: 30.88347	LR: 0.00030000	*
Steps: 89000	Loss: 34346.12500	PPL: 3.68785	bleu: 31.30517	LR: 0.00030000	*
Steps: 90000	Loss: 34400.59766	PPL: 3.69549	bleu: 30.66718	LR: 0.00030000	
Steps: 91000	Loss: 34366.86328	PPL: 3.69076	bleu: 30.61125	LR: 0.00030000	
Steps: 92000	Loss: 34390.93359	PPL: 3.69413	bleu: 30.51666	LR: 0.00030000	
Steps: 93000	Loss: 34191.80078	PPL: 3.66629	bleu: 30.49210	LR: 0.00030000	*
Steps: 94000	Loss: 34093.54688	PPL: 3.65262	bleu: 30.98921	LR: 0.00030000	*
Steps: 95000	Loss: 34346.17578	PPL: 3.68785	bleu: 30.57657	LR: 0.00030000	
Steps: 96000	Loss: 33984.32812	PPL: 3.63750	bleu: 30.73922	LR: 0.00030000	*
Steps: 97000	Loss: 33945.04688	PPL: 3.63207	bleu: 30.53422	LR: 0.00030000	*
Steps: 98000	Loss: 34108.48047	PPL: 3.65470	bleu: 30.41809	LR: 0.00030000	
Steps: 99000	Loss: 33905.70312	PPL: 3.62665	bleu: 30.98853	LR: 0.00030000	*
Steps: 100000	Loss: 33827.56250	PPL: 3.61590	bleu: 31.11354	LR: 0.00030000	*
Steps: 101000	Loss: 33818.79688	PPL: 3.61469	bleu: 30.98484	LR: 0.00030000	*
Steps: 102000	Loss: 33690.30859	PPL: 3.59709	bleu: 31.02905	LR: 0.00030000	*
Steps: 103000	Loss: 33733.51562	PPL: 3.60300	bleu: 30.84068	LR: 0.00030000	
Steps: 104000	Loss: 33771.46484	PPL: 3.60820	bleu: 31.17957	LR: 0.00030000	
Steps: 105000	Loss: 33717.67969	PPL: 3.60083	bleu: 31.22264	LR: 0.00030000	
Steps: 106000	Loss: 33572.11328	PPL: 3.58097	bleu: 31.12246	LR: 0.00030000	*
Steps: 107000	Loss: 33518.23828	PPL: 3.57365	bleu: 30.76655	LR: 0.00030000	*
Steps: 108000	Loss: 33529.24219	PPL: 3.57514	bleu: 30.41456	LR: 0.00030000	
Steps: 109000	Loss: 33524.25781	PPL: 3.57446	bleu: 30.97445	LR: 0.00030000	
Steps: 110000	Loss: 33568.29688	PPL: 3.58045	bleu: 31.27724	LR: 0.00030000	
Steps: 111000	Loss: 33386.31641	PPL: 3.55578	bleu: 31.07954	LR: 0.00030000	*
Steps: 112000	Loss: 33407.89844	PPL: 3.55869	bleu: 31.40365	LR: 0.00030000	
Steps: 113000	Loss: 33410.83984	PPL: 3.55909	bleu: 30.86494	LR: 0.00030000	
Steps: 114000	Loss: 33256.14844	PPL: 3.53823	bleu: 31.03824	LR: 0.00030000	*
Steps: 115000	Loss: 33299.70312	PPL: 3.54409	bleu: 31.25064	LR: 0.00030000	
Steps: 116000	Loss: 33405.30078	PPL: 3.55834	bleu: 31.45736	LR: 0.00030000	
Steps: 117000	Loss: 33326.59375	PPL: 3.54772	bleu: 30.89787	LR: 0.00030000	
Steps: 118000	Loss: 33079.33594	PPL: 3.51454	bleu: 31.66253	LR: 0.00030000	*
Steps: 119000	Loss: 32991.24219	PPL: 3.50280	bleu: 31.53065	LR: 0.00030000	*
Steps: 120000	Loss: 33046.24219	PPL: 3.51013	bleu: 31.10928	LR: 0.00030000	
Steps: 121000	Loss: 33072.25000	PPL: 3.51360	bleu: 31.57333	LR: 0.00030000	
Steps: 122000	Loss: 33126.78125	PPL: 3.52088	bleu: 31.29760	LR: 0.00030000	
Steps: 123000	Loss: 32983.21094	PPL: 3.50173	bleu: 31.66696	LR: 0.00030000	*
Steps: 124000	Loss: 33080.36328	PPL: 3.51468	bleu: 31.43619	LR: 0.00030000	
Steps: 125000	Loss: 32920.58594	PPL: 3.49341	bleu: 31.49514	LR: 0.00030000	*
Steps: 126000	Loss: 33020.04688	PPL: 3.50663	bleu: 31.63576	LR: 0.00030000	
Steps: 127000	Loss: 32856.67188	PPL: 3.48493	bleu: 31.46821	LR: 0.00030000	*
Steps: 128000	Loss: 32781.53125	PPL: 3.47500	bleu: 31.20838	LR: 0.00030000	*
Steps: 129000	Loss: 32951.09375	PPL: 3.49746	bleu: 31.48965	LR: 0.00030000	
Steps: 130000	Loss: 32886.66406	PPL: 3.48891	bleu: 31.35809	LR: 0.00030000	
Steps: 131000	Loss: 32890.52734	PPL: 3.48942	bleu: 31.73268	LR: 0.00030000	
Steps: 132000	Loss: 32772.80078	PPL: 3.47384	bleu: 31.86151	LR: 0.00030000	*
Steps: 133000	Loss: 32855.81250	PPL: 3.48482	bleu: 31.37413	LR: 0.00030000	
Steps: 134000	Loss: 32762.84766	PPL: 3.47253	bleu: 31.86319	LR: 0.00030000	*
Steps: 135000	Loss: 32709.50000	PPL: 3.46550	bleu: 31.63933	LR: 0.00030000	*
Steps: 136000	Loss: 32723.34375	PPL: 3.46732	bleu: 32.07189	LR: 0.00030000	
Steps: 137000	Loss: 32601.82227	PPL: 3.45135	bleu: 31.60738	LR: 0.00030000	*
Steps: 138000	Loss: 32599.85742	PPL: 3.45109	bleu: 32.18206	LR: 0.00030000	*
Steps: 139000	Loss: 32645.00195	PPL: 3.45702	bleu: 31.39706	LR: 0.00030000	
Steps: 140000	Loss: 32664.53320	PPL: 3.45958	bleu: 31.49268	LR: 0.00030000	
Steps: 141000	Loss: 32502.66406	PPL: 3.43837	bleu: 31.46003	LR: 0.00030000	*
Steps: 142000	Loss: 32540.71094	PPL: 3.44334	bleu: 31.70974	LR: 0.00030000	
Steps: 143000	Loss: 32388.56055	PPL: 3.42349	bleu: 31.66381	LR: 0.00030000	*
Steps: 144000	Loss: 32382.94531	PPL: 3.42276	bleu: 31.73107	LR: 0.00030000	*
Steps: 145000	Loss: 32361.57227	PPL: 3.41999	bleu: 31.78980	LR: 0.00030000	*
Steps: 146000	Loss: 32512.67578	PPL: 3.43968	bleu: 31.56925	LR: 0.00030000	
Steps: 147000	Loss: 32401.49023	PPL: 3.42518	bleu: 32.34126	LR: 0.00030000	
Steps: 148000	Loss: 32242.35156	PPL: 3.40453	bleu: 32.13088	LR: 0.00030000	*
Steps: 149000	Loss: 32367.37695	PPL: 3.42074	bleu: 31.79343	LR: 0.00030000	
Steps: 150000	Loss: 32337.34180	PPL: 3.41684	bleu: 31.65206	LR: 0.00030000	
Steps: 151000	Loss: 32426.80078	PPL: 3.42847	bleu: 31.93923	LR: 0.00030000	
Steps: 152000	Loss: 32209.64648	PPL: 3.40030	bleu: 31.92305	LR: 0.00030000	*
Steps: 153000	Loss: 32303.37500	PPL: 3.41243	bleu: 31.88268	LR: 0.00030000	
Steps: 154000	Loss: 32305.85938	PPL: 3.41275	bleu: 31.96695	LR: 0.00030000	
Steps: 155000	Loss: 32143.62109	PPL: 3.39178	bleu: 31.59042	LR: 0.00030000	*
Steps: 156000	Loss: 32195.13086	PPL: 3.39843	bleu: 31.97927	LR: 0.00030000	
Steps: 157000	Loss: 32223.27734	PPL: 3.40206	bleu: 31.95538	LR: 0.00030000	
Steps: 158000	Loss: 32048.46875	PPL: 3.37954	bleu: 32.11889	LR: 0.00030000	*
Steps: 159000	Loss: 32142.28125	PPL: 3.39161	bleu: 32.20169	LR: 0.00030000	
Steps: 160000	Loss: 32221.57031	PPL: 3.40184	bleu: 31.85228	LR: 0.00030000	
Steps: 161000	Loss: 32105.10547	PPL: 3.38682	bleu: 31.89760	LR: 0.00030000	
Steps: 162000	Loss: 32077.90430	PPL: 3.38332	bleu: 31.95942	LR: 0.00030000	
Steps: 163000	Loss: 32063.21680	PPL: 3.38143	bleu: 32.25314	LR: 0.00030000	
Steps: 164000	Loss: 32044.81250	PPL: 3.37907	bleu: 31.87277	LR: 0.00030000	*
Steps: 165000	Loss: 32011.27539	PPL: 3.37477	bleu: 31.85913	LR: 0.00030000	*
Steps: 166000	Loss: 31968.13086	PPL: 3.36924	bleu: 32.12024	LR: 0.00030000	*
Steps: 167000	Loss: 31894.38867	PPL: 3.35981	bleu: 32.36714	LR: 0.00030000	*
Steps: 168000	Loss: 31896.24805	PPL: 3.36005	bleu: 32.05152	LR: 0.00030000	
Steps: 169000	Loss: 32019.65039	PPL: 3.37584	bleu: 31.97728	LR: 0.00030000	
Steps: 170000	Loss: 31996.90234	PPL: 3.37292	bleu: 31.89701	LR: 0.00030000	
Steps: 171000	Loss: 31885.30273	PPL: 3.35865	bleu: 32.18194	LR: 0.00030000	*
Steps: 172000	Loss: 31862.72461	PPL: 3.35577	bleu: 32.80236	LR: 0.00030000	*
Steps: 173000	Loss: 31766.87500	PPL: 3.34357	bleu: 32.30026	LR: 0.00030000	*
Steps: 174000	Loss: 31762.73047	PPL: 3.34305	bleu: 32.46215	LR: 0.00030000	*
Steps: 175000	Loss: 31763.25195	PPL: 3.34311	bleu: 32.04518	LR: 0.00030000	
Steps: 176000	Loss: 31768.62891	PPL: 3.34380	bleu: 32.33361	LR: 0.00030000	
Steps: 177000	Loss: 31812.34766	PPL: 3.34935	bleu: 32.24424	LR: 0.00030000	
Steps: 178000	Loss: 31722.37695	PPL: 3.33792	bleu: 32.03003	LR: 0.00030000	*
Steps: 179000	Loss: 31798.01953	PPL: 3.34753	bleu: 32.86679	LR: 0.00030000	
Steps: 180000	Loss: 31784.23242	PPL: 3.34578	bleu: 32.38772	LR: 0.00030000