| Model description: cat-fra | |
| Date: 2024-08-30 | |
| TF version 2.11.0, OpenNMT version 2.32.0, CTranslate2 version 3.22.0 | |
| Test data set | |
| BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 43.1 (μ = 43.1 ± 0.5) 68.7/48.9/37.2/28.8 (BP = 0.989 ratio = 0.989 hyp_len = 268705 ref_len = 271618) | |
| chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 67.1 (μ = 67.1 ± 0.3) | |
| Flores data set | |
| BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 37.0 (μ = 36.9 ± 1.3) 65.5/43.4/31.1/22.9 (BP = 0.981 ratio = 0.981 hyp_len = 27809 ref_len = 28343) | |
| chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 62.4 (μ = 62.3 ± 0.8) | |