Model description: cat-eng
Date: 2023-10-29
TF version 2.10.0, OpenNMT version 2.29.1, CTranslate2 version 3.20.0
Test data set
  BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 47.4 (μ = 47.4 ± 0.4) 73.3/52.7/40.8/32.5 (BP = 0.997 ratio = 0.997 hyp_len = 361248 ref_len = 362174)
chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 68.7 (μ = 68.7 ± 0.3)
Flores data set
  BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 43.5 (μ = 43.5 ± 1.1) 72.2/49.6/36.5/27.3 (BP = 1.000 ratio = 1.017 hyp_len = 25144 ref_len = 24721)
chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 68.4 (μ = 68.3 ± 0.8)