| Steps: 1000 Loss: 109860.85938 PPL: 63.79848 bleu: 1.16087 LR: 0.00030000 * | |
| Steps: 2000 Loss: 95330.92188 PPL: 36.82225 bleu: 2.88280 LR: 0.00030000 * | |
| Steps: 3000 Loss: 86224.48438 PPL: 26.09207 bleu: 4.41620 LR: 0.00030000 * | |
| Steps: 4000 Loss: 80323.14062 PPL: 20.87182 bleu: 5.56210 LR: 0.00030000 * | |
| Steps: 5000 Loss: 75845.74219 PPL: 17.61996 bleu: 7.05899 LR: 0.00030000 * | |
| Steps: 6000 Loss: 72087.57031 PPL: 15.28499 bleu: 8.73496 LR: 0.00030000 * | |
| Steps: 7000 Loss: 68820.29688 PPL: 13.50797 bleu: 10.11460 LR: 0.00030000 * | |
| Steps: 8000 Loss: 66377.24219 PPL: 12.31558 bleu: 11.49296 LR: 0.00030000 * | |
| Steps: 9000 Loss: 64206.80469 PPL: 11.34485 bleu: 12.07445 LR: 0.00030000 * | |
| Steps: 10000 Loss: 62063.46094 PPL: 10.46135 bleu: 12.97361 LR: 0.00030000 * | |
| Steps: 11000 Loss: 60652.78906 PPL: 9.91775 bleu: 13.71834 LR: 0.00030000 * | |
| Steps: 12000 Loss: 59153.05859 PPL: 9.37077 bleu: 14.68732 LR: 0.00030000 * | |
| Steps: 13000 Loss: 58085.83984 PPL: 9.00000 bleu: 15.08894 LR: 0.00030000 * | |
| Steps: 14000 Loss: 56943.12500 PPL: 8.61926 bleu: 15.92625 LR: 0.00030000 * | |
| Steps: 15000 Loss: 55890.43359 PPL: 8.28278 bleu: 16.43676 LR: 0.00030000 * | |
| Steps: 16000 Loss: 54738.51172 PPL: 7.92962 bleu: 17.31161 LR: 0.00030000 * | |
| Steps: 17000 Loss: 54238.69922 PPL: 7.78111 bleu: 17.58451 LR: 0.00030000 * | |
| Steps: 18000 Loss: 53437.94531 PPL: 7.54895 bleu: 18.23502 LR: 0.00030000 * | |
| Steps: 19000 Loss: 52919.95703 PPL: 7.40247 bleu: 18.16734 LR: 0.00030000 * | |
| Steps: 20000 Loss: 52087.83594 PPL: 7.17310 bleu: 18.97346 LR: 0.00030000 * | |
| Steps: 21000 Loss: 51602.27344 PPL: 7.04255 bleu: 19.49282 LR: 0.00030000 * | |
| Steps: 22000 Loss: 51046.27344 PPL: 6.89597 bleu: 20.18313 LR: 0.00030000 * | |
| Steps: 23000 Loss: 50586.93750 PPL: 6.77719 bleu: 20.31719 LR: 0.00030000 * | |
| Steps: 24000 Loss: 50214.29297 PPL: 6.68233 bleu: 20.12025 LR: 0.00030000 * | |
| Steps: 25000 Loss: 49788.15234 PPL: 6.57547 bleu: 21.20197 LR: 0.00030000 * | |
| Steps: 26000 Loss: 49435.96094 PPL: 6.48845 bleu: 20.61039 LR: 0.00030000 * | |
| Steps: 27000 Loss: 49078.21875 PPL: 6.40124 bleu: 21.55727 LR: 0.00030000 * | |
| Steps: 28000 Loss: 48415.01172 PPL: 6.24265 bleu: 22.01150 LR: 0.00030000 * | |
| Steps: 29000 Loss: 48288.69922 PPL: 6.21289 bleu: 22.07347 LR: 0.00030000 * | |
| Steps: 30000 Loss: 47960.46875 PPL: 6.13623 bleu: 22.14050 LR: 0.00030000 * | |
| Steps: 31000 Loss: 47794.85547 PPL: 6.09791 bleu: 22.25916 LR: 0.00030000 * | |
| Steps: 32000 Loss: 47344.05078 PPL: 5.99480 bleu: 22.56217 LR: 0.00030000 * | |
| Steps: 33000 Loss: 47036.36719 PPL: 5.92544 bleu: 22.80059 LR: 0.00030000 * | |
| Steps: 34000 Loss: 46815.85547 PPL: 5.87622 bleu: 22.91385 LR: 0.00030000 * | |
| Steps: 35000 Loss: 46446.91406 PPL: 5.79478 bleu: 23.03060 LR: 0.00030000 * | |
| Steps: 36000 Loss: 46170.69141 PPL: 5.73454 bleu: 23.28469 LR: 0.00030000 * | |
| Steps: 37000 Loss: 46064.51172 PPL: 5.71156 bleu: 23.30764 LR: 0.00030000 * | |
| Steps: 38000 Loss: 45972.44922 PPL: 5.69170 bleu: 23.45203 LR: 0.00030000 * | |
| Steps: 39000 Loss: 45646.36719 PPL: 5.62193 bleu: 23.19590 LR: 0.00030000 * | |
| Steps: 40000 Loss: 45530.07422 PPL: 5.59725 bleu: 23.83184 LR: 0.00030000 * | |
| Steps: 41000 Loss: 45320.12891 PPL: 5.55297 bleu: 24.05443 LR: 0.00030000 * | |
| Steps: 42000 Loss: 45291.03125 PPL: 5.54687 bleu: 23.95032 LR: 0.00030000 * | |
| Steps: 43000 Loss: 45072.32422 PPL: 5.50117 bleu: 24.01709 LR: 0.00030000 * | |
| Steps: 44000 Loss: 44780.23828 PPL: 5.44072 bleu: 24.07221 LR: 0.00030000 * | |
| Steps: 45000 Loss: 44677.62109 PPL: 5.41964 bleu: 24.25126 LR: 0.00030000 * | |
| Steps: 46000 Loss: 44496.13672 PPL: 5.38256 bleu: 24.59385 LR: 0.00030000 * | |
| Steps: 47000 Loss: 44567.11719 PPL: 5.39703 bleu: 24.31773 LR: 0.00030000 | |
| Steps: 48000 Loss: 44194.85156 PPL: 5.32157 bleu: 24.60332 LR: 0.00030000 * | |
| Steps: 49000 Loss: 44017.55469 PPL: 5.28600 bleu: 24.87387 LR: 0.00030000 * | |
| Steps: 50000 Loss: 43836.61328 PPL: 5.24994 bleu: 24.86829 LR: 0.00030000 * | |
| Steps: 51000 Loss: 43881.33984 PPL: 5.25883 bleu: 24.98661 LR: 0.00030000 | |
| Steps: 52000 Loss: 43733.86328 PPL: 5.22957 bleu: 24.51259 LR: 0.00030000 * | |
| Steps: 53000 Loss: 43552.92578 PPL: 5.19390 bleu: 24.67414 LR: 0.00030000 * | |
| Steps: 54000 Loss: 43563.52734 PPL: 5.19599 bleu: 24.76077 LR: 0.00030000 | |
| Steps: 55000 Loss: 43322.52734 PPL: 5.14883 bleu: 25.24733 LR: 0.00030000 * | |
| Steps: 56000 Loss: 43293.60156 PPL: 5.14320 bleu: 24.94730 LR: 0.00030000 * | |
| Steps: 57000 Loss: 43352.19141 PPL: 5.15461 bleu: 25.27352 LR: 0.00030000 | |
| Steps: 58000 Loss: 43042.32812 PPL: 5.09455 bleu: 25.23045 LR: 0.00030000 * | |
| Steps: 59000 Loss: 43045.07031 PPL: 5.09508 bleu: 25.49793 LR: 0.00030000 | |
| Steps: 60000 Loss: 42705.03516 PPL: 5.02996 bleu: 25.59941 LR: 0.00030000 * | |
| Steps: 61000 Loss: 42700.70312 PPL: 5.02914 bleu: 25.75874 LR: 0.00030000 * | |
| Steps: 62000 Loss: 42574.29297 PPL: 5.00515 bleu: 25.87328 LR: 0.00030000 * | |
| Steps: 63000 Loss: 42475.92969 PPL: 4.98656 bleu: 25.95982 LR: 0.00030000 * | |
| Steps: 64000 Loss: 42353.16406 PPL: 4.96345 bleu: 25.95557 LR: 0.00030000 * | |
| Steps: 65000 Loss: 42330.46094 PPL: 4.95919 bleu: 25.53954 LR: 0.00030000 * | |
| Steps: 66000 Loss: 42035.45703 PPL: 4.90416 bleu: 25.58189 LR: 0.00030000 * | |
| Steps: 67000 Loss: 42130.27734 PPL: 4.92178 bleu: 25.84658 LR: 0.00030000 | |
| Steps: 68000 Loss: 42154.22656 PPL: 4.92624 bleu: 26.37654 LR: 0.00030000 | |
| Steps: 69000 Loss: 41889.39844 PPL: 4.87714 bleu: 26.27554 LR: 0.00030000 * | |
| Steps: 70000 Loss: 41850.42578 PPL: 4.86996 bleu: 26.00508 LR: 0.00030000 * | |
| Steps: 71000 Loss: 41709.23828 PPL: 4.84402 bleu: 26.03188 LR: 0.00030000 * | |
| Steps: 72000 Loss: 41678.94922 PPL: 4.83847 bleu: 26.44786 LR: 0.00030000 * | |
| Steps: 73000 Loss: 41674.26953 PPL: 4.83761 bleu: 26.30641 LR: 0.00030000 * | |
| Steps: 74000 Loss: 41626.07812 PPL: 4.82880 bleu: 26.05812 LR: 0.00030000 * | |
| Steps: 75000 Loss: 41343.68750 PPL: 4.77749 bleu: 26.66109 LR: 0.00030000 * | |
| Steps: 76000 Loss: 41534.37109 PPL: 4.81208 bleu: 26.23050 LR: 0.00030000 | |
| Steps: 77000 Loss: 41426.35938 PPL: 4.79246 bleu: 26.69887 LR: 0.00030000 | |
| Steps: 78000 Loss: 41517.64453 PPL: 4.80904 bleu: 26.55968 LR: 0.00030000 | |
| Steps: 79000 Loss: 41268.49219 PPL: 4.76392 bleu: 26.62992 LR: 0.00030000 * | |
| Steps: 80000 Loss: 41280.38281 PPL: 4.76607 bleu: 26.96569 LR: 0.00030000 | |
| Steps: 81000 Loss: 41320.26172 PPL: 4.77326 bleu: 26.44191 LR: 0.00030000 | |
| Steps: 82000 Loss: 41146.32422 PPL: 4.74196 bleu: 26.93031 LR: 0.00030000 * | |
| Steps: 83000 Loss: 41016.72656 PPL: 4.71877 bleu: 27.15384 LR: 0.00030000 * | |
| Steps: 84000 Loss: 41055.05469 PPL: 4.72562 bleu: 26.80484 LR: 0.00030000 | |
| Steps: 85000 Loss: 40960.78516 PPL: 4.70880 bleu: 27.22547 LR: 0.00030000 * | |
| Steps: 86000 Loss: 40844.44531 PPL: 4.68812 bleu: 26.64659 LR: 0.00030000 * | |
| Steps: 87000 Loss: 40887.74609 PPL: 4.69580 bleu: 27.03646 LR: 0.00030000 | |
| Steps: 88000 Loss: 40820.63672 PPL: 4.68390 bleu: 26.74422 LR: 0.00030000 * | |
| Steps: 89000 Loss: 40767.55859 PPL: 4.67450 bleu: 26.72004 LR: 0.00030000 * | |
| Steps: 90000 Loss: 40813.35547 PPL: 4.68261 bleu: 26.72847 LR: 0.00030000 | |
| Steps: 91000 Loss: 40692.90234 PPL: 4.66132 bleu: 26.49499 LR: 0.00030000 * | |
| Steps: 92000 Loss: 40595.41016 PPL: 4.64416 bleu: 27.17610 LR: 0.00030000 * | |
| Steps: 93000 Loss: 40498.67188 PPL: 4.62720 bleu: 26.91161 LR: 0.00030000 * | |
| Steps: 94000 Loss: 40470.02344 PPL: 4.62219 bleu: 27.54934 LR: 0.00030000 * | |
| Steps: 95000 Loss: 40204.17578 PPL: 4.57594 bleu: 27.26871 LR: 0.00030000 * | |
| Steps: 96000 Loss: 40466.09766 PPL: 4.62150 bleu: 27.33716 LR: 0.00030000 | |
| Steps: 97000 Loss: 40309.43750 PPL: 4.59419 bleu: 26.95324 LR: 0.00030000 | |
| Steps: 98000 Loss: 40214.08594 PPL: 4.57765 bleu: 27.27039 LR: 0.00030000 | |
| Steps: 99000 Loss: 40220.38281 PPL: 4.57874 bleu: 27.16213 LR: 0.00030000 | |
| Steps: 100000 Loss: 40407.34766 PPL: 4.61124 bleu: 27.08808 LR: 0.00030000 | |
| Steps: 101000 Loss: 40170.73828 PPL: 4.57015 bleu: 27.57661 LR: 0.00030000 * | |
| Steps: 102000 Loss: 39969.62109 PPL: 4.53552 bleu: 27.26296 LR: 0.00030000 * | |
| Steps: 103000 Loss: 39943.88672 PPL: 4.53110 bleu: 27.57128 LR: 0.00030000 * | |
| Steps: 104000 Loss: 39999.43750 PPL: 4.54063 bleu: 27.73437 LR: 0.00030000 | |
| Steps: 105000 Loss: 39984.07422 PPL: 4.53800 bleu: 27.80008 LR: 0.00030000 | |
| Steps: 106000 Loss: 39857.99609 PPL: 4.51641 bleu: 27.58880 LR: 0.00030000 * | |
| Steps: 107000 Loss: 39776.58594 PPL: 4.50252 bleu: 27.44173 LR: 0.00030000 * | |
| Steps: 108000 Loss: 39722.57812 PPL: 4.49333 bleu: 27.54758 LR: 0.00030000 * | |
| Steps: 109000 Loss: 39863.85938 PPL: 4.51741 bleu: 27.89135 LR: 0.00030000 | |
| Steps: 110000 Loss: 39727.18359 PPL: 4.49411 bleu: 27.57073 LR: 0.00030000 | |
| Steps: 111000 Loss: 39679.64453 PPL: 4.48604 bleu: 27.83125 LR: 0.00030000 * | |
| Steps: 112000 Loss: 39545.80859 PPL: 4.46338 bleu: 27.84191 LR: 0.00030000 * | |
| Steps: 113000 Loss: 39665.88281 PPL: 4.48370 bleu: 27.85594 LR: 0.00030000 | |
| Steps: 114000 Loss: 39423.54688 PPL: 4.44279 bleu: 27.95347 LR: 0.00030000 * | |
| Steps: 115000 Loss: 39439.51172 PPL: 4.44547 bleu: 27.93730 LR: 0.00030000 | |
| Steps: 116000 Loss: 39461.19922 PPL: 4.44912 bleu: 28.23924 LR: 0.00030000 | |
| Steps: 117000 Loss: 39426.83203 PPL: 4.44334 bleu: 28.55447 LR: 0.00030000 | |
| Steps: 118000 Loss: 39500.12500 PPL: 4.45568 bleu: 28.08246 LR: 0.00030000 | |
| Steps: 119000 Loss: 39432.98438 PPL: 4.44438 bleu: 28.03362 LR: 0.00030000 | |
| Steps: 120000 Loss: 39235.50391 PPL: 4.41130 bleu: 27.92296 LR: 0.00030000 * | |
| Steps: 121000 Loss: 39249.70312 PPL: 4.41367 bleu: 28.12895 LR: 0.00030000 | |
| Steps: 122000 Loss: 39545.42188 PPL: 4.46332 bleu: 27.44171 LR: 0.00030000 | |
| Steps: 123000 Loss: 39366.34375 PPL: 4.43319 bleu: 28.38928 LR: 0.00030000 | |
| Steps: 124000 Loss: 39260.67969 PPL: 4.41550 bleu: 27.85191 LR: 0.00030000 | |
| Steps: 125000 Loss: 39296.58984 PPL: 4.42150 bleu: 28.25766 LR: 0.00030000 | |
| Steps: 126000 Loss: 39071.32422 PPL: 4.38399 bleu: 27.99353 LR: 0.00030000 * | |
| Steps: 127000 Loss: 39090.17578 PPL: 4.38712 bleu: 28.13892 LR: 0.00030000 | |
| Steps: 128000 Loss: 39310.87109 PPL: 4.42389 bleu: 28.28530 LR: 0.00030000 | |
| Steps: 129000 Loss: 39037.03516 PPL: 4.37831 bleu: 28.17923 LR: 0.00030000 * | |
| Steps: 130000 Loss: 39034.68750 PPL: 4.37792 bleu: 27.83480 LR: 0.00030000 * | |
| Steps: 131000 Loss: 38922.85938 PPL: 4.35944 bleu: 28.11597 LR: 0.00030000 * | |
| Steps: 132000 Loss: 39091.46094 PPL: 4.38733 bleu: 28.38958 LR: 0.00030000 | |
| Steps: 133000 Loss: 38773.98828 PPL: 4.33496 bleu: 28.55294 LR: 0.00030000 * | |
| Steps: 134000 Loss: 38901.68750 PPL: 4.35595 bleu: 28.31536 LR: 0.00030000 | |
| Steps: 135000 Loss: 39047.96484 PPL: 4.38012 bleu: 28.17555 LR: 0.00030000 | |
| Steps: 136000 Loss: 38899.51172 PPL: 4.35559 bleu: 28.25831 LR: 0.00030000 | |
| Steps: 137000 Loss: 38947.98047 PPL: 4.36358 bleu: 28.54352 LR: 0.00030000 | |
| Steps: 138000 Loss: 39057.56250 PPL: 4.38171 bleu: 28.54284 LR: 0.00030000 | |
| Steps: 139000 Loss: 38880.68359 PPL: 4.35249 bleu: 28.47631 LR: 0.00021000 | |
| Steps: 140000 Loss: 38595.65234 PPL: 4.30581 bleu: 28.64533 LR: 0.00021000 * | |
| Steps: 141000 Loss: 38571.00781 PPL: 4.30180 bleu: 29.08379 LR: 0.00021000 * | |
| Steps: 142000 Loss: 38395.87109 PPL: 4.27339 bleu: 28.59285 LR: 0.00021000 * | |
| Steps: 143000 Loss: 38399.62891 PPL: 4.27400 bleu: 28.56664 LR: 0.00021000 | |
| Steps: 144000 Loss: 38419.46484 PPL: 4.27721 bleu: 28.42608 LR: 0.00021000 | |
| Steps: 145000 Loss: 38447.74609 PPL: 4.28179 bleu: 28.98545 LR: 0.00021000 | |
| Steps: 146000 Loss: 38309.48047 PPL: 4.25945 bleu: 28.65318 LR: 0.00021000 * | |
| Steps: 147000 Loss: 38190.56250 PPL: 4.24033 bleu: 28.92299 LR: 0.00021000 * | |
| Steps: 148000 Loss: 38353.00000 PPL: 4.26647 bleu: 28.80297 LR: 0.00021000 | |
| Steps: 149000 Loss: 38206.91406 PPL: 4.24296 bleu: 28.83223 LR: 0.00021000 | |
| Steps: 150000 Loss: 38072.38281 PPL: 4.22142 bleu: 28.74643 LR: 0.00021000 * | |
| Steps: 151000 Loss: 38127.95703 PPL: 4.23031 bleu: 28.96503 LR: 0.00021000 | |