Steps: 1000 Loss: 98587.16406 PPL: 42.35123 bleu: 1.97804 LR: 0.00030000 * Steps: 2000 Loss: 83331.87500 PPL: 23.72063 bleu: 4.41728 LR: 0.00030000 * Steps: 3000 Loss: 74468.50781 PPL: 16.93810 bleu: 6.43743 LR: 0.00030000 * Steps: 4000 Loss: 68886.13281 PPL: 13.70078 bleu: 9.43805 LR: 0.00030000 * Steps: 5000 Loss: 64822.57422 PPL: 11.74058 bleu: 11.82589 LR: 0.00030000 * Steps: 6000 Loss: 61739.46484 PPL: 10.44269 bleu: 13.63813 LR: 0.00030000 * Steps: 7000 Loss: 59067.85547 PPL: 9.43466 bleu: 14.85649 LR: 0.00030000 * Steps: 8000 Loss: 56806.56250 PPL: 8.65786 bleu: 16.22938 LR: 0.00030000 * Steps: 9000 Loss: 54457.80078 PPL: 7.91867 bleu: 18.71813 LR: 0.00030000 * Steps: 10000 Loss: 52996.16406 PPL: 7.49087 bleu: 19.07842 LR: 0.00030000 * Steps: 11000 Loss: 51604.36719 PPL: 7.10502 bleu: 19.20304 LR: 0.00030000 * Steps: 12000 Loss: 50352.13672 PPL: 6.77487 bleu: 20.38498 LR: 0.00030000 * Steps: 13000 Loss: 49454.42188 PPL: 6.54768 bleu: 20.43895 LR: 0.00030000 * Steps: 14000 Loss: 48591.03906 PPL: 6.33636 bleu: 21.71949 LR: 0.00030000 * Steps: 15000 Loss: 47677.19141 PPL: 6.12012 bleu: 21.90593 LR: 0.00030000 * Steps: 16000 Loss: 47033.92969 PPL: 5.97234 bleu: 22.61263 LR: 0.00030000 * Steps: 17000 Loss: 46466.60547 PPL: 5.84498 bleu: 22.53257 LR: 0.00030000 * Steps: 18000 Loss: 45689.82031 PPL: 5.67498 bleu: 23.11039 LR: 0.00030000 * Steps: 19000 Loss: 45089.90625 PPL: 5.54708 bleu: 23.38194 LR: 0.00030000 * Steps: 20000 Loss: 44844.77734 PPL: 5.49566 bleu: 24.04572 LR: 0.00030000 * Steps: 21000 Loss: 44017.16797 PPL: 5.32553 bleu: 24.43880 LR: 0.00030000 * Steps: 22000 Loss: 43584.07812 PPL: 5.23861 bleu: 24.45597 LR: 0.00030000 * Steps: 23000 Loss: 43314.88672 PPL: 5.18530 bleu: 24.65415 LR: 0.00030000 * Steps: 24000 Loss: 42719.63672 PPL: 5.06934 bleu: 24.88043 LR: 0.00030000 * Steps: 25000 Loss: 42679.84375 PPL: 5.06168 bleu: 25.29832 LR: 0.00030000 * Steps: 26000 Loss: 42187.60938 PPL: 4.96789 bleu: 25.20145 LR: 0.00030000 * Steps: 27000 Loss: 41824.11328 PPL: 4.89974 bleu: 26.03683 LR: 0.00030000 * Steps: 28000 Loss: 41468.59375 PPL: 4.83400 bleu: 26.05520 LR: 0.00030000 * Steps: 29000 Loss: 41204.90625 PPL: 4.78581 bleu: 25.88880 LR: 0.00030000 * Steps: 30000 Loss: 41016.20703 PPL: 4.75162 bleu: 26.14282 LR: 0.00030000 * Steps: 31000 Loss: 40608.95703 PPL: 4.67866 bleu: 26.55928 LR: 0.00030000 * Steps: 32000 Loss: 40509.76953 PPL: 4.66106 bleu: 26.67988 LR: 0.00030000 * Steps: 33000 Loss: 40239.44922 PPL: 4.61343 bleu: 26.84404 LR: 0.00030000 * Steps: 34000 Loss: 40025.32812 PPL: 4.57604 bleu: 26.87073 LR: 0.00030000 * Steps: 35000 Loss: 39749.69141 PPL: 4.52837 bleu: 26.45645 LR: 0.00030000 * Steps: 36000 Loss: 39582.90234 PPL: 4.49976 bleu: 27.14048 LR: 0.00030000 * Steps: 37000 Loss: 39517.82422 PPL: 4.48865 bleu: 27.31787 LR: 0.00030000 * Steps: 38000 Loss: 39297.59766 PPL: 4.45124 bleu: 27.43823 LR: 0.00030000 * Steps: 39000 Loss: 39099.30078 PPL: 4.41783 bleu: 27.54830 LR: 0.00030000 * Steps: 40000 Loss: 38847.82812 PPL: 4.37582 bleu: 27.68253 LR: 0.00030000 * Steps: 41000 Loss: 38879.46094 PPL: 4.38108 bleu: 27.68924 LR: 0.00030000 Steps: 42000 Loss: 38647.40625 PPL: 4.34262 bleu: 28.17924 LR: 0.00030000 * Steps: 43000 Loss: 38276.96484 PPL: 4.28192 bleu: 28.29594 LR: 0.00030000 * Steps: 44000 Loss: 38070.88281 PPL: 4.24853 bleu: 28.30240 LR: 0.00030000 * Steps: 45000 Loss: 38274.80469 PPL: 4.28157 bleu: 27.95180 LR: 0.00030000 Steps: 46000 Loss: 37995.72266 PPL: 4.23641 bleu: 28.24181 LR: 0.00030000 * Steps: 47000 Loss: 37869.91016 PPL: 4.21621 bleu: 28.38744 LR: 0.00030000 * Steps: 48000 Loss: 37475.66797 PPL: 4.15352 bleu: 28.37237 LR: 0.00030000 * Steps: 49000 Loss: 37545.52734 PPL: 4.16456 bleu: 28.47124 LR: 0.00030000 Steps: 50000 Loss: 37262.00781 PPL: 4.11994 bleu: 29.04737 LR: 0.00030000 * Steps: 51000 Loss: 37392.51953 PPL: 4.14042 bleu: 28.47380 LR: 0.00030000 Steps: 52000 Loss: 37086.64062 PPL: 4.09257 bleu: 28.80841 LR: 0.00030000 * Steps: 53000 Loss: 37045.52734 PPL: 4.08618 bleu: 28.96906 LR: 0.00030000 * Steps: 54000 Loss: 37022.62500 PPL: 4.08263 bleu: 28.97203 LR: 0.00030000 * Steps: 55000 Loss: 36755.39453 PPL: 4.04139 bleu: 29.39079 LR: 0.00030000 * Steps: 56000 Loss: 36576.10156 PPL: 4.01395 bleu: 29.45850 LR: 0.00030000 * Steps: 57000 Loss: 36669.27734 PPL: 4.02818 bleu: 29.16113 LR: 0.00030000 Steps: 58000 Loss: 36586.67969 PPL: 4.01556 bleu: 29.55223 LR: 0.00030000 Steps: 59000 Loss: 36472.73828 PPL: 3.99821 bleu: 29.08540 LR: 0.00030000 * Steps: 60000 Loss: 36312.05469 PPL: 3.97388 bleu: 29.55714 LR: 0.00030000 * Steps: 61000 Loss: 36405.46484 PPL: 3.98801 bleu: 29.42361 LR: 0.00030000 Steps: 62000 Loss: 36182.63672 PPL: 3.95438 bleu: 30.02000 LR: 0.00030000 * Steps: 63000 Loss: 36137.33984 PPL: 3.94758 bleu: 29.62116 LR: 0.00030000 * Steps: 64000 Loss: 36105.62109 PPL: 3.94283 bleu: 29.85833 LR: 0.00030000 * Steps: 65000 Loss: 35999.64062 PPL: 3.92698 bleu: 29.59327 LR: 0.00030000 * Steps: 66000 Loss: 35726.74609 PPL: 3.88647 bleu: 29.87549 LR: 0.00030000 * Steps: 67000 Loss: 35741.32422 PPL: 3.88863 bleu: 30.01595 LR: 0.00030000 Steps: 68000 Loss: 35686.67969 PPL: 3.88056 bleu: 30.35649 LR: 0.00030000 * Steps: 69000 Loss: 35710.10156 PPL: 3.88402 bleu: 30.05167 LR: 0.00030000 Steps: 70000 Loss: 35463.79297 PPL: 3.84784 bleu: 30.24805 LR: 0.00030000 * Steps: 71000 Loss: 35473.36328 PPL: 3.84924 bleu: 29.90266 LR: 0.00030000 Steps: 72000 Loss: 35397.48828 PPL: 3.83815 bleu: 29.88424 LR: 0.00030000 * Steps: 73000 Loss: 35230.08203 PPL: 3.81382 bleu: 30.16289 LR: 0.00030000 * Steps: 74000 Loss: 35263.62891 PPL: 3.81868 bleu: 30.48071 LR: 0.00030000 Steps: 75000 Loss: 35229.18750 PPL: 3.81369 bleu: 30.43892 LR: 0.00030000 * Steps: 76000 Loss: 35177.29297 PPL: 3.80618 bleu: 30.03361 LR: 0.00030000 * Steps: 77000 Loss: 35051.81641 PPL: 3.78807 bleu: 30.28445 LR: 0.00030000 * Steps: 78000 Loss: 34947.87891 PPL: 3.77314 bleu: 30.42704 LR: 0.00030000 * Steps: 79000 Loss: 35128.52734 PPL: 3.79913 bleu: 30.25947 LR: 0.00030000 Steps: 80000 Loss: 34997.02344 PPL: 3.78019 bleu: 30.47747 LR: 0.00030000 Steps: 81000 Loss: 34880.70703 PPL: 3.76352 bleu: 30.19161 LR: 0.00030000 * Steps: 82000 Loss: 34784.55469 PPL: 3.74980 bleu: 30.22135 LR: 0.00030000 * Steps: 83000 Loss: 34783.46484 PPL: 3.74964 bleu: 30.33980 LR: 0.00030000 * Steps: 84000 Loss: 34859.35547 PPL: 3.76047 bleu: 30.61563 LR: 0.00030000 Steps: 85000 Loss: 34702.01172 PPL: 3.73806 bleu: 30.54406 LR: 0.00030000 * Steps: 86000 Loss: 34571.55469 PPL: 3.71957 bleu: 30.43779 LR: 0.00030000 * Steps: 87000 Loss: 34516.69531 PPL: 3.71183 bleu: 30.67521 LR: 0.00030000 * Steps: 88000 Loss: 34461.06641 PPL: 3.70399 bleu: 30.88347 LR: 0.00030000 * Steps: 89000 Loss: 34346.12500 PPL: 3.68785 bleu: 31.30517 LR: 0.00030000 * Steps: 90000 Loss: 34400.59766 PPL: 3.69549 bleu: 30.66718 LR: 0.00030000 Steps: 91000 Loss: 34366.86328 PPL: 3.69076 bleu: 30.61125 LR: 0.00030000 Steps: 92000 Loss: 34390.93359 PPL: 3.69413 bleu: 30.51666 LR: 0.00030000 Steps: 93000 Loss: 34191.80078 PPL: 3.66629 bleu: 30.49210 LR: 0.00030000 * Steps: 94000 Loss: 34093.54688 PPL: 3.65262 bleu: 30.98921 LR: 0.00030000 * Steps: 95000 Loss: 34346.17578 PPL: 3.68785 bleu: 30.57657 LR: 0.00030000 Steps: 96000 Loss: 33984.32812 PPL: 3.63750 bleu: 30.73922 LR: 0.00030000 * Steps: 97000 Loss: 33945.04688 PPL: 3.63207 bleu: 30.53422 LR: 0.00030000 * Steps: 98000 Loss: 34108.48047 PPL: 3.65470 bleu: 30.41809 LR: 0.00030000 Steps: 99000 Loss: 33905.70312 PPL: 3.62665 bleu: 30.98853 LR: 0.00030000 * Steps: 100000 Loss: 33827.56250 PPL: 3.61590 bleu: 31.11354 LR: 0.00030000 * Steps: 101000 Loss: 33818.79688 PPL: 3.61469 bleu: 30.98484 LR: 0.00030000 * Steps: 102000 Loss: 33690.30859 PPL: 3.59709 bleu: 31.02905 LR: 0.00030000 * Steps: 103000 Loss: 33733.51562 PPL: 3.60300 bleu: 30.84068 LR: 0.00030000 Steps: 104000 Loss: 33771.46484 PPL: 3.60820 bleu: 31.17957 LR: 0.00030000 Steps: 105000 Loss: 33717.67969 PPL: 3.60083 bleu: 31.22264 LR: 0.00030000 Steps: 106000 Loss: 33572.11328 PPL: 3.58097 bleu: 31.12246 LR: 0.00030000 * Steps: 107000 Loss: 33518.23828 PPL: 3.57365 bleu: 30.76655 LR: 0.00030000 * Steps: 108000 Loss: 33529.24219 PPL: 3.57514 bleu: 30.41456 LR: 0.00030000 Steps: 109000 Loss: 33524.25781 PPL: 3.57446 bleu: 30.97445 LR: 0.00030000 Steps: 110000 Loss: 33568.29688 PPL: 3.58045 bleu: 31.27724 LR: 0.00030000 Steps: 111000 Loss: 33386.31641 PPL: 3.55578 bleu: 31.07954 LR: 0.00030000 * Steps: 112000 Loss: 33407.89844 PPL: 3.55869 bleu: 31.40365 LR: 0.00030000 Steps: 113000 Loss: 33410.83984 PPL: 3.55909 bleu: 30.86494 LR: 0.00030000 Steps: 114000 Loss: 33256.14844 PPL: 3.53823 bleu: 31.03824 LR: 0.00030000 * Steps: 115000 Loss: 33299.70312 PPL: 3.54409 bleu: 31.25064 LR: 0.00030000 Steps: 116000 Loss: 33405.30078 PPL: 3.55834 bleu: 31.45736 LR: 0.00030000 Steps: 117000 Loss: 33326.59375 PPL: 3.54772 bleu: 30.89787 LR: 0.00030000 Steps: 118000 Loss: 33079.33594 PPL: 3.51454 bleu: 31.66253 LR: 0.00030000 * Steps: 119000 Loss: 32991.24219 PPL: 3.50280 bleu: 31.53065 LR: 0.00030000 * Steps: 120000 Loss: 33046.24219 PPL: 3.51013 bleu: 31.10928 LR: 0.00030000 Steps: 121000 Loss: 33072.25000 PPL: 3.51360 bleu: 31.57333 LR: 0.00030000 Steps: 122000 Loss: 33126.78125 PPL: 3.52088 bleu: 31.29760 LR: 0.00030000 Steps: 123000 Loss: 32983.21094 PPL: 3.50173 bleu: 31.66696 LR: 0.00030000 * Steps: 124000 Loss: 33080.36328 PPL: 3.51468 bleu: 31.43619 LR: 0.00030000 Steps: 125000 Loss: 32920.58594 PPL: 3.49341 bleu: 31.49514 LR: 0.00030000 * Steps: 126000 Loss: 33020.04688 PPL: 3.50663 bleu: 31.63576 LR: 0.00030000 Steps: 127000 Loss: 32856.67188 PPL: 3.48493 bleu: 31.46821 LR: 0.00030000 * Steps: 128000 Loss: 32781.53125 PPL: 3.47500 bleu: 31.20838 LR: 0.00030000 * Steps: 129000 Loss: 32951.09375 PPL: 3.49746 bleu: 31.48965 LR: 0.00030000 Steps: 130000 Loss: 32886.66406 PPL: 3.48891 bleu: 31.35809 LR: 0.00030000 Steps: 131000 Loss: 32890.52734 PPL: 3.48942 bleu: 31.73268 LR: 0.00030000 Steps: 132000 Loss: 32772.80078 PPL: 3.47384 bleu: 31.86151 LR: 0.00030000 * Steps: 133000 Loss: 32855.81250 PPL: 3.48482 bleu: 31.37413 LR: 0.00030000 Steps: 134000 Loss: 32762.84766 PPL: 3.47253 bleu: 31.86319 LR: 0.00030000 * Steps: 135000 Loss: 32709.50000 PPL: 3.46550 bleu: 31.63933 LR: 0.00030000 * Steps: 136000 Loss: 32723.34375 PPL: 3.46732 bleu: 32.07189 LR: 0.00030000 Steps: 137000 Loss: 32601.82227 PPL: 3.45135 bleu: 31.60738 LR: 0.00030000 * Steps: 138000 Loss: 32599.85742 PPL: 3.45109 bleu: 32.18206 LR: 0.00030000 * Steps: 139000 Loss: 32645.00195 PPL: 3.45702 bleu: 31.39706 LR: 0.00030000 Steps: 140000 Loss: 32664.53320 PPL: 3.45958 bleu: 31.49268 LR: 0.00030000 Steps: 141000 Loss: 32502.66406 PPL: 3.43837 bleu: 31.46003 LR: 0.00030000 * Steps: 142000 Loss: 32540.71094 PPL: 3.44334 bleu: 31.70974 LR: 0.00030000 Steps: 143000 Loss: 32388.56055 PPL: 3.42349 bleu: 31.66381 LR: 0.00030000 * Steps: 144000 Loss: 32382.94531 PPL: 3.42276 bleu: 31.73107 LR: 0.00030000 * Steps: 145000 Loss: 32361.57227 PPL: 3.41999 bleu: 31.78980 LR: 0.00030000 * Steps: 146000 Loss: 32512.67578 PPL: 3.43968 bleu: 31.56925 LR: 0.00030000 Steps: 147000 Loss: 32401.49023 PPL: 3.42518 bleu: 32.34126 LR: 0.00030000 Steps: 148000 Loss: 32242.35156 PPL: 3.40453 bleu: 32.13088 LR: 0.00030000 * Steps: 149000 Loss: 32367.37695 PPL: 3.42074 bleu: 31.79343 LR: 0.00030000 Steps: 150000 Loss: 32337.34180 PPL: 3.41684 bleu: 31.65206 LR: 0.00030000 Steps: 151000 Loss: 32426.80078 PPL: 3.42847 bleu: 31.93923 LR: 0.00030000 Steps: 152000 Loss: 32209.64648 PPL: 3.40030 bleu: 31.92305 LR: 0.00030000 * Steps: 153000 Loss: 32303.37500 PPL: 3.41243 bleu: 31.88268 LR: 0.00030000 Steps: 154000 Loss: 32305.85938 PPL: 3.41275 bleu: 31.96695 LR: 0.00030000 Steps: 155000 Loss: 32143.62109 PPL: 3.39178 bleu: 31.59042 LR: 0.00030000 * Steps: 156000 Loss: 32195.13086 PPL: 3.39843 bleu: 31.97927 LR: 0.00030000 Steps: 157000 Loss: 32223.27734 PPL: 3.40206 bleu: 31.95538 LR: 0.00030000 Steps: 158000 Loss: 32048.46875 PPL: 3.37954 bleu: 32.11889 LR: 0.00030000 * Steps: 159000 Loss: 32142.28125 PPL: 3.39161 bleu: 32.20169 LR: 0.00030000 Steps: 160000 Loss: 32221.57031 PPL: 3.40184 bleu: 31.85228 LR: 0.00030000 Steps: 161000 Loss: 32105.10547 PPL: 3.38682 bleu: 31.89760 LR: 0.00030000 Steps: 162000 Loss: 32077.90430 PPL: 3.38332 bleu: 31.95942 LR: 0.00030000 Steps: 163000 Loss: 32063.21680 PPL: 3.38143 bleu: 32.25314 LR: 0.00030000 Steps: 164000 Loss: 32044.81250 PPL: 3.37907 bleu: 31.87277 LR: 0.00030000 * Steps: 165000 Loss: 32011.27539 PPL: 3.37477 bleu: 31.85913 LR: 0.00030000 * Steps: 166000 Loss: 31968.13086 PPL: 3.36924 bleu: 32.12024 LR: 0.00030000 * Steps: 167000 Loss: 31894.38867 PPL: 3.35981 bleu: 32.36714 LR: 0.00030000 * Steps: 168000 Loss: 31896.24805 PPL: 3.36005 bleu: 32.05152 LR: 0.00030000 Steps: 169000 Loss: 32019.65039 PPL: 3.37584 bleu: 31.97728 LR: 0.00030000 Steps: 170000 Loss: 31996.90234 PPL: 3.37292 bleu: 31.89701 LR: 0.00030000 Steps: 171000 Loss: 31885.30273 PPL: 3.35865 bleu: 32.18194 LR: 0.00030000 * Steps: 172000 Loss: 31862.72461 PPL: 3.35577 bleu: 32.80236 LR: 0.00030000 * Steps: 173000 Loss: 31766.87500 PPL: 3.34357 bleu: 32.30026 LR: 0.00030000 * Steps: 174000 Loss: 31762.73047 PPL: 3.34305 bleu: 32.46215 LR: 0.00030000 * Steps: 175000 Loss: 31763.25195 PPL: 3.34311 bleu: 32.04518 LR: 0.00030000 Steps: 176000 Loss: 31768.62891 PPL: 3.34380 bleu: 32.33361 LR: 0.00030000 Steps: 177000 Loss: 31812.34766 PPL: 3.34935 bleu: 32.24424 LR: 0.00030000 Steps: 178000 Loss: 31722.37695 PPL: 3.33792 bleu: 32.03003 LR: 0.00030000 * Steps: 179000 Loss: 31798.01953 PPL: 3.34753 bleu: 32.86679 LR: 0.00030000 Steps: 180000 Loss: 31784.23242 PPL: 3.34578 bleu: 32.38772 LR: 0.00030000