{ "nbformat": 4, "nbformat_minor": 0, "metadata": { "accelerator": "GPU", "colab": { "name": "starter_notebook.ipynb", "provenance": [], "collapsed_sections": [], "toc_visible": true, "include_colab_link": true }, "kernelspec": { "display_name": "Python 3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.5.6" } }, "cells": [ { "cell_type": "markdown", "metadata": { "id": "view-in-github", "colab_type": "text" }, "source": [ "\"Open" ] }, { "cell_type": "markdown", "metadata": { "colab_type": "text", "id": "Igc5itf-xMGj" }, "source": [ "# Masakhane - Machine Translation for African Languages (Using JoeyNMT)" ] }, { "cell_type": "markdown", "metadata": { "colab_type": "text", "id": "x4fXCKCf36IK" }, "source": [ "## Note before beginning:\n", "### - The idea is that you should be able to make minimal changes to this in order to get SOME result for your own translation corpus. \n", "\n", "### - The tl;dr: Go to the **\"TODO\"** comments which will tell you what to update to get up and running\n", "\n", "### - If you actually want to have a clue what you're doing, read the text and peek at the links\n", "\n", "### - With 100 epochs, it should take around 7 hours to run in Google Colab\n", "\n", "### - Once you've gotten a result for your language, please attach and email your notebook that generated it to masakhanetranslation@gmail.com\n", "\n", "### - If you care enough and get a chance, doing a brief background on your language would be amazing. See examples in [(Martinus, 2019)](https://arxiv.org/abs/1906.05685)" ] }, { "cell_type": "markdown", "metadata": { "colab_type": "text", "id": "l929HimrxS0a" }, "source": [ "## Retrieve your data & make a parallel corpus\n", "\n", "If you are wanting to use the JW300 data referenced on the Masakhane website or in our GitHub repo, you can use `opus-tools` to convert the data into a convenient format. `opus_read` from that package provides a convenient tool for reading the native aligned XML files and to convert them to TMX format. The tool can also be used to fetch relevant files from OPUS on the fly and to filter the data as necessary. [Read the documentation](https://pypi.org/project/opustools-pkg/) for more details.\n", "\n", "Once you have your corpus files in TMX format (an xml structure which will include the sentences in your target language and your source language in a single file), we recommend reading them into a pandas dataframe. Thankfully, Jade wrote a silly `tmx2dataframe` package which converts your tmx file to a pandas dataframe. " ] }, { "cell_type": "code", "metadata": { "colab_type": "code", "id": "oGRmDELn7Az0", "outputId": "1f7f8bd7-dbf5-46a3-f27a-68921359895b", "colab": { "base_uri": "https://localhost:8080/", "height": 122 } }, "source": [ "from google.colab import drive\n", "drive.mount('/content/drive')" ], "execution_count": 1, "outputs": [ { "output_type": "stream", "text": [ "Go to this URL in a browser: https://accounts.google.com/o/oauth2/auth?client_id=947318989803-6bn6qk8qdgf4n4g3pfee6491hc0brc4i.apps.googleusercontent.com&redirect_uri=urn%3aietf%3awg%3aoauth%3a2.0%3aoob&response_type=code&scope=email%20https%3a%2f%2fwww.googleapis.com%2fauth%2fdocs.test%20https%3a%2f%2fwww.googleapis.com%2fauth%2fdrive%20https%3a%2f%2fwww.googleapis.com%2fauth%2fdrive.photos.readonly%20https%3a%2f%2fwww.googleapis.com%2fauth%2fpeopleapi.readonly\n", "\n", "Enter your authorization code:\n", "··········\n", "Mounted at /content/drive\n" ], "name": "stdout" } ] }, { "cell_type": "code", "metadata": { "colab_type": "code", "id": "Cn3tgQLzUxwn", "colab": {} }, "source": [ "# TODO: Set your source and target languages. Keep in mind, these traditionally use language codes as found here:\n", "# These will also become the suffix's of all vocab and corpus files used throughout\n", "import os\n", "source_language = \"en\"\n", "target_language = \"iso\" \n", "lc = False # If True, lowercase the data.\n", "seed = 42 # Random seed for shuffling.\n", "tag = \"baseline\" # Give a unique name to your folder - this is to ensure you don't rewrite any models you've already submitted\n", "\n", "os.environ[\"src\"] = source_language # Sets them in bash as well, since we often use bash scripts\n", "os.environ[\"tgt\"] = target_language\n", "os.environ[\"tag\"] = tag\n", "\n", "# This will save it to a folder in our gdrive instead!\n", "!mkdir -p \"/content/drive/My Drive/masakhane/$src-$tgt-$tag\"\n", "os.environ[\"gdrive_path\"] = \"/content/drive/My Drive/masakhane/%s-%s-%s\" % (source_language, target_language, tag)" ], "execution_count": 0, "outputs": [] }, { "cell_type": "code", "metadata": { "colab_type": "code", "id": "kBSgJHEw7Nvx", "outputId": "f64ceb65-f836-4639-b934-eb63a9791b92", "colab": { "base_uri": "https://localhost:8080/", "height": 34 } }, "source": [ "!echo $gdrive_path" ], "execution_count": 3, "outputs": [ { "output_type": "stream", "text": [ "/content/drive/My Drive/masakhane/en-iso-baseline\n" ], "name": "stdout" } ] }, { "cell_type": "code", "metadata": { "colab_type": "code", "id": "gA75Fs9ys8Y9", "outputId": "85f1a7de-5ab8-45b9-cdb0-9ae3199df91b", "colab": { "base_uri": "https://localhost:8080/", "height": 102 } }, "source": [ "# Install opus-tools\n", "! pip install opustools-pkg" ], "execution_count": 0, "outputs": [ { "output_type": "stream", "text": [ "Collecting opustools-pkg\n", "\u001b[?25l Downloading https://files.pythonhosted.org/packages/6c/9f/e829a0cceccc603450cd18e1ff80807b6237a88d9a8df2c0bb320796e900/opustools_pkg-0.0.52-py3-none-any.whl (80kB)\n", "\r\u001b[K |████ | 10kB 23.8MB/s eta 0:00:01\r\u001b[K |████████ | 20kB 1.7MB/s eta 0:00:01\r\u001b[K |████████████▏ | 30kB 2.5MB/s eta 0:00:01\r\u001b[K |████████████████▏ | 40kB 1.7MB/s eta 0:00:01\r\u001b[K |████████████████████▎ | 51kB 2.1MB/s eta 0:00:01\r\u001b[K |████████████████████████▎ | 61kB 2.5MB/s eta 0:00:01\r\u001b[K |████████████████████████████▎ | 71kB 2.9MB/s eta 0:00:01\r\u001b[K |████████████████████████████████| 81kB 2.5MB/s \n", "\u001b[?25hInstalling collected packages: opustools-pkg\n", "Successfully installed opustools-pkg-0.0.52\n" ], "name": "stdout" } ] }, { "cell_type": "code", "metadata": { "colab_type": "code", "id": "xq-tDZVks7ZD", "outputId": "9d17c9e1-b6a7-43f4-ee1e-3ea9a8559c27", "colab": { "base_uri": "https://localhost:8080/", "height": 204 } }, "source": [ "# Downloading our corpus\n", "! opus_read -d JW300 -s $src -t $tgt -wm moses -w jw300.$src jw300.$tgt -q\n", "\n", "# extract the corpus file\n", "! gunzip JW300_latest_xml_$src-$tgt.xml.gz" ], "execution_count": 0, "outputs": [ { "output_type": "stream", "text": [ "\n", "Alignment file /proj/nlpl/data/OPUS/JW300/latest/xml/en-iso.xml.gz not found. The following files are available for downloading:\n", "\n", " 2 MB https://object.pouta.csc.fi/OPUS-JW300/v1/xml/en-iso.xml.gz\n", " 263 MB https://object.pouta.csc.fi/OPUS-JW300/v1/xml/en.zip\n", " 26 MB https://object.pouta.csc.fi/OPUS-JW300/v1/xml/iso.zip\n", "\n", " 291 MB Total size\n", "./JW300_latest_xml_en-iso.xml.gz ... 100% of 2 MB\n", "./JW300_latest_xml_en.zip ... 100% of 263 MB\n", "./JW300_latest_xml_iso.zip ... 100% of 26 MB\n" ], "name": "stdout" } ] }, { "cell_type": "code", "metadata": { "id": "n48GDRnP8y2G", "colab_type": "code", "outputId": "8949fb1b-854c-4644-a03c-43fdb68dbc42", "colab": { "base_uri": "https://localhost:8080/", "height": 578 } }, "source": [ "# Download the global test set.\n", "! wget https://raw.githubusercontent.com/juliakreutzer/masakhane/master/jw300_utils/test/test.en-any.en\n", " \n", "# And the specific test set for this language pair.\n", "os.environ[\"trg\"] = target_language \n", "os.environ[\"src\"] = source_language \n", "\n", "! wget https://raw.githubusercontent.com/juliakreutzer/masakhane/master/jw300_utils/test/test.en-$trg.en \n", "! mv test.en-$trg.en test.en\n", "! wget https://raw.githubusercontent.com/juliakreutzer/masakhane/master/jw300_utils/test/test.en-$trg.$trg \n", "! mv test.en-$trg.$trg test.$trg" ], "execution_count": 0, "outputs": [ { "output_type": "stream", "text": [ "--2020-01-17 04:59:50-- https://raw.githubusercontent.com/juliakreutzer/masakhane/master/jw300_utils/test/test.en-any.en\n", "Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 151.101.0.133, 151.101.64.133, 151.101.128.133, ...\n", "Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|151.101.0.133|:443... connected.\n", "HTTP request sent, awaiting response... 200 OK\n", "Length: 277791 (271K) [text/plain]\n", "Saving to: ‘test.en-any.en’\n", "\n", "\rtest.en-any.en 0%[ ] 0 --.-KB/s \rtest.en-any.en 100%[===================>] 271.28K --.-KB/s in 0.05s \n", "\n", "2020-01-17 04:59:51 (5.15 MB/s) - ‘test.en-any.en’ saved [277791/277791]\n", "\n", "--2020-01-17 04:59:52-- https://raw.githubusercontent.com/juliakreutzer/masakhane/master/jw300_utils/test/test.en-iso.en\n", "Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 151.101.0.133, 151.101.64.133, 151.101.128.133, ...\n", "Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|151.101.0.133|:443... connected.\n", "HTTP request sent, awaiting response... 200 OK\n", "Length: 205488 (201K) [text/plain]\n", "Saving to: ‘test.en-iso.en’\n", "\n", "test.en-iso.en 100%[===================>] 200.67K --.-KB/s in 0.04s \n", "\n", "2020-01-17 04:59:52 (5.30 MB/s) - ‘test.en-iso.en’ saved [205488/205488]\n", "\n", "--2020-01-17 04:59:54-- https://raw.githubusercontent.com/juliakreutzer/masakhane/master/jw300_utils/test/test.en-iso.iso\n", "Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 151.101.0.133, 151.101.64.133, 151.101.128.133, ...\n", "Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|151.101.0.133|:443... connected.\n", "HTTP request sent, awaiting response... 200 OK\n", "Length: 251918 (246K) [text/plain]\n", "Saving to: ‘test.en-iso.iso’\n", "\n", "test.en-iso.iso 100%[===================>] 246.01K --.-KB/s in 0.05s \n", "\n", "2020-01-17 04:59:55 (4.68 MB/s) - ‘test.en-iso.iso’ saved [251918/251918]\n", "\n" ], "name": "stdout" } ] }, { "cell_type": "code", "metadata": { "id": "NqDG-CI28y2L", "colab_type": "code", "outputId": "44ef9271-b0fc-418d-dc5f-04c90e4e38cd", "colab": { "base_uri": "https://localhost:8080/", "height": 34 } }, "source": [ "# Read the test data to filter from train and dev splits.\n", "# Store english portion in set for quick filtering checks.\n", "en_test_sents = set()\n", "filter_test_sents = \"test.en-any.en\"\n", "j = 0\n", "with open(filter_test_sents) as f:\n", " for line in f:\n", " en_test_sents.add(line.strip())\n", " j += 1\n", "print('Loaded {} global test sentences to filter from the training/dev data.'.format(j))" ], "execution_count": 0, "outputs": [ { "output_type": "stream", "text": [ "Loaded 3571 global test sentences to filter from the training/dev data.\n" ], "name": "stdout" } ] }, { "cell_type": "code", "metadata": { "colab_type": "code", "id": "3CNdwLBCfSIl", "outputId": "fcf09810-26de-481b-8ba0-39853c4378b0", "colab": { "base_uri": "https://localhost:8080/", "height": 159 } }, "source": [ "import pandas as pd\n", "\n", "# TMX file to dataframe\n", "source_file = 'jw300.' + source_language\n", "target_file = 'jw300.' + target_language\n", "\n", "source = []\n", "target = []\n", "skip_lines = [] # Collect the line numbers of the source portion to skip the same lines for the target portion.\n", "with open(source_file) as f:\n", " for i, line in enumerate(f):\n", " # Skip sentences that are contained in the test set.\n", " if line.strip() not in en_test_sents:\n", " source.append(line.strip())\n", " else:\n", " skip_lines.append(i) \n", "with open(target_file) as f:\n", " for j, line in enumerate(f):\n", " # Only add to corpus if corresponding source was not skipped.\n", " if j not in skip_lines:\n", " target.append(line.strip())\n", " \n", "print('Loaded data and skipped {}/{} lines since contained in test set.'.format(len(skip_lines), i))\n", " \n", "df = pd.DataFrame(zip(source, target), columns=['source_sentence', 'target_sentence'])\n", "# if you get TypeError: data argument can't be an iterator is because of your zip version run this below\n", "#df = pd.DataFrame(list(zip(source, target)), columns=['source_sentence', 'target_sentence'])\n", "df.head(3)" ], "execution_count": 0, "outputs": [ { "output_type": "stream", "text": [ "Loaded data and skipped 5685/243487 lines since contained in test set.\n" ], "name": "stdout" }, { "output_type": "execute_result", "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
source_sentencetarget_sentence
0“ Only One of the Many Lives That You Touched ”“ Omọvo Ahwo Buobu nọ Who Duobọ te Uzuazọ Riẹ ”
1BACK in January 1996 , Carol was sick with a b...EVAỌ January 1996 , Carol ọ jẹ mọ ẹyao ẹvori .
2She was in her 60 ’ s and until then had alway...Ọ kpako te ikpe 60 no yọ oke yena kpobi ọ jọ a...
\n", "
" ], "text/plain": [ " source_sentence target_sentence\n", "0 “ Only One of the Many Lives That You Touched ” “ Omọvo Ahwo Buobu nọ Who Duobọ te Uzuazọ Riẹ ”\n", "1 BACK in January 1996 , Carol was sick with a b... EVAỌ January 1996 , Carol ọ jẹ mọ ẹyao ẹvori .\n", "2 She was in her 60 ’ s and until then had alway... Ọ kpako te ikpe 60 no yọ oke yena kpobi ọ jọ a..." ] }, "metadata": { "tags": [] }, "execution_count": 11 } ] }, { "cell_type": "markdown", "metadata": { "colab_type": "text", "id": "YkuK3B4p2AkN" }, "source": [ "## Pre-processing and export\n", "\n", "It is generally a good idea to remove duplicate translations and conflicting translations from the corpus. In practice, these public corpora include some number of these that need to be cleaned.\n", "\n", "In addition we will split our data into dev/test/train and export to the filesystem." ] }, { "cell_type": "code", "metadata": { "colab_type": "code", "id": "M_2ouEOH1_1q", "outputId": "b109ef42-7557-4c8c-8952-874ac33ed667", "colab": { "base_uri": "https://localhost:8080/", "height": 187 } }, "source": [ "# drop duplicate translations\n", "df_pp = df.drop_duplicates()\n", "\n", "# drop conflicting translations\n", "# (this is optional and something that you might want to comment out \n", "# depending on the size of your corpus)\n", "df_pp.drop_duplicates(subset='source_sentence', inplace=True)\n", "df_pp.drop_duplicates(subset='target_sentence', inplace=True)\n", "\n", "# Shuffle the data to remove bias in dev set selection.\n", "df_pp = df_pp.sample(frac=1, random_state=seed).reset_index(drop=True)" ], "execution_count": 0, "outputs": [ { "output_type": "stream", "text": [ "/usr/local/lib/python3.6/dist-packages/ipykernel_launcher.py:6: SettingWithCopyWarning: \n", "A value is trying to be set on a copy of a slice from a DataFrame\n", "\n", "See the caveats in the documentation: http://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy\n", " \n", "/usr/local/lib/python3.6/dist-packages/ipykernel_launcher.py:7: SettingWithCopyWarning: \n", "A value is trying to be set on a copy of a slice from a DataFrame\n", "\n", "See the caveats in the documentation: http://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy\n", " import sys\n" ], "name": "stderr" } ] }, { "cell_type": "code", "metadata": { "id": "Z_1BwAApEtMk", "colab_type": "code", "outputId": "175b8c38-2c43-47f7-bccc-0cffe0336959", "colab": { "base_uri": "https://localhost:8080/", "height": 1000 } }, "source": [ "# Install fuzzy wuzzy to remove \"almost duplicate\" sentences in the\n", "# test and training sets.\n", "! pip install fuzzywuzzy\n", "! pip install python-Levenshtein\n", "import time\n", "from fuzzywuzzy import process\n", "import numpy as np\n", "\n", "# reset the index of the training set after previous filtering\n", "df_pp.reset_index(drop=False, inplace=True)\n", "\n", "# Remove samples from the training data set if they \"almost overlap\" with the\n", "# samples in the test set.\n", "\n", "# Filtering function. Adjust pad to narrow down the candidate matches to\n", "# within a certain length of characters of the given sample.\n", "def fuzzfilter(sample, candidates, pad):\n", " candidates = [x for x in candidates if len(x) <= len(sample)+pad and len(x) >= len(sample)-pad] \n", " if len(candidates) > 0:\n", " return process.extractOne(sample, candidates)[1]\n", " else:\n", " return np.nan\n", "\n", "# NOTE - This might run slow depending on the size of your training set. We are\n", "# printing some information to help you track how long it would take. \n", "scores = []\n", "start_time = time.time()\n", "for idx, row in df_pp.iterrows():\n", " scores.append(fuzzfilter(row['source_sentence'], list(en_test_sents), 5))\n", " if idx % 1000 == 0:\n", " hours, rem = divmod(time.time() - start_time, 3600)\n", " minutes, seconds = divmod(rem, 60)\n", " print(\"{:0>2}:{:0>2}:{:05.2f}\".format(int(hours),int(minutes),seconds), \"%0.2f percent complete\" % (100.0*float(idx)/float(len(df_pp))))\n", "\n", "# Filter out \"almost overlapping samples\"\n", "df_pp['scores'] = scores\n", "df_pp = df_pp[df_pp['scores'] < 95]" ], "execution_count": 0, "outputs": [ { "output_type": "stream", "text": [ "Collecting fuzzywuzzy\n", " Downloading https://files.pythonhosted.org/packages/d8/f1/5a267addb30ab7eaa1beab2b9323073815da4551076554ecc890a3595ec9/fuzzywuzzy-0.17.0-py2.py3-none-any.whl\n", "Installing collected packages: fuzzywuzzy\n", "Successfully installed fuzzywuzzy-0.17.0\n", "Collecting python-Levenshtein\n", "\u001b[?25l Downloading https://files.pythonhosted.org/packages/42/a9/d1785c85ebf9b7dfacd08938dd028209c34a0ea3b1bcdb895208bd40a67d/python-Levenshtein-0.12.0.tar.gz (48kB)\n", "\u001b[K |████████████████████████████████| 51kB 1.7MB/s \n", "\u001b[?25hRequirement already satisfied: setuptools in /usr/local/lib/python3.6/dist-packages (from python-Levenshtein) (42.0.2)\n", "Building wheels for collected packages: python-Levenshtein\n", " Building wheel for python-Levenshtein (setup.py) ... \u001b[?25l\u001b[?25hdone\n", " Created wheel for python-Levenshtein: filename=python_Levenshtein-0.12.0-cp36-cp36m-linux_x86_64.whl size=144672 sha256=27cc679925e9ea7d499147fe08f2564ad8e4295a570a1a075b46139a669d35bc\n", " Stored in directory: /root/.cache/pip/wheels/de/c2/93/660fd5f7559049268ad2dc6d81c4e39e9e36518766eaf7e342\n", "Successfully built python-Levenshtein\n", "Installing collected packages: python-Levenshtein\n", "Successfully installed python-Levenshtein-0.12.0\n", "00:00:00.10 0.00 percent complete\n", "00:00:23.78 0.46 percent complete\n" ], "name": "stdout" }, { "output_type": "stream", "text": [ "WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '']\n" ], "name": "stderr" }, { "output_type": "stream", "text": [ "00:00:47.40 0.92 percent complete\n", "00:01:10.57 1.39 percent complete\n" ], "name": "stdout" }, { "output_type": "stream", "text": [ "WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '*']\n" ], "name": "stderr" }, { "output_type": "stream", "text": [ "00:01:33.67 1.85 percent complete\n", "00:01:56.94 2.31 percent complete\n", "00:02:20.72 2.77 percent complete\n", "00:02:43.97 3.23 percent complete\n", "00:03:07.38 3.70 percent complete\n", "00:03:31.62 4.16 percent complete\n", "00:03:56.02 4.62 percent complete\n", "00:04:19.06 5.08 percent complete\n", "00:04:42.39 5.54 percent complete\n", "00:05:06.25 6.00 percent complete\n", "00:05:30.46 6.47 percent complete\n", "00:05:53.63 6.93 percent complete\n", "00:06:17.23 7.39 percent complete\n", "00:06:41.67 7.85 percent complete\n", "00:07:05.22 8.31 percent complete\n", "00:07:29.08 8.78 percent complete\n", "00:07:52.78 9.24 percent complete\n", "00:08:16.19 9.70 percent complete\n", "00:08:39.44 10.16 percent complete\n", "00:09:03.31 10.62 percent complete\n", "00:09:26.40 11.09 percent complete\n", "00:09:51.25 11.55 percent complete\n", "00:10:15.14 12.01 percent complete\n", "00:10:38.52 12.47 percent complete\n", "00:11:02.41 12.93 percent complete\n", "00:11:26.41 13.40 percent complete\n", "00:11:50.05 13.86 percent complete\n", "00:12:13.38 14.32 percent complete\n" ], "name": "stdout" }, { "output_type": "stream", "text": [ "WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '․ ․ ․ ․ ․']\n" ], "name": "stderr" }, { "output_type": "stream", "text": [ "00:12:37.46 14.78 percent complete\n", "00:13:01.81 15.24 percent complete\n", "00:13:25.69 15.70 percent complete\n", "00:13:49.63 16.17 percent complete\n", "00:14:13.48 16.63 percent complete\n", "00:14:37.29 17.09 percent complete\n", "00:15:01.50 17.55 percent complete\n", "00:15:25.57 18.01 percent complete\n", "00:15:49.18 18.48 percent complete\n", "00:16:13.51 18.94 percent complete\n", "00:16:37.01 19.40 percent complete\n", "00:17:00.10 19.86 percent complete\n", "00:17:23.41 20.32 percent complete\n", "00:17:47.00 20.79 percent complete\n", "00:18:10.96 21.25 percent complete\n", "00:18:34.67 21.71 percent complete\n", "00:18:59.32 22.17 percent complete\n", "00:19:23.61 22.63 percent complete\n", "00:19:47.81 23.10 percent complete\n", "00:20:12.35 23.56 percent complete\n", "00:20:36.05 24.02 percent complete\n", "00:20:59.50 24.48 percent complete\n", "00:21:23.22 24.94 percent complete\n", "00:21:47.62 25.40 percent complete\n", "00:22:11.51 25.87 percent complete\n", "00:22:35.28 26.33 percent complete\n", "00:22:58.71 26.79 percent complete\n", "00:23:22.48 27.25 percent complete\n", "00:23:46.81 27.71 percent complete\n" ], "name": "stdout" }, { "output_type": "stream", "text": [ "WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '․ ․ ․ ․ ․ ․ ․ ․']\n" ], "name": "stderr" }, { "output_type": "stream", "text": [ "00:24:10.94 28.18 percent complete\n", "00:24:34.16 28.64 percent complete\n", "00:24:58.34 29.10 percent complete\n", "00:25:22.14 29.56 percent complete\n", "00:25:46.52 30.02 percent complete\n", "00:26:09.90 30.49 percent complete\n", "00:26:34.10 30.95 percent complete\n", "00:26:58.06 31.41 percent complete\n", "00:27:21.26 31.87 percent complete\n", "00:27:45.50 32.33 percent complete\n", "00:28:09.00 32.79 percent complete\n", "00:28:32.87 33.26 percent complete\n", "00:28:57.11 33.72 percent complete\n", "00:29:21.37 34.18 percent complete\n", "00:29:45.41 34.64 percent complete\n", "00:30:08.93 35.10 percent complete\n", "00:30:32.97 35.57 percent complete\n", "00:30:56.46 36.03 percent complete\n", "00:31:19.93 36.49 percent complete\n", "00:31:44.33 36.95 percent complete\n", "00:32:07.88 37.41 percent complete\n", "00:32:32.08 37.88 percent complete\n", "00:32:56.34 38.34 percent complete\n", "00:33:20.79 38.80 percent complete\n", "00:33:44.59 39.26 percent complete\n", "00:34:08.98 39.72 percent complete\n", "00:34:32.93 40.19 percent complete\n", "00:34:56.72 40.65 percent complete\n", "00:35:21.12 41.11 percent complete\n", "00:35:45.38 41.57 percent complete\n", "00:36:09.10 42.03 percent complete\n", "00:36:33.30 42.49 percent complete\n", "00:36:57.68 42.96 percent complete\n", "00:37:21.90 43.42 percent complete\n", "00:37:45.21 43.88 percent complete\n", "00:38:09.01 44.34 percent complete\n", "00:38:33.14 44.80 percent complete\n", "00:38:57.65 45.27 percent complete\n", "00:39:21.34 45.73 percent complete\n", "00:39:45.27 46.19 percent complete\n", "00:40:09.16 46.65 percent complete\n" ], "name": "stdout" }, { "output_type": "stream", "text": [ "WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '․ ․']\n" ], "name": "stderr" }, { "output_type": "stream", "text": [ "00:40:32.51 47.11 percent complete\n", "00:40:56.64 47.58 percent complete\n", "00:41:20.36 48.04 percent complete\n", "00:41:44.61 48.50 percent complete\n", "00:42:08.32 48.96 percent complete\n", "00:42:31.93 49.42 percent complete\n", "00:42:56.28 49.89 percent complete\n", "00:43:20.24 50.35 percent complete\n", "00:43:44.62 50.81 percent complete\n", "00:44:08.91 51.27 percent complete\n", "00:44:32.54 51.73 percent complete\n", "00:44:56.09 52.19 percent complete\n", "00:45:20.95 52.66 percent complete\n", "00:45:44.71 53.12 percent complete\n", "00:46:08.30 53.58 percent complete\n", "00:46:32.61 54.04 percent complete\n", "00:46:56.86 54.50 percent complete\n", "00:47:20.82 54.97 percent complete\n", "00:47:44.99 55.43 percent complete\n", "00:48:08.38 55.89 percent complete\n", "00:48:32.48 56.35 percent complete\n", "00:48:56.67 56.81 percent complete\n", "00:49:20.35 57.28 percent complete\n", "00:49:44.61 57.74 percent complete\n", "00:50:08.07 58.20 percent complete\n", "00:50:32.40 58.66 percent complete\n", "00:50:56.51 59.12 percent complete\n", "00:51:20.65 59.59 percent complete\n", "00:51:44.56 60.05 percent complete\n", "00:52:08.95 60.51 percent complete\n", "00:52:32.77 60.97 percent complete\n", "00:52:56.32 61.43 percent complete\n", "00:53:20.96 61.89 percent complete\n", "00:53:45.01 62.36 percent complete\n", "00:54:08.62 62.82 percent complete\n", "00:54:32.80 63.28 percent complete\n", "00:54:56.52 63.74 percent complete\n", "00:55:20.42 64.20 percent complete\n", "00:55:44.48 64.67 percent complete\n", "00:56:08.38 65.13 percent complete\n", "00:56:32.50 65.59 percent complete\n", "00:56:56.41 66.05 percent complete\n", "00:57:20.00 66.51 percent complete\n", "00:57:43.52 66.98 percent complete\n", "00:58:07.51 67.44 percent complete\n", "00:58:31.43 67.90 percent complete\n", "00:58:55.35 68.36 percent complete\n", "00:59:19.06 68.82 percent complete\n", "00:59:42.85 69.29 percent complete\n", "01:00:07.00 69.75 percent complete\n", "01:00:30.53 70.21 percent complete\n", "01:00:54.45 70.67 percent complete\n", "01:01:18.35 71.13 percent complete\n", "01:01:42.37 71.59 percent complete\n", "01:02:06.05 72.06 percent complete\n", "01:02:29.54 72.52 percent complete\n", "01:02:53.79 72.98 percent complete\n", "01:03:17.95 73.44 percent complete\n", "01:03:41.78 73.90 percent complete\n", "01:04:05.36 74.37 percent complete\n", "01:04:29.49 74.83 percent complete\n", "01:04:54.40 75.29 percent complete\n", "01:05:18.19 75.75 percent complete\n", "01:05:41.97 76.21 percent complete\n", "01:06:05.42 76.68 percent complete\n", "01:06:29.65 77.14 percent complete\n", "01:06:53.24 77.60 percent complete\n", "01:07:16.62 78.06 percent complete\n", "01:07:40.89 78.52 percent complete\n", "01:08:05.22 78.98 percent complete\n", "01:08:28.49 79.45 percent complete\n", "01:08:52.56 79.91 percent complete\n", "01:09:16.44 80.37 percent complete\n", "01:09:40.34 80.83 percent complete\n", "01:10:04.15 81.29 percent complete\n", "01:10:28.28 81.76 percent complete\n", "01:10:51.83 82.22 percent complete\n", "01:11:15.87 82.68 percent complete\n", "01:11:39.95 83.14 percent complete\n", "01:12:03.72 83.60 percent complete\n", "01:12:26.92 84.07 percent complete\n", "01:12:51.37 84.53 percent complete\n" ], "name": "stdout" }, { "output_type": "stream", "text": [ "WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '⇩']\n" ], "name": "stderr" }, { "output_type": "stream", "text": [ "01:13:15.72 84.99 percent complete\n", "01:13:39.67 85.45 percent complete\n", "01:14:03.39 85.91 percent complete\n", "01:14:27.32 86.38 percent complete\n", "01:14:51.76 86.84 percent complete\n", "01:15:15.58 87.30 percent complete\n", "01:15:39.33 87.76 percent complete\n", "01:16:03.85 88.22 percent complete\n", "01:16:27.71 88.68 percent complete\n", "01:16:51.58 89.15 percent complete\n", "01:17:15.41 89.61 percent complete\n", "01:17:39.83 90.07 percent complete\n", "01:18:04.13 90.53 percent complete\n", "01:18:28.67 90.99 percent complete\n", "01:18:53.01 91.46 percent complete\n", "01:19:16.73 91.92 percent complete\n", "01:19:41.87 92.38 percent complete\n", "01:20:05.67 92.84 percent complete\n", "01:20:29.44 93.30 percent complete\n", "01:20:53.86 93.77 percent complete\n", "01:21:18.33 94.23 percent complete\n", "01:21:42.36 94.69 percent complete\n", "01:22:06.26 95.15 percent complete\n", "01:22:29.82 95.61 percent complete\n", "01:22:53.83 96.08 percent complete\n", "01:23:17.51 96.54 percent complete\n", "01:23:41.70 97.00 percent complete\n", "01:24:05.69 97.46 percent complete\n", "01:24:30.08 97.92 percent complete\n", "01:24:53.94 98.38 percent complete\n", "01:25:17.57 98.85 percent complete\n", "01:25:41.43 99.31 percent complete\n", "01:26:05.41 99.77 percent complete\n" ], "name": "stdout" } ] }, { "cell_type": "code", "metadata": { "colab_type": "code", "id": "hxxBOCA-xXhy", "outputId": "c1d5d941-1524-480d-9371-b2abd5a19d0b", "colab": { "base_uri": "https://localhost:8080/", "height": 819 } }, "source": [ "# This section does the split between train/dev for the parallel corpora then saves them as separate files\n", "# We use 1000 dev test and the given test set.\n", "import csv\n", "\n", "# Do the split between dev/train and create parallel corpora\n", "num_dev_patterns = 1000\n", "\n", "# Optional: lower case the corpora - this will make it easier to generalize, but without proper casing.\n", "if lc: # Julia: making lowercasing optional\n", " df_pp[\"source_sentence\"] = df_pp[\"source_sentence\"].str.lower()\n", " df_pp[\"target_sentence\"] = df_pp[\"target_sentence\"].str.lower()\n", "\n", "# Julia: test sets are already generated\n", "dev = df_pp.tail(num_dev_patterns) # Herman: Error in original\n", "stripped = df_pp.drop(df_pp.tail(num_dev_patterns).index)\n", "\n", "with open(\"train.\"+source_language, \"w\") as src_file, open(\"train.\"+target_language, \"w\") as trg_file:\n", " for index, row in stripped.iterrows():\n", " src_file.write(row[\"source_sentence\"]+\"\\n\")\n", " trg_file.write(row[\"target_sentence\"]+\"\\n\")\n", " \n", "with open(\"dev.\"+source_language, \"w\") as src_file, open(\"dev.\"+target_language, \"w\") as trg_file:\n", " for index, row in dev.iterrows():\n", " src_file.write(row[\"source_sentence\"]+\"\\n\")\n", " trg_file.write(row[\"target_sentence\"]+\"\\n\")\n", "\n", "#stripped[[\"source_sentence\"]].to_csv(\"train.\"+source_language, header=False, index=False) # Herman: Added `header=False` everywhere\n", "#stripped[[\"target_sentence\"]].to_csv(\"train.\"+target_language, header=False, index=False) # Julia: Problematic handling of quotation marks.\n", "\n", "#dev[[\"source_sentence\"]].to_csv(\"dev.\"+source_language, header=False, index=False)\n", "#dev[[\"target_sentence\"]].to_csv(\"dev.\"+target_language, header=False, index=False)\n", "\n", "# Doublecheck the format below. There should be no extra quotation marks or weird characters.\n", "! head train.*\n", "! head dev.*" ], "execution_count": 0, "outputs": [ { "output_type": "stream", "text": [ "==> train.en <==\n", "Now in his 80 ’ s , John admits that at times he feels despondent .\n", "The Bible exhorts us to “ speak consolingly to the depressed souls , support the weak . ”\n", "Those words of 17th - century British historian Edward Herbert underscore one reason why we need to be forgiving toward others : Sooner or later , we may need to ask others to forgive us .\n", "So why not prove to yourself that what you have been taught from the Bible is indeed the truth ?\n", "Father , glorify your name . ’\n", "God’s Word foretold this development , saying : “ There will be a period of time when they [ people professing to serve God ] will not put up with the healthful teaching , but , in accord with their own desires , they will accumulate teachers for themselves to have their ears tickled . ”\n", "We get water from a well at the police station .\n", "Do we courageously identify ourselves as Jehovah’s Witnesses , even though doing so may mean persecution ?\n", "Tatiana , a full - time evangelizer in Kamchatka , a Russian peninsula located northeast of Japan , began saving for the trip a year in advance .\n", "Since 1939 , the cover of each issue of The Watchtower magazine has displayed the words “ Announcing Jehovah’s Kingdom . ”\n", "\n", "==> train.iso <==\n", "Enẹna Jọn ọ kpako te ikpe udhone gbọ no , ọ ta nọ ẹsejọ ọ be hai wo elọhoma .\n", "Ebaibol na e ta udu họ omai awọ nnọ “ wha ta udu họ enọ udu u re bro awọ , wha fiobọhọ kẹ enọ e ko . ”\n", "Eme yena nọ ogbiku yena ọ ta anwọ ikpe udhusoi akwa ane ( 400 ) nọ i kpemu na , i dhesẹ epanọ u wuzou te re ma rọ vrẹ amọfa , keme ma te siọ amọfa ba eruthọ ẹdẹjọ họ , nọ o te gwọlọ nọ a rọ vrẹ omai .\n", "Kiẹ kẹ oma ra re u mu owhẹ ẹro inọ eware nọ a wuhrẹ owhẹ no Ebaibol ze na ginọ uzẹme .\n", "Koyehọ uru jọ u te no eva ehru ze nọ , ‘ Mẹ kẹ riẹ oro uno , mẹ jẹ te wariẹ kẹ e oro . ’\n", "A jọ Ebaibol ruẹaro kpahe onana , inọ : “ Oke o be tha nọ ahwo [ enọ i se oma rai eg’Ọghẹnẹ ] a rẹ te rehọ uwuhrẹ nọ o gbunu hu , [ rekọ ] ezọ e rẹ te sae okpọ a ve ti koko iwuhrẹ nọ i re ti wuhrẹ ai onọ a guọlọ . ”\n", "Ozae nọ o rrọ ogba iporisi ma re kpohọ jo vo ame .\n", "Kọ ma be hae gbaudu dhesẹ oma wọhọ Isẹri Jihova , o tẹ make rọnọ ere oruo o rẹ sae wha ukpokpoma ze ?\n", "Tatiana , ọtausiuwoma oke - kpobi nọ o no Kamchatka ze , ẹwho Russia jọ nọ ọ rrọ ofẹ obọze ẹkpẹlobọ ovatha - ọre ọrọ Japan , o muọ ugho họ ekoko họ kẹ erẹ na ukpe soso taure oke na u te ti te .\n", "Anwọ ukpe 1939 ze , uzoẹme nọ o rrọ uke emagazini Uwou - Eroro Na họ “ Uwou - Eroro Na Nọ U Bi Whowho Uvie Jihova . ”\n", "==> dev.en <==\n", "We can even ask God to ‘ create in us a pure heart . ’\n", "This was followed by Kingdom News No .\n", "In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "Still , words of apology are a strong force toward making peace .\n", "Elijah brings the boy down to his mother and says : “ See , your son is alive . ”\n", "By means of his ministry , he gave a priceless gift to humankind ​ — a message that revealed the truth about God and His will .\n", "Comparably , Christian husbands assign their mates honor and praise them .\n", "How do we feel about all those who are making sacrifices for the Kingdom , and what should all of us consider ?\n", "Jesus too is a shepherd and a conquering king .\n", "These examples clearly establish that those who truly belong to Jehovah must firmly take their stand for righteousness and against wickedness .\n", "\n", "==> dev.iso <==\n", "Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "Elaeja ọ tẹ rehọ ọmọ na se oni riẹ jẹ ta nọ : “ Ri , ọmọ ra ọ zọe ” no .\n", "Ọ rehọ ẹkwoma odibọgba riẹ kẹ ahwo - akpọ okẹ jọ nọ o ghare thesiwa — ovuẹ nọ u dhesẹ uzẹme na via kpahe Ọghẹnẹ gbe oreva riẹ .\n", "Epọvo na re , ezae Ileleikristi a re tete eyae rai je jiri ai .\n", "Ẹvẹ u fo nọ ma re rri inievo nọ i bi si obọ no eware jọ re a sae rọ iruo Uvie na karo , kọ eme u fo nọ mai omomọvo o re ru ?\n", "Jesu omariẹ yọ othuru - igodẹ gbe ovie nọ o bi fi kparobọ .\n", "Iriruo nana i dhesẹ vevẹ nọ enọ e ginẹ rrọ erọ Jihova a rẹ gbaemu nọ a re ru eware nọ i dhesẹ nọ a kiẹrẹe je mukpahe oware uyoma .\n" ], "name": "stdout" } ] }, { "cell_type": "markdown", "metadata": { "colab_type": "text", "id": "epeCydmCyS8X" }, "source": [ "\n", "\n", "---\n", "\n", "\n", "## Installation of JoeyNMT\n", "\n", "JoeyNMT is a simple, minimalist NMT package which is useful for learning and teaching. Check out the documentation for JoeyNMT [here](https://joeynmt.readthedocs.io) " ] }, { "cell_type": "code", "metadata": { "colab_type": "code", "id": "iBRMm4kMxZ8L", "outputId": "b3b6172c-57d1-4275-d4a1-ad12342accda", "colab": { "base_uri": "https://localhost:8080/", "height": 1000 } }, "source": [ "# Install JoeyNMT\n", "! git clone https://github.com/joeynmt/joeynmt.git\n", "! cd joeynmt; pip3 install ." ], "execution_count": 5, "outputs": [ { "output_type": "stream", "text": [ "Cloning into 'joeynmt'...\n", "remote: Enumerating objects: 20, done.\u001b[K\n", "remote: Counting objects: 100% (20/20), done.\u001b[K\n", "remote: Compressing objects: 100% (17/17), done.\u001b[K\n", "remote: Total 2204 (delta 8), reused 5 (delta 3), pack-reused 2184\u001b[K\n", "Receiving objects: 100% (2204/2204), 2.61 MiB | 12.48 MiB/s, done.\n", "Resolving deltas: 100% (1529/1529), done.\n", "Processing /content/joeynmt\n", "Requirement already satisfied: future in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (0.16.0)\n", "Requirement already satisfied: pillow in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (6.2.2)\n", "Requirement already satisfied: numpy<2.0,>=1.14.5 in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (1.17.5)\n", "Requirement already satisfied: setuptools>=41.0.0 in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (42.0.2)\n", "Requirement already satisfied: torch>=1.1 in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (1.3.1)\n", "Requirement already satisfied: tensorflow>=1.14 in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (1.15.0)\n", "Requirement already satisfied: torchtext in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (0.3.1)\n", "Collecting sacrebleu>=1.3.6\n", " Downloading https://files.pythonhosted.org/packages/45/31/1a135b964c169984b27fb2f7a50280fa7f8e6d9d404d8a9e596180487fd1/sacrebleu-1.4.3-py3-none-any.whl\n", "Collecting subword-nmt\n", " Downloading https://files.pythonhosted.org/packages/74/60/6600a7bc09e7ab38bc53a48a20d8cae49b837f93f5842a41fe513a694912/subword_nmt-0.3.7-py2.py3-none-any.whl\n", "Requirement already satisfied: matplotlib in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (3.1.2)\n", "Requirement already satisfied: seaborn in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (0.9.0)\n", "Collecting pyyaml>=5.1\n", "\u001b[?25l Downloading https://files.pythonhosted.org/packages/3d/d9/ea9816aea31beeadccd03f1f8b625ecf8f645bd66744484d162d84803ce5/PyYAML-5.3.tar.gz (268kB)\n", "\u001b[K |████████████████████████████████| 276kB 14.2MB/s \n", "\u001b[?25hCollecting pylint\n", "\u001b[?25l Downloading https://files.pythonhosted.org/packages/e9/59/43fc36c5ee316bb9aeb7cf5329cdbdca89e5749c34d5602753827c0aa2dc/pylint-2.4.4-py3-none-any.whl (302kB)\n", "\u001b[K |████████████████████████████████| 307kB 50.5MB/s \n", "\u001b[?25hRequirement already satisfied: six==1.12 in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (1.12.0)\n", "Requirement already satisfied: termcolor>=1.1.0 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (1.1.0)\n", "Requirement already satisfied: astor>=0.6.0 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (0.8.1)\n", "Requirement already satisfied: tensorboard<1.16.0,>=1.15.0 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (1.15.0)\n", "Requirement already satisfied: keras-applications>=1.0.8 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (1.0.8)\n", "Requirement already satisfied: opt-einsum>=2.3.2 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (3.1.0)\n", "Requirement already satisfied: protobuf>=3.6.1 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (3.10.0)\n", "Requirement already satisfied: wheel>=0.26 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (0.33.6)\n", "Requirement already satisfied: absl-py>=0.7.0 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (0.9.0)\n", "Requirement already satisfied: gast==0.2.2 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (0.2.2)\n", "Requirement already satisfied: grpcio>=1.8.6 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (1.15.0)\n", "Requirement already satisfied: keras-preprocessing>=1.0.5 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (1.1.0)\n", "Requirement already satisfied: wrapt>=1.11.1 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (1.11.2)\n", "Requirement already satisfied: tensorflow-estimator==1.15.1 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (1.15.1)\n", "Requirement already satisfied: google-pasta>=0.1.6 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (0.1.8)\n", "Requirement already satisfied: requests in /usr/local/lib/python3.6/dist-packages (from torchtext->joeynmt==0.0.1) (2.21.0)\n", "Requirement already satisfied: tqdm in /usr/local/lib/python3.6/dist-packages (from torchtext->joeynmt==0.0.1) (4.28.1)\n", "Requirement already satisfied: typing in /usr/local/lib/python3.6/dist-packages (from sacrebleu>=1.3.6->joeynmt==0.0.1) (3.6.6)\n", "Collecting portalocker\n", " Downloading https://files.pythonhosted.org/packages/91/db/7bc703c0760df726839e0699b7f78a4d8217fdc9c7fcb1b51b39c5a22a4e/portalocker-1.5.2-py2.py3-none-any.whl\n", "Requirement already satisfied: cycler>=0.10 in /usr/local/lib/python3.6/dist-packages (from matplotlib->joeynmt==0.0.1) (0.10.0)\n", "Requirement already satisfied: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.1 in /usr/local/lib/python3.6/dist-packages (from matplotlib->joeynmt==0.0.1) (2.4.6)\n", "Requirement already satisfied: kiwisolver>=1.0.1 in /usr/local/lib/python3.6/dist-packages (from matplotlib->joeynmt==0.0.1) (1.1.0)\n", "Requirement already satisfied: python-dateutil>=2.1 in /usr/local/lib/python3.6/dist-packages (from matplotlib->joeynmt==0.0.1) (2.6.1)\n", "Requirement already satisfied: scipy>=0.14.0 in /usr/local/lib/python3.6/dist-packages (from seaborn->joeynmt==0.0.1) (1.4.1)\n", "Requirement already satisfied: pandas>=0.15.2 in /usr/local/lib/python3.6/dist-packages (from seaborn->joeynmt==0.0.1) (0.25.3)\n", "Collecting astroid<2.4,>=2.3.0\n", "\u001b[?25l Downloading https://files.pythonhosted.org/packages/ad/ae/86734823047962e7b8c8529186a1ac4a7ca19aaf1aa0c7713c022ef593fd/astroid-2.3.3-py3-none-any.whl (205kB)\n", "\u001b[K |████████████████████████████████| 215kB 53.6MB/s \n", "\u001b[?25hCollecting isort<5,>=4.2.5\n", "\u001b[?25l Downloading https://files.pythonhosted.org/packages/e5/b0/c121fd1fa3419ea9bfd55c7f9c4fedfec5143208d8c7ad3ce3db6c623c21/isort-4.3.21-py2.py3-none-any.whl (42kB)\n", "\u001b[K |████████████████████████████████| 51kB 9.5MB/s \n", "\u001b[?25hCollecting mccabe<0.7,>=0.6\n", " Downloading https://files.pythonhosted.org/packages/87/89/479dc97e18549e21354893e4ee4ef36db1d237534982482c3681ee6e7b57/mccabe-0.6.1-py2.py3-none-any.whl\n", "Requirement already satisfied: markdown>=2.6.8 in /usr/local/lib/python3.6/dist-packages (from tensorboard<1.16.0,>=1.15.0->tensorflow>=1.14->joeynmt==0.0.1) (3.1.1)\n", "Requirement already satisfied: werkzeug>=0.11.15 in /usr/local/lib/python3.6/dist-packages (from tensorboard<1.16.0,>=1.15.0->tensorflow>=1.14->joeynmt==0.0.1) (0.16.0)\n", "Requirement already satisfied: h5py in /usr/local/lib/python3.6/dist-packages (from keras-applications>=1.0.8->tensorflow>=1.14->joeynmt==0.0.1) (2.8.0)\n", "Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python3.6/dist-packages (from requests->torchtext->joeynmt==0.0.1) (3.0.4)\n", "Requirement already satisfied: idna<2.9,>=2.5 in /usr/local/lib/python3.6/dist-packages (from requests->torchtext->joeynmt==0.0.1) (2.8)\n", "Requirement already satisfied: urllib3<1.25,>=1.21.1 in /usr/local/lib/python3.6/dist-packages (from requests->torchtext->joeynmt==0.0.1) (1.24.3)\n", "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.6/dist-packages (from requests->torchtext->joeynmt==0.0.1) (2019.11.28)\n", "Requirement already satisfied: pytz>=2017.2 in /usr/local/lib/python3.6/dist-packages (from pandas>=0.15.2->seaborn->joeynmt==0.0.1) (2018.9)\n", "Collecting lazy-object-proxy==1.4.*\n", "\u001b[?25l Downloading https://files.pythonhosted.org/packages/0b/dd/b1e3407e9e6913cf178e506cd0dee818e58694d9a5cd1984e3f6a8b9a10f/lazy_object_proxy-1.4.3-cp36-cp36m-manylinux1_x86_64.whl (55kB)\n", "\u001b[K |████████████████████████████████| 61kB 9.9MB/s \n", "\u001b[?25hCollecting typed-ast<1.5,>=1.4.0; implementation_name == \"cpython\" and python_version < \"3.8\"\n", "\u001b[?25l Downloading https://files.pythonhosted.org/packages/90/ed/5459080d95eb87a02fe860d447197be63b6e2b5e9ff73c2b0a85622994f4/typed_ast-1.4.1-cp36-cp36m-manylinux1_x86_64.whl (737kB)\n", "\u001b[K |████████████████████████████████| 747kB 61.8MB/s \n", "\u001b[?25hBuilding wheels for collected packages: joeynmt, pyyaml\n", " Building wheel for joeynmt (setup.py) ... \u001b[?25l\u001b[?25hdone\n", " Created wheel for joeynmt: filename=joeynmt-0.0.1-cp36-none-any.whl size=72136 sha256=5707981394ee54b776f20dcd3f8678902212c73b0671a13b312536e4c5135bc9\n", " Stored in directory: /tmp/pip-ephem-wheel-cache-fnf46e7w/wheels/db/01/db/751cc9f3e7f6faec127c43644ba250a3ea7ad200594aeda70a\n", " Building wheel for pyyaml (setup.py) ... \u001b[?25l\u001b[?25hdone\n", " Created wheel for pyyaml: filename=PyYAML-5.3-cp36-cp36m-linux_x86_64.whl size=44229 sha256=5865bbc1c502c588cf7768934b3c43d53221d1a86064dbb1fcbbdc794c89487a\n", " Stored in directory: /root/.cache/pip/wheels/e4/76/4d/a95b8dd7b452b69e8ed4f68b69e1b55e12c9c9624dd962b191\n", "Successfully built joeynmt pyyaml\n", "Installing collected packages: portalocker, sacrebleu, subword-nmt, pyyaml, lazy-object-proxy, typed-ast, astroid, isort, mccabe, pylint, joeynmt\n", " Found existing installation: PyYAML 3.13\n", " Uninstalling PyYAML-3.13:\n", " Successfully uninstalled PyYAML-3.13\n", "Successfully installed astroid-2.3.3 isort-4.3.21 joeynmt-0.0.1 lazy-object-proxy-1.4.3 mccabe-0.6.1 portalocker-1.5.2 pylint-2.4.4 pyyaml-5.3 sacrebleu-1.4.3 subword-nmt-0.3.7 typed-ast-1.4.1\n" ], "name": "stdout" } ] }, { "cell_type": "markdown", "metadata": { "colab_type": "text", "id": "AaE77Tcppex9" }, "source": [ "# Preprocessing the Data into Subword BPE Tokens\n", "\n", "- One of the most powerful improvements for agglutinative languages (a feature of most Bantu languages) is using BPE tokenization [ (Sennrich, 2015) ](https://arxiv.org/abs/1508.07909).\n", "\n", "- It was also shown that by optimizing the umber of BPE codes we significantly improve results for low-resourced languages [(Sennrich, 2019)](https://www.aclweb.org/anthology/P19-1021) [(Martinus, 2019)](https://arxiv.org/abs/1906.05685)\n", "\n", "- Below we have the scripts for doing BPE tokenization of our data. We use 4000 tokens as recommended by [(Sennrich, 2019)](https://www.aclweb.org/anthology/P19-1021). You do not need to change anything. Simply running the below will be suitable. " ] }, { "cell_type": "code", "metadata": { "colab_type": "code", "id": "H-TyjtmXB1mL", "colab": {} }, "source": [ "# # One of the huge boosts in NMT performance was to use a different method of tokenizing. \n", "# # Usually, NMT would tokenize by words. However, using a method called BPE gave amazing boosts to performance\n", "\n", "# # Do subword NMT\n", "# from os import path\n", "# os.environ[\"src\"] = source_language # Sets them in bash as well, since we often use bash scripts\n", "# os.environ[\"tgt\"] = target_language\n", "\n", "# # Learn BPEs on the training data.\n", "# os.environ[\"data_path\"] = path.join(\"joeynmt\", \"data\", source_language + target_language) # Herman! \n", "# ! subword-nmt learn-joint-bpe-and-vocab --input train.$src train.$tgt -s 4000 -o bpe.codes.4000 --write-vocabulary vocab.$src vocab.$tgt\n", "\n", "# # Apply BPE splits to the development and test data.\n", "# ! subword-nmt apply-bpe -c bpe.codes.4000 --vocabulary vocab.$src < train.$src > train.bpe.$src\n", "# ! subword-nmt apply-bpe -c bpe.codes.4000 --vocabulary vocab.$tgt < train.$tgt > train.bpe.$tgt\n", "\n", "# ! subword-nmt apply-bpe -c bpe.codes.4000 --vocabulary vocab.$src < dev.$src > dev.bpe.$src\n", "# ! subword-nmt apply-bpe -c bpe.codes.4000 --vocabulary vocab.$tgt < dev.$tgt > dev.bpe.$tgt\n", "# ! subword-nmt apply-bpe -c bpe.codes.4000 --vocabulary vocab.$src < test.$src > test.bpe.$src\n", "# ! subword-nmt apply-bpe -c bpe.codes.4000 --vocabulary vocab.$tgt < test.$tgt > test.bpe.$tgt\n", "\n", "# # Create directory, move everyone we care about to the correct location\n", "# ! mkdir -p $data_path\n", "# ! cp train.* $data_path\n", "# ! cp test.* $data_path\n", "# ! cp dev.* $data_path\n", "# ! cp bpe.codes.4000 $data_path\n", "# ! ls $data_path\n", "\n", "# # Also move everything we care about to a mounted location in google drive (relevant if running in colab) at gdrive_path\n", "# ! cp train.* \"$gdrive_path\"\n", "# ! cp test.* \"$gdrive_path\"\n", "# ! cp dev.* \"$gdrive_path\"\n", "# ! cp bpe.codes.4000 \"$gdrive_path\"\n", "# ! ls \"$gdrive_path\"\n", "\n", "# # Create that vocab using build_vocab\n", "# ! sudo chmod 777 joeynmt/scripts/build_vocab.py\n", "# ! joeynmt/scripts/build_vocab.py joeynmt/data/$src$tgt/train.bpe.$src joeynmt/data/$src$tgt/train.bpe.$tgt --output_path joeynmt/data/$src$tgt/vocab.txt\n", "\n", "# # Some output\n", "# ! echo \"BPE Isoko Sentences\"\n", "# ! tail -n 5 test.bpe.$tgt\n", "# ! echo \"Combined BPE Vocab\"\n", "# ! tail -n 10 joeynmt/data/$src$tgt/vocab.txt # Herman\n", "# ! cp joeynmt/data/$src$tgt/vocab.txt \"$gdrive_path\"" ], "execution_count": 0, "outputs": [] }, { "cell_type": "code", "metadata": { "id": "4OkAKSIK7Eg4", "colab_type": "code", "colab": { "base_uri": "https://localhost:8080/", "height": 306 }, "outputId": "ebd32661-78d6-45fb-c0a9-e059c0f5d055" }, "source": [ "###### IOHAVOC MODIFICATIONS ==>> CREATE THE VOCAB FOR NON-BPE EXPERIMENTS\n", "from os import path\n", "\n", "os.environ[\"src\"] = source_language # Sets them in bash as well, since we often use bash scripts\n", "os.environ[\"tgt\"] = target_language\n", "\n", "! sudo chmod 777 joeynmt/scripts/build_vocab.py\n", "! joeynmt/scripts/build_vocab.py \"$gdrive_path/train.$src\" \"$gdrive_path/train.$tgt\" --output_path \"$gdrive_path/vocab-nonBPE.txt\"\n", "\n", "# Some output\n", "! echo \"Isoko test Sentences\"\n", "! tail -n 5 \"$gdrive_path/test.$tgt\"\n", "! echo \"Combined Vocab\"\n", "! tail -n 10 \"$gdrive_path/vocab-nonBPE.txt\" # iroro" ], "execution_count": 5, "outputs": [ { "output_type": "stream", "text": [ "Isoko test Sentences\n", "Fikieme o rọ gwọlọ nọ Hushai o re wo udu re ọ sae talamu Ọghẹnẹ ?\n", "Fikieme o rọ gwọlọ nọ ma wo udu re ma sai yoẹme kẹ Jihova ?\n", "Mẹ tẹ lẹ se Ọghẹnẹ re ọ kẹ omẹ udu nọ me re ro ru lele iroro nọ mẹ jẹ na .\n", "Enẹna eva mẹ e gbẹ be dhae he , yọ mẹ sai weze bru ai oke kpobi . ” — Se Itẹ 29 : 25 .\n", "[ 1 ] ( edhe - ẹme avọ 7 ) Ma nwene edẹ na jọ .\n", "Combined Vocab\n", "instructor’s\n", "midwife\n", "priestess\n", "congregator’s\n", "prairies\n", "HONORS\n", "ROME’S\n", "FAVORITE\n", "EMPERORS\n", "BO\n" ], "name": "stdout" } ] }, { "cell_type": "markdown", "metadata": { "colab_type": "text", "id": "Ixmzi60WsUZ8" }, "source": [ "# Creating the JoeyNMT Config\n", "\n", "JoeyNMT requires a yaml config. We provide a template below. We've also set a number of defaults with it, that you may play with!\n", "\n", "- We used Transformer architecture \n", "- We set our dropout to reasonably high: 0.3 (recommended in [(Sennrich, 2019)](https://www.aclweb.org/anthology/P19-1021))\n", "\n", "Things worth playing with:\n", "- The batch size (also recommended to change for low-resourced languages)\n", "- The number of epochs (we've set it at 30 just so it runs in about an hour, for testing purposes)\n", "- The decoder options (beam_size, alpha)\n", "- Evaluation metrics (BLEU versus Crhf4)" ] }, { "cell_type": "code", "metadata": { "colab_type": "code", "id": "PIs1lY2hxMsl", "colab": {} }, "source": [ "# This creates the config file for our JoeyNMT system. It might seem overwhelming so we've provided a couple of useful parameters you'll need to update\n", "# (You can of course play with all the parameters if you'd like!)\n", "\n", "name = '%s%s' % (source_language, target_language)\n", "gdrive_path = os.environ[\"gdrive_path\"]\n", "\n", "# Create the config\n", "config = \"\"\"\n", "name: \"{name}_transformer\"\n", "\n", "data:\n", " src: \"{source_language}\"\n", " trg: \"{target_language}\"\n", " train: \"{gdrive_path}/train\"\n", " dev: \"{gdrive_path}/dev\"\n", " test: \"{gdrive_path}/test\"\n", " level: \"bpe\"\n", " lowercase: False\n", " max_sent_length: 100\n", " src_vocab: \"{gdrive_path}/vocab-nonBPE.txt\"\n", " trg_vocab: \"{gdrive_path}/vocab-nonBPE.txt\"\n", "\n", "testing:\n", " beam_size: 5\n", " alpha: 1.0\n", "\n", "training:\n", " # load_model: \"{gdrive_path}/models/{name}_transformer_orig/142000.ckpt\" # if uncommented, load a pre-trained model from this checkpoint\n", " random_seed: 42\n", " optimizer: \"adam\"\n", " normalization: \"tokens\"\n", " adam_betas: [0.9, 0.999] \n", " scheduling: \"plateau\" # TODO: try switching from plateau to Noam scheduling\n", " patience: 5 # For plateau: decrease learning rate by decrease_factor if validation score has not improved for this many validation rounds.\n", " learning_rate_factor: 0.5 # factor for Noam scheduler (used with Transformer)\n", " learning_rate_warmup: 1000 # warmup steps for Noam scheduler (used with Transformer)\n", " decrease_factor: 0.7\n", " loss: \"crossentropy\"\n", " learning_rate: 0.0003\n", " learning_rate_min: 0.00000001\n", " weight_decay: 0.0\n", " label_smoothing: 0.1\n", " batch_size: 4096\n", " batch_type: \"token\"\n", " eval_batch_size: 3600\n", " eval_batch_type: \"token\"\n", " batch_multiplier: 1\n", " early_stopping_metric: \"ppl\"\n", " epochs: 100 # TODO: Decrease for when playing around and checking of working. Around 30 is sufficient to check if its working at all\n", " validation_freq: 1000 # TODO: Set to at least once per epoch.\n", " logging_freq: 100\n", " eval_metric: \"bleu\"\n", " model_dir: \"{gdrive_path}/models/{name}_transformer\"\n", " overwrite: True # TODO: Set to True if you want to overwrite possibly existing models. \n", " shuffle: True\n", " use_cuda: True\n", " max_output_length: 100\n", " print_valid_sents: [0, 1, 2, 3]\n", " keep_last_ckpts: 3\n", "\n", "model:\n", " initializer: \"xavier\"\n", " bias_initializer: \"zeros\"\n", " init_gain: 1.0\n", " embed_initializer: \"xavier\"\n", " embed_init_gain: 1.0\n", " tied_embeddings: True\n", " tied_softmax: True\n", " encoder:\n", " type: \"transformer\"\n", " num_layers: 6\n", " num_heads: 4 # TODO: Increase to 8 for larger data.\n", " embeddings:\n", " embedding_dim: 256 # TODO: Increase to 512 for larger data.\n", " scale: True\n", " dropout: 0.2\n", " # typically ff_size = 4 x hidden_size\n", " hidden_size: 256 # TODO: Increase to 512 for larger data.\n", " ff_size: 1024 # TODO: Increase to 2048 for larger data.\n", " dropout: 0.3\n", " decoder:\n", " type: \"transformer\"\n", " num_layers: 6\n", " num_heads: 4 # TODO: Increase to 8 for larger data.\n", " embeddings:\n", " embedding_dim: 256 # TODO: Increase to 512 for larger data.\n", " scale: True\n", " dropout: 0.2\n", " # typically ff_size = 4 x hidden_size\n", " hidden_size: 256 # TODO: Increase to 512 for larger data.\n", " ff_size: 1024 # TODO: Increase to 2048 for larger data.\n", " dropout: 0.3\n", "\"\"\".format(name=name, gdrive_path=os.environ[\"gdrive_path\"], source_language=source_language, target_language=target_language)\n", "with open(\"joeynmt/configs/transformer_{name}.yaml\".format(name=name),'w') as f:\n", " f.write(config)\n", "\n", "! cp joeynmt/configs/transformer_$src$tgt.yaml \"$gdrive_path\"" ], "execution_count": 0, "outputs": [] }, { "cell_type": "markdown", "metadata": { "colab_type": "text", "id": "pIifxE3Qzuvs" }, "source": [ "# Train the Model\n", "\n", "This single line of joeynmt runs the training using the config we made above" ] }, { "cell_type": "code", "metadata": { "colab_type": "code", "id": "6ZBPFwT94WpI", "outputId": "20ad5d5b-66ed-4bc8-974e-4f97c0d5038c", "colab": { "base_uri": "https://localhost:8080/", "height": 1000 } }, "source": [ "# Train the model\n", "# You can press Ctrl-C to stop. And then run the next cell to save your checkpoints! \n", "# !cd joeynmt; python3 -m joeynmt train configs/transformer_$src$tgt.yaml\n", "!python3 -m joeynmt train \"$gdrive_path/transformer_$src$tgt.yaml\"" ], "execution_count": 0, "outputs": [ { "output_type": "stream", "text": [ "2020-01-18 04:45:27,857 Hello! This is Joey-NMT.\n", "2020-01-18 04:45:29,039 Total params: 24833536\n", "2020-01-18 04:45:29,041 Trainable parameters: ['decoder.layer_norm.bias', 'decoder.layer_norm.weight', 'decoder.layers.0.dec_layer_norm.bias', 'decoder.layers.0.dec_layer_norm.weight', 'decoder.layers.0.feed_forward.layer_norm.bias', 'decoder.layers.0.feed_forward.layer_norm.weight', 'decoder.layers.0.feed_forward.pwff_layer.0.bias', 'decoder.layers.0.feed_forward.pwff_layer.0.weight', 'decoder.layers.0.feed_forward.pwff_layer.3.bias', 'decoder.layers.0.feed_forward.pwff_layer.3.weight', 'decoder.layers.0.src_trg_att.k_layer.bias', 'decoder.layers.0.src_trg_att.k_layer.weight', 'decoder.layers.0.src_trg_att.output_layer.bias', 'decoder.layers.0.src_trg_att.output_layer.weight', 'decoder.layers.0.src_trg_att.q_layer.bias', 'decoder.layers.0.src_trg_att.q_layer.weight', 'decoder.layers.0.src_trg_att.v_layer.bias', 'decoder.layers.0.src_trg_att.v_layer.weight', 'decoder.layers.0.trg_trg_att.k_layer.bias', 'decoder.layers.0.trg_trg_att.k_layer.weight', 'decoder.layers.0.trg_trg_att.output_layer.bias', 'decoder.layers.0.trg_trg_att.output_layer.weight', 'decoder.layers.0.trg_trg_att.q_layer.bias', 'decoder.layers.0.trg_trg_att.q_layer.weight', 'decoder.layers.0.trg_trg_att.v_layer.bias', 'decoder.layers.0.trg_trg_att.v_layer.weight', 'decoder.layers.0.x_layer_norm.bias', 'decoder.layers.0.x_layer_norm.weight', 'decoder.layers.1.dec_layer_norm.bias', 'decoder.layers.1.dec_layer_norm.weight', 'decoder.layers.1.feed_forward.layer_norm.bias', 'decoder.layers.1.feed_forward.layer_norm.weight', 'decoder.layers.1.feed_forward.pwff_layer.0.bias', 'decoder.layers.1.feed_forward.pwff_layer.0.weight', 'decoder.layers.1.feed_forward.pwff_layer.3.bias', 'decoder.layers.1.feed_forward.pwff_layer.3.weight', 'decoder.layers.1.src_trg_att.k_layer.bias', 'decoder.layers.1.src_trg_att.k_layer.weight', 'decoder.layers.1.src_trg_att.output_layer.bias', 'decoder.layers.1.src_trg_att.output_layer.weight', 'decoder.layers.1.src_trg_att.q_layer.bias', 'decoder.layers.1.src_trg_att.q_layer.weight', 'decoder.layers.1.src_trg_att.v_layer.bias', 'decoder.layers.1.src_trg_att.v_layer.weight', 'decoder.layers.1.trg_trg_att.k_layer.bias', 'decoder.layers.1.trg_trg_att.k_layer.weight', 'decoder.layers.1.trg_trg_att.output_layer.bias', 'decoder.layers.1.trg_trg_att.output_layer.weight', 'decoder.layers.1.trg_trg_att.q_layer.bias', 'decoder.layers.1.trg_trg_att.q_layer.weight', 'decoder.layers.1.trg_trg_att.v_layer.bias', 'decoder.layers.1.trg_trg_att.v_layer.weight', 'decoder.layers.1.x_layer_norm.bias', 'decoder.layers.1.x_layer_norm.weight', 'decoder.layers.2.dec_layer_norm.bias', 'decoder.layers.2.dec_layer_norm.weight', 'decoder.layers.2.feed_forward.layer_norm.bias', 'decoder.layers.2.feed_forward.layer_norm.weight', 'decoder.layers.2.feed_forward.pwff_layer.0.bias', 'decoder.layers.2.feed_forward.pwff_layer.0.weight', 'decoder.layers.2.feed_forward.pwff_layer.3.bias', 'decoder.layers.2.feed_forward.pwff_layer.3.weight', 'decoder.layers.2.src_trg_att.k_layer.bias', 'decoder.layers.2.src_trg_att.k_layer.weight', 'decoder.layers.2.src_trg_att.output_layer.bias', 'decoder.layers.2.src_trg_att.output_layer.weight', 'decoder.layers.2.src_trg_att.q_layer.bias', 'decoder.layers.2.src_trg_att.q_layer.weight', 'decoder.layers.2.src_trg_att.v_layer.bias', 'decoder.layers.2.src_trg_att.v_layer.weight', 'decoder.layers.2.trg_trg_att.k_layer.bias', 'decoder.layers.2.trg_trg_att.k_layer.weight', 'decoder.layers.2.trg_trg_att.output_layer.bias', 'decoder.layers.2.trg_trg_att.output_layer.weight', 'decoder.layers.2.trg_trg_att.q_layer.bias', 'decoder.layers.2.trg_trg_att.q_layer.weight', 'decoder.layers.2.trg_trg_att.v_layer.bias', 'decoder.layers.2.trg_trg_att.v_layer.weight', 'decoder.layers.2.x_layer_norm.bias', 'decoder.layers.2.x_layer_norm.weight', 'decoder.layers.3.dec_layer_norm.bias', 'decoder.layers.3.dec_layer_norm.weight', 'decoder.layers.3.feed_forward.layer_norm.bias', 'decoder.layers.3.feed_forward.layer_norm.weight', 'decoder.layers.3.feed_forward.pwff_layer.0.bias', 'decoder.layers.3.feed_forward.pwff_layer.0.weight', 'decoder.layers.3.feed_forward.pwff_layer.3.bias', 'decoder.layers.3.feed_forward.pwff_layer.3.weight', 'decoder.layers.3.src_trg_att.k_layer.bias', 'decoder.layers.3.src_trg_att.k_layer.weight', 'decoder.layers.3.src_trg_att.output_layer.bias', 'decoder.layers.3.src_trg_att.output_layer.weight', 'decoder.layers.3.src_trg_att.q_layer.bias', 'decoder.layers.3.src_trg_att.q_layer.weight', 'decoder.layers.3.src_trg_att.v_layer.bias', 'decoder.layers.3.src_trg_att.v_layer.weight', 'decoder.layers.3.trg_trg_att.k_layer.bias', 'decoder.layers.3.trg_trg_att.k_layer.weight', 'decoder.layers.3.trg_trg_att.output_layer.bias', 'decoder.layers.3.trg_trg_att.output_layer.weight', 'decoder.layers.3.trg_trg_att.q_layer.bias', 'decoder.layers.3.trg_trg_att.q_layer.weight', 'decoder.layers.3.trg_trg_att.v_layer.bias', 'decoder.layers.3.trg_trg_att.v_layer.weight', 'decoder.layers.3.x_layer_norm.bias', 'decoder.layers.3.x_layer_norm.weight', 'decoder.layers.4.dec_layer_norm.bias', 'decoder.layers.4.dec_layer_norm.weight', 'decoder.layers.4.feed_forward.layer_norm.bias', 'decoder.layers.4.feed_forward.layer_norm.weight', 'decoder.layers.4.feed_forward.pwff_layer.0.bias', 'decoder.layers.4.feed_forward.pwff_layer.0.weight', 'decoder.layers.4.feed_forward.pwff_layer.3.bias', 'decoder.layers.4.feed_forward.pwff_layer.3.weight', 'decoder.layers.4.src_trg_att.k_layer.bias', 'decoder.layers.4.src_trg_att.k_layer.weight', 'decoder.layers.4.src_trg_att.output_layer.bias', 'decoder.layers.4.src_trg_att.output_layer.weight', 'decoder.layers.4.src_trg_att.q_layer.bias', 'decoder.layers.4.src_trg_att.q_layer.weight', 'decoder.layers.4.src_trg_att.v_layer.bias', 'decoder.layers.4.src_trg_att.v_layer.weight', 'decoder.layers.4.trg_trg_att.k_layer.bias', 'decoder.layers.4.trg_trg_att.k_layer.weight', 'decoder.layers.4.trg_trg_att.output_layer.bias', 'decoder.layers.4.trg_trg_att.output_layer.weight', 'decoder.layers.4.trg_trg_att.q_layer.bias', 'decoder.layers.4.trg_trg_att.q_layer.weight', 'decoder.layers.4.trg_trg_att.v_layer.bias', 'decoder.layers.4.trg_trg_att.v_layer.weight', 'decoder.layers.4.x_layer_norm.bias', 'decoder.layers.4.x_layer_norm.weight', 'decoder.layers.5.dec_layer_norm.bias', 'decoder.layers.5.dec_layer_norm.weight', 'decoder.layers.5.feed_forward.layer_norm.bias', 'decoder.layers.5.feed_forward.layer_norm.weight', 'decoder.layers.5.feed_forward.pwff_layer.0.bias', 'decoder.layers.5.feed_forward.pwff_layer.0.weight', 'decoder.layers.5.feed_forward.pwff_layer.3.bias', 'decoder.layers.5.feed_forward.pwff_layer.3.weight', 'decoder.layers.5.src_trg_att.k_layer.bias', 'decoder.layers.5.src_trg_att.k_layer.weight', 'decoder.layers.5.src_trg_att.output_layer.bias', 'decoder.layers.5.src_trg_att.output_layer.weight', 'decoder.layers.5.src_trg_att.q_layer.bias', 'decoder.layers.5.src_trg_att.q_layer.weight', 'decoder.layers.5.src_trg_att.v_layer.bias', 'decoder.layers.5.src_trg_att.v_layer.weight', 'decoder.layers.5.trg_trg_att.k_layer.bias', 'decoder.layers.5.trg_trg_att.k_layer.weight', 'decoder.layers.5.trg_trg_att.output_layer.bias', 'decoder.layers.5.trg_trg_att.output_layer.weight', 'decoder.layers.5.trg_trg_att.q_layer.bias', 'decoder.layers.5.trg_trg_att.q_layer.weight', 'decoder.layers.5.trg_trg_att.v_layer.bias', 'decoder.layers.5.trg_trg_att.v_layer.weight', 'decoder.layers.5.x_layer_norm.bias', 'decoder.layers.5.x_layer_norm.weight', 'encoder.layer_norm.bias', 'encoder.layer_norm.weight', 'encoder.layers.0.feed_forward.layer_norm.bias', 'encoder.layers.0.feed_forward.layer_norm.weight', 'encoder.layers.0.feed_forward.pwff_layer.0.bias', 'encoder.layers.0.feed_forward.pwff_layer.0.weight', 'encoder.layers.0.feed_forward.pwff_layer.3.bias', 'encoder.layers.0.feed_forward.pwff_layer.3.weight', 'encoder.layers.0.layer_norm.bias', 'encoder.layers.0.layer_norm.weight', 'encoder.layers.0.src_src_att.k_layer.bias', 'encoder.layers.0.src_src_att.k_layer.weight', 'encoder.layers.0.src_src_att.output_layer.bias', 'encoder.layers.0.src_src_att.output_layer.weight', 'encoder.layers.0.src_src_att.q_layer.bias', 'encoder.layers.0.src_src_att.q_layer.weight', 'encoder.layers.0.src_src_att.v_layer.bias', 'encoder.layers.0.src_src_att.v_layer.weight', 'encoder.layers.1.feed_forward.layer_norm.bias', 'encoder.layers.1.feed_forward.layer_norm.weight', 'encoder.layers.1.feed_forward.pwff_layer.0.bias', 'encoder.layers.1.feed_forward.pwff_layer.0.weight', 'encoder.layers.1.feed_forward.pwff_layer.3.bias', 'encoder.layers.1.feed_forward.pwff_layer.3.weight', 'encoder.layers.1.layer_norm.bias', 'encoder.layers.1.layer_norm.weight', 'encoder.layers.1.src_src_att.k_layer.bias', 'encoder.layers.1.src_src_att.k_layer.weight', 'encoder.layers.1.src_src_att.output_layer.bias', 'encoder.layers.1.src_src_att.output_layer.weight', 'encoder.layers.1.src_src_att.q_layer.bias', 'encoder.layers.1.src_src_att.q_layer.weight', 'encoder.layers.1.src_src_att.v_layer.bias', 'encoder.layers.1.src_src_att.v_layer.weight', 'encoder.layers.2.feed_forward.layer_norm.bias', 'encoder.layers.2.feed_forward.layer_norm.weight', 'encoder.layers.2.feed_forward.pwff_layer.0.bias', 'encoder.layers.2.feed_forward.pwff_layer.0.weight', 'encoder.layers.2.feed_forward.pwff_layer.3.bias', 'encoder.layers.2.feed_forward.pwff_layer.3.weight', 'encoder.layers.2.layer_norm.bias', 'encoder.layers.2.layer_norm.weight', 'encoder.layers.2.src_src_att.k_layer.bias', 'encoder.layers.2.src_src_att.k_layer.weight', 'encoder.layers.2.src_src_att.output_layer.bias', 'encoder.layers.2.src_src_att.output_layer.weight', 'encoder.layers.2.src_src_att.q_layer.bias', 'encoder.layers.2.src_src_att.q_layer.weight', 'encoder.layers.2.src_src_att.v_layer.bias', 'encoder.layers.2.src_src_att.v_layer.weight', 'encoder.layers.3.feed_forward.layer_norm.bias', 'encoder.layers.3.feed_forward.layer_norm.weight', 'encoder.layers.3.feed_forward.pwff_layer.0.bias', 'encoder.layers.3.feed_forward.pwff_layer.0.weight', 'encoder.layers.3.feed_forward.pwff_layer.3.bias', 'encoder.layers.3.feed_forward.pwff_layer.3.weight', 'encoder.layers.3.layer_norm.bias', 'encoder.layers.3.layer_norm.weight', 'encoder.layers.3.src_src_att.k_layer.bias', 'encoder.layers.3.src_src_att.k_layer.weight', 'encoder.layers.3.src_src_att.output_layer.bias', 'encoder.layers.3.src_src_att.output_layer.weight', 'encoder.layers.3.src_src_att.q_layer.bias', 'encoder.layers.3.src_src_att.q_layer.weight', 'encoder.layers.3.src_src_att.v_layer.bias', 'encoder.layers.3.src_src_att.v_layer.weight', 'encoder.layers.4.feed_forward.layer_norm.bias', 'encoder.layers.4.feed_forward.layer_norm.weight', 'encoder.layers.4.feed_forward.pwff_layer.0.bias', 'encoder.layers.4.feed_forward.pwff_layer.0.weight', 'encoder.layers.4.feed_forward.pwff_layer.3.bias', 'encoder.layers.4.feed_forward.pwff_layer.3.weight', 'encoder.layers.4.layer_norm.bias', 'encoder.layers.4.layer_norm.weight', 'encoder.layers.4.src_src_att.k_layer.bias', 'encoder.layers.4.src_src_att.k_layer.weight', 'encoder.layers.4.src_src_att.output_layer.bias', 'encoder.layers.4.src_src_att.output_layer.weight', 'encoder.layers.4.src_src_att.q_layer.bias', 'encoder.layers.4.src_src_att.q_layer.weight', 'encoder.layers.4.src_src_att.v_layer.bias', 'encoder.layers.4.src_src_att.v_layer.weight', 'encoder.layers.5.feed_forward.layer_norm.bias', 'encoder.layers.5.feed_forward.layer_norm.weight', 'encoder.layers.5.feed_forward.pwff_layer.0.bias', 'encoder.layers.5.feed_forward.pwff_layer.0.weight', 'encoder.layers.5.feed_forward.pwff_layer.3.bias', 'encoder.layers.5.feed_forward.pwff_layer.3.weight', 'encoder.layers.5.layer_norm.bias', 'encoder.layers.5.layer_norm.weight', 'encoder.layers.5.src_src_att.k_layer.bias', 'encoder.layers.5.src_src_att.k_layer.weight', 'encoder.layers.5.src_src_att.output_layer.bias', 'encoder.layers.5.src_src_att.output_layer.weight', 'encoder.layers.5.src_src_att.q_layer.bias', 'encoder.layers.5.src_src_att.q_layer.weight', 'encoder.layers.5.src_src_att.v_layer.bias', 'encoder.layers.5.src_src_att.v_layer.weight', 'src_embed.lut.weight']\n", "2020-01-18 04:45:38,131 cfg.name : eniso_transformer\n", "2020-01-18 04:45:38,132 cfg.data.src : en\n", "2020-01-18 04:45:38,132 cfg.data.trg : iso\n", "2020-01-18 04:45:38,132 cfg.data.train : /content/drive/My Drive/masakhane/en-iso-baseline/train\n", "2020-01-18 04:45:38,132 cfg.data.dev : /content/drive/My Drive/masakhane/en-iso-baseline/dev\n", "2020-01-18 04:45:38,132 cfg.data.test : /content/drive/My Drive/masakhane/en-iso-baseline/test\n", "2020-01-18 04:45:38,132 cfg.data.level : bpe\n", "2020-01-18 04:45:38,132 cfg.data.lowercase : False\n", "2020-01-18 04:45:38,132 cfg.data.max_sent_length : 100\n", "2020-01-18 04:45:38,133 cfg.data.src_vocab : /content/drive/My Drive/masakhane/en-iso-baseline/vocab-nonBPE.txt\n", "2020-01-18 04:45:38,133 cfg.data.trg_vocab : /content/drive/My Drive/masakhane/en-iso-baseline/vocab-nonBPE.txt\n", "2020-01-18 04:45:38,133 cfg.testing.beam_size : 5\n", "2020-01-18 04:45:38,133 cfg.testing.alpha : 1.0\n", "2020-01-18 04:45:38,133 cfg.training.random_seed : 42\n", "2020-01-18 04:45:38,133 cfg.training.optimizer : adam\n", "2020-01-18 04:45:38,133 cfg.training.normalization : tokens\n", "2020-01-18 04:45:38,134 cfg.training.adam_betas : [0.9, 0.999]\n", "2020-01-18 04:45:38,134 cfg.training.scheduling : plateau\n", "2020-01-18 04:45:38,134 cfg.training.patience : 5\n", "2020-01-18 04:45:38,134 cfg.training.learning_rate_factor : 0.5\n", "2020-01-18 04:45:38,134 cfg.training.learning_rate_warmup : 1000\n", "2020-01-18 04:45:38,134 cfg.training.decrease_factor : 0.7\n", "2020-01-18 04:45:38,134 cfg.training.loss : crossentropy\n", "2020-01-18 04:45:38,135 cfg.training.learning_rate : 0.0003\n", "2020-01-18 04:45:38,135 cfg.training.learning_rate_min : 1e-08\n", "2020-01-18 04:45:38,135 cfg.training.weight_decay : 0.0\n", "2020-01-18 04:45:38,135 cfg.training.label_smoothing : 0.1\n", "2020-01-18 04:45:38,135 cfg.training.batch_size : 4096\n", "2020-01-18 04:45:38,135 cfg.training.batch_type : token\n", "2020-01-18 04:45:38,135 cfg.training.eval_batch_size : 3600\n", "2020-01-18 04:45:38,135 cfg.training.eval_batch_type : token\n", "2020-01-18 04:45:38,136 cfg.training.batch_multiplier : 1\n", "2020-01-18 04:45:38,136 cfg.training.early_stopping_metric : ppl\n", "2020-01-18 04:45:38,136 cfg.training.epochs : 100\n", "2020-01-18 04:45:38,136 cfg.training.validation_freq : 1000\n", "2020-01-18 04:45:38,136 cfg.training.logging_freq : 100\n", "2020-01-18 04:45:38,136 cfg.training.eval_metric : bleu\n", "2020-01-18 04:45:38,136 cfg.training.model_dir : /content/drive/My Drive/masakhane/en-iso-baseline/models/eniso_transformer\n", "2020-01-18 04:45:38,136 cfg.training.overwrite : True\n", "2020-01-18 04:45:38,137 cfg.training.shuffle : True\n", "2020-01-18 04:45:38,137 cfg.training.use_cuda : True\n", "2020-01-18 04:45:38,137 cfg.training.max_output_length : 100\n", "2020-01-18 04:45:38,137 cfg.training.print_valid_sents : [0, 1, 2, 3]\n", "2020-01-18 04:45:38,137 cfg.training.keep_last_ckpts : 3\n", "2020-01-18 04:45:38,137 cfg.model.initializer : xavier\n", "2020-01-18 04:45:38,137 cfg.model.bias_initializer : zeros\n", "2020-01-18 04:45:38,137 cfg.model.init_gain : 1.0\n", "2020-01-18 04:45:38,138 cfg.model.embed_initializer : xavier\n", "2020-01-18 04:45:38,138 cfg.model.embed_init_gain : 1.0\n", "2020-01-18 04:45:38,138 cfg.model.tied_embeddings : True\n", "2020-01-18 04:45:38,138 cfg.model.tied_softmax : True\n", "2020-01-18 04:45:38,138 cfg.model.encoder.type : transformer\n", "2020-01-18 04:45:38,138 cfg.model.encoder.num_layers : 6\n", "2020-01-18 04:45:38,138 cfg.model.encoder.num_heads : 4\n", "2020-01-18 04:45:38,138 cfg.model.encoder.embeddings.embedding_dim : 256\n", "2020-01-18 04:45:38,139 cfg.model.encoder.embeddings.scale : True\n", "2020-01-18 04:45:38,139 cfg.model.encoder.embeddings.dropout : 0.2\n", "2020-01-18 04:45:38,139 cfg.model.encoder.hidden_size : 256\n", "2020-01-18 04:45:38,139 cfg.model.encoder.ff_size : 1024\n", "2020-01-18 04:45:38,139 cfg.model.encoder.dropout : 0.3\n", "2020-01-18 04:45:38,139 cfg.model.decoder.type : transformer\n", "2020-01-18 04:45:38,139 cfg.model.decoder.num_layers : 6\n", "2020-01-18 04:45:38,139 cfg.model.decoder.num_heads : 4\n", "2020-01-18 04:45:38,140 cfg.model.decoder.embeddings.embedding_dim : 256\n", "2020-01-18 04:45:38,140 cfg.model.decoder.embeddings.scale : True\n", "2020-01-18 04:45:38,140 cfg.model.decoder.embeddings.dropout : 0.2\n", "2020-01-18 04:45:38,140 cfg.model.decoder.hidden_size : 256\n", "2020-01-18 04:45:38,140 cfg.model.decoder.ff_size : 1024\n", "2020-01-18 04:45:38,140 cfg.model.decoder.dropout : 0.3\n", "2020-01-18 04:45:38,140 Data set sizes: \n", "\ttrain 214534,\n", "\tvalid 1000,\n", "\ttest 2709\n", "2020-01-18 04:45:38,140 First training example:\n", "\t[SRC] Now in his 80 ’ s , John admits that at times he feels despondent .\n", "\t[TRG] Enẹna Jọn ọ kpako te ikpe udhone gbọ no , ọ ta nọ ẹsejọ ọ be hai wo elọhoma .\n", "2020-01-18 04:45:38,141 First 10 words (src): (0) (1) (2) (3) (4) . (5) , (6) nọ (7) a (8) the (9) na\n", "2020-01-18 04:45:38,141 First 10 words (trg): (0) (1) (2) (3) (4) . (5) , (6) nọ (7) a (8) the (9) na\n", "2020-01-18 04:45:38,141 Number of Src words (types): 53802\n", "2020-01-18 04:45:38,142 Number of Trg words (types): 53802\n", "2020-01-18 04:45:38,142 Model(\n", "\tencoder=TransformerEncoder(num_layers=6, num_heads=4),\n", "\tdecoder=TransformerDecoder(num_layers=6, num_heads=4),\n", "\tsrc_embed=Embeddings(embedding_dim=256, vocab_size=53802),\n", "\ttrg_embed=Embeddings(embedding_dim=256, vocab_size=53802))\n", "2020-01-18 04:45:38,190 EPOCH 1\n", "2020-01-18 04:45:58,820 Epoch 1 Step: 100 Batch Loss: 5.304596 Tokens per Sec: 10457, Lr: 0.000300\n", "2020-01-18 04:46:19,029 Epoch 1 Step: 200 Batch Loss: 5.267745 Tokens per Sec: 10530, Lr: 0.000300\n", "2020-01-18 04:46:39,067 Epoch 1 Step: 300 Batch Loss: 5.167497 Tokens per Sec: 10776, Lr: 0.000300\n", "2020-01-18 04:46:59,353 Epoch 1 Step: 400 Batch Loss: 4.970615 Tokens per Sec: 10512, Lr: 0.000300\n", "2020-01-18 04:47:19,321 Epoch 1 Step: 500 Batch Loss: 4.668531 Tokens per Sec: 10683, Lr: 0.000300\n", "2020-01-18 04:47:39,488 Epoch 1 Step: 600 Batch Loss: 4.501199 Tokens per Sec: 10869, Lr: 0.000300\n", "2020-01-18 04:47:59,665 Epoch 1 Step: 700 Batch Loss: 4.601970 Tokens per Sec: 10629, Lr: 0.000300\n", "2020-01-18 04:48:19,868 Epoch 1 Step: 800 Batch Loss: 4.251521 Tokens per Sec: 10803, Lr: 0.000300\n", "2020-01-18 04:48:40,013 Epoch 1 Step: 900 Batch Loss: 4.778258 Tokens per Sec: 10583, Lr: 0.000300\n", "2020-01-18 04:49:00,207 Epoch 1 Step: 1000 Batch Loss: 3.988404 Tokens per Sec: 10817, Lr: 0.000300\n", "2020-01-18 04:49:48,273 Hooray! New best validation result [ppl]!\n", "2020-01-18 04:49:48,273 Saving new checkpoint.\n", "2020-01-18 04:49:50,797 Example #0\n", "2020-01-18 04:49:50,798 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 04:49:50,798 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 04:49:50,798 \tHypothesis: ( b ) Ma rẹ rọ kẹ omai kẹ omai kẹ omai kẹ omai kẹ omai .\n", "2020-01-18 04:49:50,798 Example #1\n", "2020-01-18 04:49:50,798 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 04:49:50,798 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 04:49:50,799 \tHypothesis: ( 2 : 1 : 1 : 1 : 1 : 1 : 1 : 1 : 1 .\n", "2020-01-18 04:49:50,799 Example #2\n", "2020-01-18 04:49:50,799 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 04:49:50,799 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 04:49:50,799 \tHypothesis: Nọ ma rẹ rọ kẹ omai nọ ma rẹ rọ kẹ omai nọ ma rẹ rọ kẹ omai kẹ omai kẹ omai kẹ omai kẹ omai kẹ omai kẹ omai kẹ omai kẹ omai kẹ omai .\n", "2020-01-18 04:49:50,799 Example #3\n", "2020-01-18 04:49:50,799 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 04:49:50,799 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 04:49:50,800 \tHypothesis: ( b : 1 : 1 : 1 : 1 : 1 : 1 : 1 : 1 : 1 : 1 : 1 : 1 .\n", "2020-01-18 04:49:50,800 Validation result (greedy) at epoch 1, step 1000: bleu: 0.80, loss: 93509.6328, ppl: 57.1846, duration: 50.5918s\n", "2020-01-18 04:50:11,195 Epoch 1 Step: 1100 Batch Loss: 4.008318 Tokens per Sec: 10671, Lr: 0.000300\n", "2020-01-18 04:50:30,943 Epoch 1 Step: 1200 Batch Loss: 3.971554 Tokens per Sec: 10635, Lr: 0.000300\n", "2020-01-18 04:50:51,117 Epoch 1 Step: 1300 Batch Loss: 3.938731 Tokens per Sec: 10676, Lr: 0.000300\n", "2020-01-18 04:51:11,566 Epoch 1 Step: 1400 Batch Loss: 3.848077 Tokens per Sec: 10747, Lr: 0.000300\n", "2020-01-18 04:51:31,626 Epoch 1 Step: 1500 Batch Loss: 3.654587 Tokens per Sec: 10527, Lr: 0.000300\n", "2020-01-18 04:51:51,736 Epoch 1 Step: 1600 Batch Loss: 3.629787 Tokens per Sec: 10720, Lr: 0.000300\n", "2020-01-18 04:52:11,497 Epoch 1 Step: 1700 Batch Loss: 3.567107 Tokens per Sec: 10367, Lr: 0.000300\n", "2020-01-18 04:52:31,304 Epoch 1 Step: 1800 Batch Loss: 3.590435 Tokens per Sec: 10717, Lr: 0.000300\n", "2020-01-18 04:52:51,583 Epoch 1 Step: 1900 Batch Loss: 3.425914 Tokens per Sec: 10857, Lr: 0.000300\n", "2020-01-18 04:53:11,611 Epoch 1 Step: 2000 Batch Loss: 3.609844 Tokens per Sec: 10581, Lr: 0.000300\n", "2020-01-18 04:53:59,538 Hooray! New best validation result [ppl]!\n", "2020-01-18 04:53:59,538 Saving new checkpoint.\n", "2020-01-18 04:54:01,557 Example #0\n", "2020-01-18 04:54:01,557 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 04:54:01,557 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 04:54:01,557 \tHypothesis: Ma rẹ sai ru re ma “ wo uyoyou ” . ”\n", "2020-01-18 04:54:01,558 Example #1\n", "2020-01-18 04:54:01,558 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 04:54:01,558 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 04:54:01,558 \tHypothesis: O te ti ru iruo usiuwoma ota na .\n", "2020-01-18 04:54:01,558 Example #2\n", "2020-01-18 04:54:01,558 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 04:54:01,558 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 04:54:01,559 \tHypothesis: Evaọ oke yena , ma te ti ru nọ ma re ro dhesẹ nọ ma re se “ rehọ eva odhiwu , ” nọ a re ro dhesẹ nọ : “ Wha te rehọ eva riẹ , ” nọ a re ro ru ei . ”\n", "2020-01-18 04:54:01,559 Example #3\n", "2020-01-18 04:54:01,559 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 04:54:01,559 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 04:54:01,559 \tHypothesis: O te roro nọ o rrọ bẹbẹ kẹ ahwo nọ a re ro ru iruo rai .\n", "2020-01-18 04:54:01,559 Validation result (greedy) at epoch 1, step 2000: bleu: 3.00, loss: 78938.6172, ppl: 30.4406, duration: 49.9478s\n", "2020-01-18 04:54:22,133 Epoch 1 Step: 2100 Batch Loss: 3.581513 Tokens per Sec: 10655, Lr: 0.000300\n", "2020-01-18 04:54:42,194 Epoch 1 Step: 2200 Batch Loss: 3.345359 Tokens per Sec: 10821, Lr: 0.000300\n", "2020-01-18 04:55:02,305 Epoch 1 Step: 2300 Batch Loss: 3.194122 Tokens per Sec: 10848, Lr: 0.000300\n", "2020-01-18 04:55:10,966 Epoch 1: total training loss 9759.48\n", "2020-01-18 04:55:10,966 EPOCH 2\n", "2020-01-18 04:55:22,701 Epoch 2 Step: 2400 Batch Loss: 3.462741 Tokens per Sec: 10558, Lr: 0.000300\n", "2020-01-18 04:55:42,726 Epoch 2 Step: 2500 Batch Loss: 3.406073 Tokens per Sec: 10502, Lr: 0.000300\n", "2020-01-18 04:56:02,667 Epoch 2 Step: 2600 Batch Loss: 3.340951 Tokens per Sec: 10848, Lr: 0.000300\n", "2020-01-18 04:56:22,624 Epoch 2 Step: 2700 Batch Loss: 2.939559 Tokens per Sec: 10723, Lr: 0.000300\n", "2020-01-18 04:56:42,681 Epoch 2 Step: 2800 Batch Loss: 2.949533 Tokens per Sec: 10579, Lr: 0.000300\n", "2020-01-18 04:57:02,613 Epoch 2 Step: 2900 Batch Loss: 3.269601 Tokens per Sec: 10626, Lr: 0.000300\n", "2020-01-18 04:57:22,700 Epoch 2 Step: 3000 Batch Loss: 3.023423 Tokens per Sec: 10729, Lr: 0.000300\n", "2020-01-18 04:58:10,749 Hooray! New best validation result [ppl]!\n", "2020-01-18 04:58:10,750 Saving new checkpoint.\n", "2020-01-18 04:58:12,752 Example #0\n", "2020-01-18 04:58:12,753 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 04:58:12,753 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 04:58:12,753 \tHypothesis: Ma rẹ sae ta nọ Ọghẹnẹ ọ rẹ sae rọ “ rehọ oma mai kpobi ” mai ru omai .\n", "2020-01-18 04:58:12,753 Example #1\n", "2020-01-18 04:58:12,754 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 04:58:12,754 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 04:58:12,754 \tHypothesis: Onana u dhesẹ nọ Uvie na o te jọ obọ odhiwu .\n", "2020-01-18 04:58:12,755 Example #2\n", "2020-01-18 04:58:12,756 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 04:58:12,756 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 04:58:12,756 \tHypothesis: Evaọ oke yena , ma rẹ rọ rehọ oma mai ru omai wo ogaga nọ ma rẹ rọ rehọ oma mai ru lele iei , nọ : “ Wha rehọ oma riẹ rehọ oma riẹ kẹ ahwo nọ a re ro ru iruo nọ a rọ kẹ owhai . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .\n", "2020-01-18 04:58:12,756 Example #3\n", "2020-01-18 04:58:12,757 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 04:58:12,757 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 04:58:12,757 \tHypothesis: Dede na , eme nana e rrọ oware nọ u re ru nọ o rẹ rọ kẹ omai evawere .\n", "2020-01-18 04:58:12,757 Validation result (greedy) at epoch 2, step 3000: bleu: 4.84, loss: 69391.8828, ppl: 20.1394, duration: 50.0573s\n", "2020-01-18 04:58:33,267 Epoch 2 Step: 3100 Batch Loss: 2.717620 Tokens per Sec: 10527, Lr: 0.000300\n", "2020-01-18 04:58:53,247 Epoch 2 Step: 3200 Batch Loss: 2.995375 Tokens per Sec: 10781, Lr: 0.000300\n", "2020-01-18 04:59:13,470 Epoch 2 Step: 3300 Batch Loss: 2.746496 Tokens per Sec: 10527, Lr: 0.000300\n", "2020-01-18 04:59:33,611 Epoch 2 Step: 3400 Batch Loss: 3.091735 Tokens per Sec: 10709, Lr: 0.000300\n", "2020-01-18 04:59:53,725 Epoch 2 Step: 3500 Batch Loss: 2.938541 Tokens per Sec: 10705, Lr: 0.000300\n", "2020-01-18 05:00:13,668 Epoch 2 Step: 3600 Batch Loss: 2.949249 Tokens per Sec: 10744, Lr: 0.000300\n", "2020-01-18 05:00:33,790 Epoch 2 Step: 3700 Batch Loss: 2.682598 Tokens per Sec: 10922, Lr: 0.000300\n", "2020-01-18 05:00:53,927 Epoch 2 Step: 3800 Batch Loss: 2.651279 Tokens per Sec: 10733, Lr: 0.000300\n", "2020-01-18 05:01:13,742 Epoch 2 Step: 3900 Batch Loss: 2.923479 Tokens per Sec: 10876, Lr: 0.000300\n", "2020-01-18 05:01:33,930 Epoch 2 Step: 4000 Batch Loss: 3.286345 Tokens per Sec: 10652, Lr: 0.000300\n", "2020-01-18 05:02:21,952 Hooray! New best validation result [ppl]!\n", "2020-01-18 05:02:21,952 Saving new checkpoint.\n", "2020-01-18 05:02:23,974 Example #0\n", "2020-01-18 05:02:23,974 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 05:02:23,975 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 05:02:23,975 \tHypothesis: Ma rẹ sae nọ Ọghẹnẹ ọ rẹ sai ru omai wo “ uyoyou ” kẹ omai .\n", "2020-01-18 05:02:23,975 Example #1\n", "2020-01-18 05:02:23,975 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 05:02:23,975 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 05:02:23,975 \tHypothesis: Onana u te no iwuhrẹ Uvie na ze .\n", "2020-01-18 05:02:23,975 Example #2\n", "2020-01-18 05:02:23,975 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 05:02:23,976 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 05:02:23,976 \tHypothesis: Evaọ oke yena , ma te rọ oma mai ru iruo nọ ma te rọ rehọ oma mai ru lele iei , onọ u re fi obọ họ kẹ omai ruẹ epanọ a rọ rehọ ẹkwoma odẹ riẹ ta nọ : “ Wha rehọ odẹ riẹ kẹ ahwo nọ a rọ aro kele Jesu Kristi , re ti ru iruo riẹ , re a rọ eva riẹ , keme a rọ aro kele iei , re ti ru oreva riẹ nọ a rọ aro kele iei , re ti ru oreva riẹ , re a te rọ aro kele iei\n", "2020-01-18 05:02:23,976 Example #3\n", "2020-01-18 05:02:23,976 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 05:02:23,976 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 05:02:23,976 \tHypothesis: Ghele na , eme nana e rẹ wha evawere se ohwo nọ o re ru iruo nọ a re ro wo evawere .\n", "2020-01-18 05:02:23,977 Validation result (greedy) at epoch 2, step 4000: bleu: 5.98, loss: 64425.8242, ppl: 16.2451, duration: 50.0465s\n", "2020-01-18 05:02:44,169 Epoch 2 Step: 4100 Batch Loss: 2.874117 Tokens per Sec: 10083, Lr: 0.000300\n", "2020-01-18 05:03:04,017 Epoch 2 Step: 4200 Batch Loss: 2.624166 Tokens per Sec: 10504, Lr: 0.000300\n", "2020-01-18 05:03:23,936 Epoch 2 Step: 4300 Batch Loss: 2.636919 Tokens per Sec: 10537, Lr: 0.000300\n", "2020-01-18 05:03:44,017 Epoch 2 Step: 4400 Batch Loss: 2.844933 Tokens per Sec: 10910, Lr: 0.000300\n", "2020-01-18 05:04:03,953 Epoch 2 Step: 4500 Batch Loss: 2.792626 Tokens per Sec: 10656, Lr: 0.000300\n", "2020-01-18 05:04:24,052 Epoch 2 Step: 4600 Batch Loss: 2.471326 Tokens per Sec: 10909, Lr: 0.000300\n", "2020-01-18 05:04:42,905 Epoch 2: total training loss 7001.10\n", "2020-01-18 05:04:42,905 EPOCH 3\n", "2020-01-18 05:04:44,156 Epoch 3 Step: 4700 Batch Loss: 2.649913 Tokens per Sec: 9019, Lr: 0.000300\n", "2020-01-18 05:05:04,100 Epoch 3 Step: 4800 Batch Loss: 2.637687 Tokens per Sec: 10657, Lr: 0.000300\n", "2020-01-18 05:05:23,971 Epoch 3 Step: 4900 Batch Loss: 2.703757 Tokens per Sec: 10563, Lr: 0.000300\n", "2020-01-18 05:05:43,898 Epoch 3 Step: 5000 Batch Loss: 2.501377 Tokens per Sec: 10776, Lr: 0.000300\n", "2020-01-18 05:06:31,807 Hooray! New best validation result [ppl]!\n", "2020-01-18 05:06:31,808 Saving new checkpoint.\n", "2020-01-18 05:06:33,724 Example #0\n", "2020-01-18 05:06:33,724 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 05:06:33,725 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 05:06:33,725 \tHypothesis: Ma rẹ sae nọ Ọghẹnẹ ọ rẹ sae nọ omai “ Ọghẹnẹ ọ rẹ kẹ omai ẹgba . ”\n", "2020-01-18 05:06:33,725 Example #1\n", "2020-01-18 05:06:33,725 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 05:06:33,725 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 05:06:33,726 \tHypothesis: Onana u te mu omai ẹro inọ Uvie na o te jọ .\n", "2020-01-18 05:06:33,726 Example #2\n", "2020-01-18 05:06:33,726 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 05:06:33,726 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 05:06:33,726 \tHypothesis: Evaọ uzẹme , ma te ruẹ nọ ma te bi wo evawere nọ ma te bi ro ru eware nọ e rẹ rọ rehọ odẹ riẹ riwi , onọ o ta nọ : “ Wha rehọ odẹ riẹ mu , re a rehọ odẹ riẹ kẹ ae , re a ruẹse rehọ iẹe , re ti ru ei , re a ruẹse rehọ iẹe .\n", "2020-01-18 05:06:33,726 Example #3\n", "2020-01-18 05:06:33,726 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 05:06:33,726 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 05:06:33,726 \tHypothesis: Ghele na , eme nọ e rẹ wha udhedhẹ ze e rẹ wha udhedhẹ ze .\n", "2020-01-18 05:06:33,727 Validation result (greedy) at epoch 3, step 5000: bleu: 10.55, loss: 58171.5781, ppl: 12.3934, duration: 49.8281s\n", "2020-01-18 05:06:54,157 Epoch 3 Step: 5100 Batch Loss: 2.648947 Tokens per Sec: 10530, Lr: 0.000300\n", "2020-01-18 05:07:13,956 Epoch 3 Step: 5200 Batch Loss: 2.844867 Tokens per Sec: 10510, Lr: 0.000300\n", "2020-01-18 05:07:33,920 Epoch 3 Step: 5300 Batch Loss: 2.509118 Tokens per Sec: 10621, Lr: 0.000300\n", "2020-01-18 05:07:53,794 Epoch 3 Step: 5400 Batch Loss: 2.281852 Tokens per Sec: 10773, Lr: 0.000300\n", "2020-01-18 05:08:13,876 Epoch 3 Step: 5500 Batch Loss: 2.653013 Tokens per Sec: 10655, Lr: 0.000300\n", "2020-01-18 05:08:33,839 Epoch 3 Step: 5600 Batch Loss: 2.374635 Tokens per Sec: 10618, Lr: 0.000300\n", "2020-01-18 05:08:53,902 Epoch 3 Step: 5700 Batch Loss: 2.229042 Tokens per Sec: 10742, Lr: 0.000300\n", "2020-01-18 05:09:13,917 Epoch 3 Step: 5800 Batch Loss: 2.777659 Tokens per Sec: 10828, Lr: 0.000300\n", "2020-01-18 05:09:33,945 Epoch 3 Step: 5900 Batch Loss: 2.420178 Tokens per Sec: 10935, Lr: 0.000300\n", "2020-01-18 05:09:53,999 Epoch 3 Step: 6000 Batch Loss: 2.547040 Tokens per Sec: 10757, Lr: 0.000300\n", "2020-01-18 05:10:41,841 Hooray! New best validation result [ppl]!\n", "2020-01-18 05:10:41,841 Saving new checkpoint.\n", "2020-01-18 05:10:43,710 Example #0\n", "2020-01-18 05:10:43,714 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 05:10:43,715 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 05:10:43,715 \tHypothesis: Ma rẹ sae nọ Ọghẹnẹ ọ tẹ nọ omai nọ , “ Ma rẹ jọ eva mai kpobi . ”\n", "2020-01-18 05:10:43,715 Example #1\n", "2020-01-18 05:10:43,715 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 05:10:43,715 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 05:10:43,715 \tHypothesis: Onana u te no iwuhrẹ Uvie na ze .\n", "2020-01-18 05:10:43,716 Example #2\n", "2020-01-18 05:10:43,716 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 05:10:43,716 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 05:10:43,716 \tHypothesis: Evaọ uzẹme , ma te ru omai kpobi nọ ma te bi ru eware nọ e be were omai kpobi nọ ma te ruẹ uye nọ ma te ruẹ no , keme “ odẹ riẹ o rọ eva riẹ kpobi kẹ [ Kristi ] , re a rehọ odẹ riẹ kẹ ae , re a rehọ odẹ riẹ kẹ ae . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .\n", "2020-01-18 05:10:43,716 Example #3\n", "2020-01-18 05:10:43,717 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 05:10:43,717 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 05:10:43,717 \tHypothesis: Ghele na , eme nọ e rẹ wha udhedhẹ ze e rẹ wha udhedhẹ ze .\n", "2020-01-18 05:10:43,717 Validation result (greedy) at epoch 3, step 6000: bleu: 13.10, loss: 54539.6094, ppl: 10.5910, duration: 49.7171s\n", "2020-01-18 05:11:04,036 Epoch 3 Step: 6100 Batch Loss: 2.332406 Tokens per Sec: 10546, Lr: 0.000300\n", "2020-01-18 05:11:24,011 Epoch 3 Step: 6200 Batch Loss: 2.511204 Tokens per Sec: 10855, Lr: 0.000300\n", "2020-01-18 05:11:44,131 Epoch 3 Step: 6300 Batch Loss: 2.349152 Tokens per Sec: 10733, Lr: 0.000300\n", "2020-01-18 05:12:04,101 Epoch 3 Step: 6400 Batch Loss: 2.531099 Tokens per Sec: 10857, Lr: 0.000300\n", "2020-01-18 05:12:24,061 Epoch 3 Step: 6500 Batch Loss: 2.531884 Tokens per Sec: 10688, Lr: 0.000300\n", "2020-01-18 05:12:44,016 Epoch 3 Step: 6600 Batch Loss: 2.286827 Tokens per Sec: 10617, Lr: 0.000300\n", "2020-01-18 05:13:03,967 Epoch 3 Step: 6700 Batch Loss: 2.497401 Tokens per Sec: 10762, Lr: 0.000300\n", "2020-01-18 05:13:23,987 Epoch 3 Step: 6800 Batch Loss: 2.545265 Tokens per Sec: 10981, Lr: 0.000300\n", "2020-01-18 05:13:43,998 Epoch 3 Step: 6900 Batch Loss: 2.237705 Tokens per Sec: 10572, Lr: 0.000300\n", "2020-01-18 05:14:04,080 Epoch 3 Step: 7000 Batch Loss: 2.339658 Tokens per Sec: 10831, Lr: 0.000300\n", "2020-01-18 05:14:51,982 Hooray! New best validation result [ppl]!\n", "2020-01-18 05:14:51,983 Saving new checkpoint.\n", "2020-01-18 05:14:53,825 Example #0\n", "2020-01-18 05:14:53,826 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 05:14:53,826 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 05:14:53,826 \tHypothesis: Ma rẹ sae nọ Ọghẹnẹ ọ rẹ sae nọ omai “ eva efuafo . . . . . . . . . . . . . . . . . . . . . . . . . . . . ”\n", "2020-01-18 05:14:53,826 Example #1\n", "2020-01-18 05:14:53,826 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 05:14:53,826 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 05:14:53,826 \tHypothesis: Onana u te no ovuẹ Uvie na ze .\n", "2020-01-18 05:14:53,827 Example #2\n", "2020-01-18 05:14:53,827 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 05:14:53,827 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 05:14:53,827 \tHypothesis: Evaọ uzẹme , ma te reawere oghọghọ mai nọ ma te wo kugbe eware nọ e rẹ were omai gaga , onọ o ta nọ : “ Jọ odẹ Jesu Kristi Kristi Kristi o ru , re a rehọ odẹ riẹ kpobi kẹ erẹwho kpobi , re a rehọ odẹ riẹ kpobi , re a rehọ odẹ riẹ kpobi kẹ ae .\n", "2020-01-18 05:14:53,827 Example #3\n", "2020-01-18 05:14:53,827 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 05:14:53,827 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 05:14:53,827 \tHypothesis: Ghele na , eme nọ a re se gboja kẹ ohwo o rẹ wha udhedhẹ ze .\n", "2020-01-18 05:14:53,828 Validation result (greedy) at epoch 3, step 7000: bleu: 15.29, loss: 51549.6055, ppl: 9.3056, duration: 49.7471s\n", "2020-01-18 05:15:02,753 Epoch 3: total training loss 5873.05\n", "2020-01-18 05:15:02,754 EPOCH 4\n", "2020-01-18 05:15:14,523 Epoch 4 Step: 7100 Batch Loss: 2.326759 Tokens per Sec: 10291, Lr: 0.000300\n", "2020-01-18 05:15:34,682 Epoch 4 Step: 7200 Batch Loss: 2.308998 Tokens per Sec: 11044, Lr: 0.000300\n", "2020-01-18 05:15:54,702 Epoch 4 Step: 7300 Batch Loss: 2.156527 Tokens per Sec: 10622, Lr: 0.000300\n", "2020-01-18 05:16:14,880 Epoch 4 Step: 7400 Batch Loss: 2.612202 Tokens per Sec: 10679, Lr: 0.000300\n", "2020-01-18 05:16:34,874 Epoch 4 Step: 7500 Batch Loss: 1.851495 Tokens per Sec: 10764, Lr: 0.000300\n", "2020-01-18 05:16:54,697 Epoch 4 Step: 7600 Batch Loss: 2.511102 Tokens per Sec: 10905, Lr: 0.000300\n", "2020-01-18 05:17:14,892 Epoch 4 Step: 7700 Batch Loss: 2.590116 Tokens per Sec: 10717, Lr: 0.000300\n", "2020-01-18 05:17:34,759 Epoch 4 Step: 7800 Batch Loss: 2.344204 Tokens per Sec: 10661, Lr: 0.000300\n", "2020-01-18 05:17:54,860 Epoch 4 Step: 7900 Batch Loss: 2.398788 Tokens per Sec: 10692, Lr: 0.000300\n", "2020-01-18 05:18:15,047 Epoch 4 Step: 8000 Batch Loss: 2.323113 Tokens per Sec: 10922, Lr: 0.000300\n", "2020-01-18 05:19:02,981 Hooray! New best validation result [ppl]!\n", "2020-01-18 05:19:02,982 Saving new checkpoint.\n", "2020-01-18 05:19:05,378 Example #0\n", "2020-01-18 05:19:05,379 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 05:19:05,379 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 05:19:05,379 \tHypothesis: Ma rẹ sae nọ Ọghẹnẹ ọ rẹ ‘ kpọ omai evaọ udu . ’\n", "2020-01-18 05:19:05,379 Example #1\n", "2020-01-18 05:19:05,380 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 05:19:05,380 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 05:19:05,380 \tHypothesis: Onana o tẹ jẹ hae te rehọ ovuẹ Uvie na mu hu .\n", "2020-01-18 05:19:05,380 Example #2\n", "2020-01-18 05:19:05,381 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 05:19:05,383 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 05:19:05,383 \tHypothesis: Fikiere , ma te rọ evawere ruẹ oghọghọ nọ ma te bi ro ru iruo igbunu nana , onọ o rrọ ole nana : “ Jọ odẹ riẹ , re odẹ riẹ o lo kẹ Ọnowo na , re o vi ai bẹdẹ bẹdẹ bẹdẹ ; re wha rehọ odẹ riẹ mu odẹ riẹ .\n", "2020-01-18 05:19:05,383 Example #3\n", "2020-01-18 05:19:05,384 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 05:19:05,384 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 05:19:05,384 \tHypothesis: Ghele na , eme nọ e rẹ lẹliẹ ohwo wo udhedhẹ .\n", "2020-01-18 05:19:05,384 Validation result (greedy) at epoch 4, step 8000: bleu: 17.44, loss: 48991.1445, ppl: 8.3304, duration: 50.3365s\n", "2020-01-18 05:19:25,705 Epoch 4 Step: 8100 Batch Loss: 2.255151 Tokens per Sec: 10702, Lr: 0.000300\n", "2020-01-18 05:19:45,679 Epoch 4 Step: 8200 Batch Loss: 2.412225 Tokens per Sec: 10875, Lr: 0.000300\n", "2020-01-18 05:20:05,659 Epoch 4 Step: 8300 Batch Loss: 2.401777 Tokens per Sec: 10787, Lr: 0.000300\n", "2020-01-18 05:20:25,615 Epoch 4 Step: 8400 Batch Loss: 2.594648 Tokens per Sec: 10766, Lr: 0.000300\n", "2020-01-18 05:20:45,606 Epoch 4 Step: 8500 Batch Loss: 1.926293 Tokens per Sec: 10728, Lr: 0.000300\n", "2020-01-18 05:21:05,501 Epoch 4 Step: 8600 Batch Loss: 2.283063 Tokens per Sec: 10729, Lr: 0.000300\n", "2020-01-18 05:21:25,575 Epoch 4 Step: 8700 Batch Loss: 1.997900 Tokens per Sec: 10745, Lr: 0.000300\n", "2020-01-18 05:21:45,732 Epoch 4 Step: 8800 Batch Loss: 2.060629 Tokens per Sec: 10811, Lr: 0.000300\n", "2020-01-18 05:22:05,774 Epoch 4 Step: 8900 Batch Loss: 2.132430 Tokens per Sec: 10901, Lr: 0.000300\n", "2020-01-18 05:22:25,661 Epoch 4 Step: 9000 Batch Loss: 1.901475 Tokens per Sec: 10450, Lr: 0.000300\n", "2020-01-18 05:23:13,489 Hooray! New best validation result [ppl]!\n", "2020-01-18 05:23:13,490 Saving new checkpoint.\n", "2020-01-18 05:23:15,273 Example #0\n", "2020-01-18 05:23:15,274 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 05:23:15,274 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 05:23:15,274 \tHypothesis: Ma rẹ sae nọ Ọghẹnẹ ọ rẹ sae nọ omai ‘ eva efuafo . ’\n", "2020-01-18 05:23:15,274 Example #1\n", "2020-01-18 05:23:15,274 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 05:23:15,274 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 05:23:15,274 \tHypothesis: A rehọ ovuẹ Uvie na mu hu .\n", "2020-01-18 05:23:15,274 Example #2\n", "2020-01-18 05:23:15,275 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 05:23:15,275 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 05:23:15,275 \tHypothesis: Fikiere , joma ghọghọ fiki eware nọ e be lẹliẹ omai ghọghọ nọ e be were omai gaga , jẹ ta nọ : “ Jọ odẹ riẹ Jesu Kristi Kristi Kristi , re ọ rehọ odẹ riẹ mu , re a ruẹse ruẹ odẹ riẹ , re a jọ bẹdẹ ; keme a rehọ odẹ riẹ mu ei họ , re a jọ etẹe a rọ kẹ ae , re a jọ bẹdẹ .\n", "2020-01-18 05:23:15,275 Example #3\n", "2020-01-18 05:23:15,275 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 05:23:15,275 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 05:23:15,275 \tHypothesis: Ghele na , eme nọ a re se gboja e rẹ lẹliẹ ohwo wo udhedhẹ .\n", "2020-01-18 05:23:15,276 Validation result (greedy) at epoch 4, step 9000: bleu: 18.44, loss: 47067.3672, ppl: 7.6650, duration: 49.6143s\n", "2020-01-18 05:23:35,629 Epoch 4 Step: 9100 Batch Loss: 2.353693 Tokens per Sec: 10613, Lr: 0.000300\n", "2020-01-18 05:23:55,486 Epoch 4 Step: 9200 Batch Loss: 2.002255 Tokens per Sec: 10279, Lr: 0.000300\n", "2020-01-18 05:24:15,544 Epoch 4 Step: 9300 Batch Loss: 2.200109 Tokens per Sec: 10684, Lr: 0.000300\n", "2020-01-18 05:24:32,440 Epoch 4: total training loss 5181.53\n", "2020-01-18 05:24:32,441 EPOCH 5\n", "2020-01-18 05:24:35,962 Epoch 5 Step: 9400 Batch Loss: 2.278134 Tokens per Sec: 10051, Lr: 0.000300\n", "2020-01-18 05:24:56,046 Epoch 5 Step: 9500 Batch Loss: 2.253607 Tokens per Sec: 10796, Lr: 0.000300\n", "2020-01-18 05:25:16,141 Epoch 5 Step: 9600 Batch Loss: 2.052938 Tokens per Sec: 10605, Lr: 0.000300\n", "2020-01-18 05:25:36,120 Epoch 5 Step: 9700 Batch Loss: 2.045638 Tokens per Sec: 10686, Lr: 0.000300\n", "2020-01-18 05:25:56,081 Epoch 5 Step: 9800 Batch Loss: 2.091621 Tokens per Sec: 10901, Lr: 0.000300\n", "2020-01-18 05:26:16,105 Epoch 5 Step: 9900 Batch Loss: 1.853025 Tokens per Sec: 10917, Lr: 0.000300\n", "2020-01-18 05:26:35,955 Epoch 5 Step: 10000 Batch Loss: 1.853068 Tokens per Sec: 10674, Lr: 0.000300\n", "2020-01-18 05:27:23,888 Hooray! New best validation result [ppl]!\n", "2020-01-18 05:27:23,889 Saving new checkpoint.\n", "2020-01-18 05:27:25,693 Example #0\n", "2020-01-18 05:27:25,694 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 05:27:25,694 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 05:27:25,694 \tHypothesis: Ma rẹ sae nọ Ọghẹnẹ ọ rẹ sae nọ omai ‘ ma rọ eva efuafo . ’\n", "2020-01-18 05:27:25,694 Example #1\n", "2020-01-18 05:27:25,694 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 05:27:25,695 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 05:27:25,695 \tHypothesis: Onana o jọ oka ovuẹ Uvie na ha .\n", "2020-01-18 05:27:25,695 Example #2\n", "2020-01-18 05:27:25,695 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 05:27:25,695 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 05:27:25,695 \tHypothesis: Fikiere , joma ghọghọ fiki oghọghọ mai nọ ma te ruẹ evaọ oria nana , onọ o be kẹ omai evawere : “ Jọ odẹ riẹ , [ Jesu Kristi ] o re ti ru odẹ riẹ bẹdẹ ; re a rehọ odẹ riẹ mu , re a rehọ odẹ riẹ , re a rehọ odẹ riẹ kẹ ae bẹdẹ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .\n", "2020-01-18 05:27:25,695 Example #3\n", "2020-01-18 05:27:25,696 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 05:27:25,696 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 05:27:25,696 \tHypothesis: Ghele na , eme nọ a re se gboja e rẹ jọ ọbọga kẹ udhedhẹ .\n", "2020-01-18 05:27:25,696 Validation result (greedy) at epoch 5, step 10000: bleu: 19.84, loss: 45932.4531, ppl: 7.2977, duration: 49.7410s\n", "2020-01-18 05:27:46,328 Epoch 5 Step: 10100 Batch Loss: 1.873614 Tokens per Sec: 10799, Lr: 0.000300\n", "2020-01-18 05:28:06,310 Epoch 5 Step: 10200 Batch Loss: 2.151208 Tokens per Sec: 10838, Lr: 0.000300\n", "2020-01-18 05:28:26,371 Epoch 5 Step: 10300 Batch Loss: 1.881412 Tokens per Sec: 10640, Lr: 0.000300\n", "2020-01-18 05:28:46,230 Epoch 5 Step: 10400 Batch Loss: 2.166464 Tokens per Sec: 10924, Lr: 0.000300\n", "2020-01-18 05:29:06,327 Epoch 5 Step: 10500 Batch Loss: 1.936636 Tokens per Sec: 10694, Lr: 0.000300\n", "2020-01-18 05:29:26,262 Epoch 5 Step: 10600 Batch Loss: 1.828373 Tokens per Sec: 10832, Lr: 0.000300\n", "2020-01-18 05:29:46,373 Epoch 5 Step: 10700 Batch Loss: 2.068016 Tokens per Sec: 10888, Lr: 0.000300\n", "2020-01-18 05:30:06,348 Epoch 5 Step: 10800 Batch Loss: 2.007430 Tokens per Sec: 10768, Lr: 0.000300\n", "2020-01-18 05:30:26,464 Epoch 5 Step: 10900 Batch Loss: 2.108883 Tokens per Sec: 10666, Lr: 0.000300\n", "2020-01-18 05:30:46,496 Epoch 5 Step: 11000 Batch Loss: 2.115098 Tokens per Sec: 10892, Lr: 0.000300\n", "2020-01-18 05:31:34,400 Hooray! New best validation result [ppl]!\n", "2020-01-18 05:31:34,400 Saving new checkpoint.\n", "2020-01-18 05:31:36,370 Example #0\n", "2020-01-18 05:31:36,371 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 05:31:36,371 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 05:31:36,371 \tHypothesis: Ma rẹ sae jẹ nọ Ọghẹnẹ ọ rẹ sae nọ omai ‘ ma ma eva efuafo . ’\n", "2020-01-18 05:31:36,371 Example #1\n", "2020-01-18 05:31:36,371 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 05:31:36,371 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 05:31:36,371 \tHypothesis: Onana u ru nọ a ro lele ovuẹ Uvie na ha .\n", "2020-01-18 05:31:36,371 Example #2\n", "2020-01-18 05:31:36,372 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 05:31:36,372 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 05:31:36,372 \tHypothesis: Fikiere , mai kpobi ma te ghọghọ fiki eware nọ e rẹ kẹ omai evawere nọ ma te ruẹ evaọ oria nana , yọ ile nọ a rẹ jọ ruẹ ude - oruẹ gbe ile nana : “ Jọ odẹ riẹ Jesu Kristi o rọ eva rai kpobi , re a jọ eva odẹ riẹ , re a jọ eva odẹ riẹ kẹ ae bẹdẹ bẹdẹ bẹdẹ ; keme a rẹ te jọ isẹi riẹ o rọ odẹ riẹ kpobi a rẹ te jọ bẹdẹ bẹdẹ bẹdẹ .\n", "2020-01-18 05:31:36,372 Example #3\n", "2020-01-18 05:31:36,372 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 05:31:36,372 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 05:31:36,372 \tHypothesis: Ghele na , eme nọ a re se i re fi obọ họ kẹ ohwo wo udhedhẹ .\n", "2020-01-18 05:31:36,372 Validation result (greedy) at epoch 5, step 11000: bleu: 20.71, loss: 44678.6953, ppl: 6.9123, duration: 49.8761s\n", "2020-01-18 05:31:56,868 Epoch 5 Step: 11100 Batch Loss: 1.990384 Tokens per Sec: 10622, Lr: 0.000300\n", "2020-01-18 05:32:16,644 Epoch 5 Step: 11200 Batch Loss: 1.764206 Tokens per Sec: 10742, Lr: 0.000300\n", "2020-01-18 05:32:36,622 Epoch 5 Step: 11300 Batch Loss: 2.104237 Tokens per Sec: 10463, Lr: 0.000300\n", "2020-01-18 05:32:56,643 Epoch 5 Step: 11400 Batch Loss: 1.747144 Tokens per Sec: 10644, Lr: 0.000300\n", "2020-01-18 05:33:16,674 Epoch 5 Step: 11500 Batch Loss: 1.942783 Tokens per Sec: 10745, Lr: 0.000300\n", "2020-01-18 05:33:36,526 Epoch 5 Step: 11600 Batch Loss: 1.957734 Tokens per Sec: 10617, Lr: 0.000300\n", "2020-01-18 05:33:56,589 Epoch 5 Step: 11700 Batch Loss: 1.823954 Tokens per Sec: 10682, Lr: 0.000300\n", "2020-01-18 05:34:01,358 Epoch 5: total training loss 4750.37\n", "2020-01-18 05:34:01,358 EPOCH 6\n", "2020-01-18 05:34:16,770 Epoch 6 Step: 11800 Batch Loss: 1.960184 Tokens per Sec: 10662, Lr: 0.000300\n", "2020-01-18 05:34:36,617 Epoch 6 Step: 11900 Batch Loss: 1.922006 Tokens per Sec: 10468, Lr: 0.000300\n", "2020-01-18 05:34:56,720 Epoch 6 Step: 12000 Batch Loss: 2.018655 Tokens per Sec: 10755, Lr: 0.000300\n", "2020-01-18 05:35:44,600 Hooray! New best validation result [ppl]!\n", "2020-01-18 05:35:44,601 Saving new checkpoint.\n", "2020-01-18 05:35:46,509 Example #0\n", "2020-01-18 05:35:46,509 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 05:35:46,509 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 05:35:46,510 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ rehọ eva efuafo kẹ omai . ’\n", "2020-01-18 05:35:46,510 Example #1\n", "2020-01-18 05:35:46,510 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 05:35:46,510 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 05:35:46,510 \tHypothesis: Onana u ru nọ a ro lele ovuẹ Uvie na ha .\n", "2020-01-18 05:35:46,510 Example #2\n", "2020-01-18 05:35:46,511 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 05:35:46,511 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 05:35:46,511 \tHypothesis: Fikiere , re mai kpobi ma sae ghọghọ eva oma mai kẹ eware nọ e be via na , ma vẹ jẹ ruẹ ole urirẹ nana : “ Jọ odẹ riẹ [ Kristi ] o te ti wo odẹ riẹ bẹdẹ ; re a rehọ odẹ riẹ mu ei họ ehru bẹdẹ ; re a rehọ odẹ riẹ mu ei họ ehru ehru ehru .\n", "2020-01-18 05:35:46,511 Example #3\n", "2020-01-18 05:35:46,512 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 05:35:46,512 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 05:35:46,512 \tHypothesis: Ghele na , eme - uwou - odi e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 05:35:46,512 Validation result (greedy) at epoch 6, step 12000: bleu: 21.65, loss: 43474.6328, ppl: 6.5614, duration: 49.7919s\n", "2020-01-18 05:36:06,850 Epoch 6 Step: 12100 Batch Loss: 1.981416 Tokens per Sec: 10491, Lr: 0.000300\n", "2020-01-18 05:36:26,660 Epoch 6 Step: 12200 Batch Loss: 2.067845 Tokens per Sec: 10843, Lr: 0.000300\n", "2020-01-18 05:36:46,801 Epoch 6 Step: 12300 Batch Loss: 1.542629 Tokens per Sec: 10665, Lr: 0.000300\n", "2020-01-18 05:37:07,013 Epoch 6 Step: 12400 Batch Loss: 1.597100 Tokens per Sec: 10658, Lr: 0.000300\n", "2020-01-18 05:37:27,025 Epoch 6 Step: 12500 Batch Loss: 2.004372 Tokens per Sec: 10652, Lr: 0.000300\n", "2020-01-18 05:37:46,981 Epoch 6 Step: 12600 Batch Loss: 2.014840 Tokens per Sec: 10768, Lr: 0.000300\n", "2020-01-18 05:38:06,984 Epoch 6 Step: 12700 Batch Loss: 1.467613 Tokens per Sec: 10753, Lr: 0.000300\n", "2020-01-18 05:38:26,876 Epoch 6 Step: 12800 Batch Loss: 2.131567 Tokens per Sec: 10517, Lr: 0.000300\n", "2020-01-18 05:38:46,640 Epoch 6 Step: 12900 Batch Loss: 1.816798 Tokens per Sec: 10743, Lr: 0.000300\n", "2020-01-18 05:39:06,783 Epoch 6 Step: 13000 Batch Loss: 1.870493 Tokens per Sec: 11086, Lr: 0.000300\n", "2020-01-18 05:39:54,699 Hooray! New best validation result [ppl]!\n", "2020-01-18 05:39:54,700 Saving new checkpoint.\n", "2020-01-18 05:39:56,632 Example #0\n", "2020-01-18 05:39:56,632 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 05:39:56,633 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 05:39:56,633 \tHypothesis: Ma rẹ sae nọ Ọghẹnẹ ọ rẹ sae nọ omai ‘ eva efuafo . ’\n", "2020-01-18 05:39:56,633 Example #1\n", "2020-01-18 05:39:56,633 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 05:39:56,633 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 05:39:56,634 \tHypothesis: Onana u lele ovuẹ Uvie na no .\n", "2020-01-18 05:39:56,634 Example #2\n", "2020-01-18 05:39:56,635 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 05:39:56,635 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 05:39:56,635 \tHypothesis: Fikiere , mai kpobi ma te ghọghọ fiki oghọghọ nọ ma be so ole nana avọ ole oghọghọ nọ o rrọ urirẹ : “ Jọ odẹ Jesu Kristi Ovie na o lo , re o lo bẹdẹ bẹdẹ bẹdẹ bẹdẹ bẹdẹ , re o jiri ei bẹdẹ bẹdẹ .\n", "2020-01-18 05:39:56,636 Example #3\n", "2020-01-18 05:39:56,636 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 05:39:56,636 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 05:39:56,636 \tHypothesis: Ghele na , eme nọ a re se okpa họ ẹgba nọ a re ro ru udhedhẹ .\n", "2020-01-18 05:39:56,636 Validation result (greedy) at epoch 6, step 13000: bleu: 22.07, loss: 42439.7539, ppl: 6.2741, duration: 49.8530s\n", "2020-01-18 05:40:16,951 Epoch 6 Step: 13100 Batch Loss: 1.813626 Tokens per Sec: 10361, Lr: 0.000300\n", "2020-01-18 05:40:37,285 Epoch 6 Step: 13200 Batch Loss: 1.948243 Tokens per Sec: 10910, Lr: 0.000300\n", "2020-01-18 05:40:57,313 Epoch 6 Step: 13300 Batch Loss: 1.789862 Tokens per Sec: 10693, Lr: 0.000300\n", "2020-01-18 05:41:17,183 Epoch 6 Step: 13400 Batch Loss: 2.001313 Tokens per Sec: 10833, Lr: 0.000300\n", "2020-01-18 05:41:37,173 Epoch 6 Step: 13500 Batch Loss: 1.998041 Tokens per Sec: 10777, Lr: 0.000300\n", "2020-01-18 05:41:57,214 Epoch 6 Step: 13600 Batch Loss: 2.002583 Tokens per Sec: 10807, Lr: 0.000300\n", "2020-01-18 05:42:17,055 Epoch 6 Step: 13700 Batch Loss: 1.826828 Tokens per Sec: 10522, Lr: 0.000300\n", "2020-01-18 05:42:37,221 Epoch 6 Step: 13800 Batch Loss: 1.671089 Tokens per Sec: 10995, Lr: 0.000300\n", "2020-01-18 05:42:57,033 Epoch 6 Step: 13900 Batch Loss: 1.659511 Tokens per Sec: 10748, Lr: 0.000300\n", "2020-01-18 05:43:17,034 Epoch 6 Step: 14000 Batch Loss: 1.789781 Tokens per Sec: 10561, Lr: 0.000300\n", "2020-01-18 05:44:04,927 Hooray! New best validation result [ppl]!\n", "2020-01-18 05:44:04,928 Saving new checkpoint.\n", "2020-01-18 05:44:06,866 Example #0\n", "2020-01-18 05:44:06,867 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 05:44:06,867 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 05:44:06,867 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu . ’\n", "2020-01-18 05:44:06,868 Example #1\n", "2020-01-18 05:44:06,868 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 05:44:06,869 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 05:44:06,869 \tHypothesis: Onana u lele ovuẹ Uvie na nọ a re se orọnikọ orọ he .\n", "2020-01-18 05:44:06,869 Example #2\n", "2020-01-18 05:44:06,870 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 05:44:06,870 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 05:44:06,870 \tHypothesis: Evaọ edhere nọ ma re ro ru omai kpobi , ma ve ti wo oghọghọ nọ ma wo evaọ ole nana gbe ole nọ e vọ avọ evawere : “ Jọ odẹ riẹ [ Jesu Kristi ] o re ti ru odẹ riẹ , re ma jọ bẹdẹ bẹdẹ bẹdẹ bẹdẹ ; re ma jọ eva aro riẹ ru odẹ riẹ , re ma jọ bẹdẹ bẹdẹ bẹdẹ bẹdẹ bẹdẹ , re ma jọ bẹdẹ bẹdẹ bẹdẹ bẹdẹ , re ti wo oghale ebẹdẹ bẹdẹ , re ma jọ bẹdẹ , re jiri ei , re ma jọ bẹdẹ bẹdẹ\n", "2020-01-18 05:44:06,870 Example #3\n", "2020-01-18 05:44:06,871 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 05:44:06,871 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 05:44:06,871 \tHypothesis: Ghele na , eme nọ i re fi obọ họ kẹ ohwo wo udhedhẹ .\n", "2020-01-18 05:44:06,871 Validation result (greedy) at epoch 6, step 14000: bleu: 22.58, loss: 42425.4609, ppl: 6.2702, duration: 49.8369s\n", "2020-01-18 05:44:21,463 Epoch 6: total training loss 4457.03\n", "2020-01-18 05:44:21,463 EPOCH 7\n", "2020-01-18 05:44:27,445 Epoch 7 Step: 14100 Batch Loss: 1.841474 Tokens per Sec: 10145, Lr: 0.000300\n", "2020-01-18 05:44:47,612 Epoch 7 Step: 14200 Batch Loss: 1.872432 Tokens per Sec: 10631, Lr: 0.000300\n", "2020-01-18 05:45:07,420 Epoch 7 Step: 14300 Batch Loss: 1.850478 Tokens per Sec: 10608, Lr: 0.000300\n", "2020-01-18 05:45:27,460 Epoch 7 Step: 14400 Batch Loss: 1.656556 Tokens per Sec: 10991, Lr: 0.000300\n", "2020-01-18 05:45:47,458 Epoch 7 Step: 14500 Batch Loss: 1.867053 Tokens per Sec: 10513, Lr: 0.000300\n", "2020-01-18 05:46:07,427 Epoch 7 Step: 14600 Batch Loss: 1.794798 Tokens per Sec: 10620, Lr: 0.000300\n", "2020-01-18 05:46:27,327 Epoch 7 Step: 14700 Batch Loss: 2.077128 Tokens per Sec: 10462, Lr: 0.000300\n", "2020-01-18 05:46:47,390 Epoch 7 Step: 14800 Batch Loss: 1.759184 Tokens per Sec: 10833, Lr: 0.000300\n", "2020-01-18 05:47:07,571 Epoch 7 Step: 14900 Batch Loss: 1.965192 Tokens per Sec: 10473, Lr: 0.000300\n", "2020-01-18 05:47:27,678 Epoch 7 Step: 15000 Batch Loss: 1.827376 Tokens per Sec: 10800, Lr: 0.000300\n", "2020-01-18 05:48:15,689 Hooray! New best validation result [ppl]!\n", "2020-01-18 05:48:15,690 Saving new checkpoint.\n", "2020-01-18 05:48:17,499 Example #0\n", "2020-01-18 05:48:17,499 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 05:48:17,499 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 05:48:17,500 \tHypothesis: Ma rẹ sae tubẹ nọ Ọghẹnẹ nọ ọ rẹ kẹ omai ‘ udu oruọzewọ . ’\n", "2020-01-18 05:48:17,500 Example #1\n", "2020-01-18 05:48:17,500 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 05:48:17,500 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 05:48:17,500 \tHypothesis: Onana u te lele ovuẹ Uvie na ha .\n", "2020-01-18 05:48:17,500 Example #2\n", "2020-01-18 05:48:17,500 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 05:48:17,501 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 05:48:17,501 \tHypothesis: ( Olezi 119 : 1 ) Fikiere , mai kpobi ma te ghọghọ fiki eme nọ e rrọ ole nana , nọ e rẹ kẹ omosasọ : “ Jọ odẹ riẹ [ Jesu Ovie na ] o re ti wo oghale ebẹdẹ bẹdẹ ; re a ruẹse ghale odẹ riẹ bẹdẹ bẹdẹ bẹdẹ , re o jọ bẹdẹ bẹdẹ bẹdẹ bẹdẹ .\n", "2020-01-18 05:48:17,501 Example #3\n", "2020-01-18 05:48:17,501 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 05:48:17,501 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 05:48:17,501 \tHypothesis: Ghele na , eme nọ a re se eviẹ - uwou e rẹ bọ udhedhẹ .\n", "2020-01-18 05:48:17,501 Validation result (greedy) at epoch 7, step 15000: bleu: 23.28, loss: 41134.4961, ppl: 5.9295, duration: 49.8231s\n", "2020-01-18 05:48:38,066 Epoch 7 Step: 15100 Batch Loss: 1.485458 Tokens per Sec: 10800, Lr: 0.000300\n", "2020-01-18 05:48:58,279 Epoch 7 Step: 15200 Batch Loss: 2.005208 Tokens per Sec: 10684, Lr: 0.000300\n", "2020-01-18 05:49:18,053 Epoch 7 Step: 15300 Batch Loss: 2.055413 Tokens per Sec: 10667, Lr: 0.000300\n", "2020-01-18 05:49:37,799 Epoch 7 Step: 15400 Batch Loss: 1.936713 Tokens per Sec: 10382, Lr: 0.000300\n", "2020-01-18 05:49:58,023 Epoch 7 Step: 15500 Batch Loss: 1.531119 Tokens per Sec: 10859, Lr: 0.000300\n", "2020-01-18 05:50:18,081 Epoch 7 Step: 15600 Batch Loss: 1.949427 Tokens per Sec: 10695, Lr: 0.000300\n", "2020-01-18 05:50:38,224 Epoch 7 Step: 15700 Batch Loss: 1.940830 Tokens per Sec: 10901, Lr: 0.000300\n", "2020-01-18 05:50:58,297 Epoch 7 Step: 15800 Batch Loss: 1.863669 Tokens per Sec: 10763, Lr: 0.000300\n", "2020-01-18 05:51:18,520 Epoch 7 Step: 15900 Batch Loss: 1.949780 Tokens per Sec: 10573, Lr: 0.000300\n", "2020-01-18 05:51:38,437 Epoch 7 Step: 16000 Batch Loss: 1.877936 Tokens per Sec: 10612, Lr: 0.000300\n", "2020-01-18 05:52:26,326 Hooray! New best validation result [ppl]!\n", "2020-01-18 05:52:26,326 Saving new checkpoint.\n", "2020-01-18 05:52:28,138 Example #0\n", "2020-01-18 05:52:28,139 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 05:52:28,139 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 05:52:28,139 \tHypothesis: Ma rẹ sae yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu oruọzewọ . ’\n", "2020-01-18 05:52:28,139 Example #1\n", "2020-01-18 05:52:28,139 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 05:52:28,139 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 05:52:28,140 \tHypothesis: Onana o jọ oka nọ a ro mu omobe - ovẹvẹ Uvie na họ .\n", "2020-01-18 05:52:28,140 Example #2\n", "2020-01-18 05:52:28,140 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 05:52:28,140 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 05:52:28,140 \tHypothesis: Evaọ oghẹrẹ nọ ma te rọ ghọghọ , ma ve ti fiba edo ole nana nọ o bi nuhu na , ọ tẹ jẹ ta nọ : “ Jọ odẹ riẹ [ Ovie ] na o re ti dhesẹ oruaro riẹ , re ma ve ti jiri odẹ riẹ , re a ve ti jiri ei , re ti jiri ai re a ve ti jiri ei kẹ eruẹaro riẹ a ve ti jiri ei , re ti jiri ai kpobi a ve ti jiri ei re ti jiri ei re ti jiri ei re a ve ti jiri ai\n", "2020-01-18 05:52:28,140 Example #3\n", "2020-01-18 05:52:28,140 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 05:52:28,140 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 05:52:28,141 \tHypothesis: Ghele na , eme nọ i re duobọte ohwo udu nọ o re ro ru udhedhẹ .\n", "2020-01-18 05:52:28,141 Validation result (greedy) at epoch 7, step 16000: bleu: 24.16, loss: 40746.8008, ppl: 5.8309, duration: 49.7030s\n", "2020-01-18 05:52:48,478 Epoch 7 Step: 16100 Batch Loss: 1.585990 Tokens per Sec: 10493, Lr: 0.000300\n", "2020-01-18 05:53:08,434 Epoch 7 Step: 16200 Batch Loss: 1.652171 Tokens per Sec: 10653, Lr: 0.000300\n", "2020-01-18 05:53:28,720 Epoch 7 Step: 16300 Batch Loss: 2.040347 Tokens per Sec: 10958, Lr: 0.000300\n", "2020-01-18 05:53:48,829 Epoch 7 Step: 16400 Batch Loss: 1.676087 Tokens per Sec: 10710, Lr: 0.000300\n", "2020-01-18 05:53:53,073 Epoch 7: total training loss 4240.16\n", "2020-01-18 05:53:53,074 EPOCH 8\n", "2020-01-18 05:54:09,078 Epoch 8 Step: 16500 Batch Loss: 1.245923 Tokens per Sec: 10317, Lr: 0.000300\n", "2020-01-18 05:54:29,145 Epoch 8 Step: 16600 Batch Loss: 1.805567 Tokens per Sec: 11023, Lr: 0.000300\n", "2020-01-18 05:54:49,386 Epoch 8 Step: 16700 Batch Loss: 1.692395 Tokens per Sec: 10685, Lr: 0.000300\n", "2020-01-18 05:55:09,411 Epoch 8 Step: 16800 Batch Loss: 1.592851 Tokens per Sec: 10780, Lr: 0.000300\n", "2020-01-18 05:55:29,561 Epoch 8 Step: 16900 Batch Loss: 1.697161 Tokens per Sec: 10824, Lr: 0.000300\n", "2020-01-18 05:55:49,385 Epoch 8 Step: 17000 Batch Loss: 1.731798 Tokens per Sec: 10779, Lr: 0.000300\n", "2020-01-18 05:56:37,254 Hooray! New best validation result [ppl]!\n", "2020-01-18 05:56:37,254 Saving new checkpoint.\n", "2020-01-18 05:56:39,106 Example #0\n", "2020-01-18 05:56:39,107 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 05:56:39,107 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 05:56:39,107 \tHypothesis: Ma rẹ sae tubẹ nọ Ọghẹnẹ ọ rẹ ‘ ma omai evaọ udu mai . ’\n", "2020-01-18 05:56:39,107 Example #1\n", "2020-01-18 05:56:39,108 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 05:56:39,108 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 05:56:39,108 \tHypothesis: Onana u lele ovuẹ Uvie na , orọnikọ Ijo .\n", "2020-01-18 05:56:39,108 Example #2\n", "2020-01-18 05:56:39,109 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 05:56:39,109 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 05:56:39,109 \tHypothesis: Fikiere , joma ghọghọ eva oke urere nana avọ ole urirẹ nana , jẹ ta nọ : “ Jọ odẹ riẹ [ Jesu Kristi ] o jọ bẹdẹ bẹdẹ , re a jọ odẹ riẹ ruẹ ọre ebẹdẹ bẹdẹ ; re a rehọ odẹ riẹ jiri ei , re a jọ bẹdẹ bẹdẹ . . .\n", "2020-01-18 05:56:39,109 Example #3\n", "2020-01-18 05:56:39,110 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 05:56:39,110 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 05:56:39,110 \tHypothesis: Ghele na , eme - unu i re duobọte ohwo udu nọ o re ro ru udhedhẹ .\n", "2020-01-18 05:56:39,110 Validation result (greedy) at epoch 8, step 17000: bleu: 24.70, loss: 40108.5781, ppl: 5.6720, duration: 49.7242s\n", "2020-01-18 05:56:59,488 Epoch 8 Step: 17100 Batch Loss: 1.567477 Tokens per Sec: 10577, Lr: 0.000300\n", "2020-01-18 05:57:19,244 Epoch 8 Step: 17200 Batch Loss: 1.594132 Tokens per Sec: 10449, Lr: 0.000300\n", "2020-01-18 05:57:39,225 Epoch 8 Step: 17300 Batch Loss: 1.583733 Tokens per Sec: 10823, Lr: 0.000300\n", "2020-01-18 05:57:58,935 Epoch 8 Step: 17400 Batch Loss: 1.748768 Tokens per Sec: 10589, Lr: 0.000300\n", "2020-01-18 05:58:19,005 Epoch 8 Step: 17500 Batch Loss: 1.768951 Tokens per Sec: 10666, Lr: 0.000300\n", "2020-01-18 05:58:39,044 Epoch 8 Step: 17600 Batch Loss: 1.464271 Tokens per Sec: 10819, Lr: 0.000300\n", "2020-01-18 05:58:59,064 Epoch 8 Step: 17700 Batch Loss: 1.850798 Tokens per Sec: 10608, Lr: 0.000300\n", "2020-01-18 05:59:19,074 Epoch 8 Step: 17800 Batch Loss: 1.850773 Tokens per Sec: 10848, Lr: 0.000300\n", "2020-01-18 05:59:39,122 Epoch 8 Step: 17900 Batch Loss: 1.747395 Tokens per Sec: 10869, Lr: 0.000300\n", "2020-01-18 05:59:59,064 Epoch 8 Step: 18000 Batch Loss: 1.871414 Tokens per Sec: 10711, Lr: 0.000300\n", "2020-01-18 06:00:46,966 Hooray! New best validation result [ppl]!\n", "2020-01-18 06:00:46,967 Saving new checkpoint.\n", "2020-01-18 06:00:48,943 Example #0\n", "2020-01-18 06:00:48,944 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 06:00:48,944 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 06:00:48,945 \tHypothesis: Ma rẹ sae tubẹ nọ Ọghẹnẹ ọ rẹ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 06:00:48,945 Example #1\n", "2020-01-18 06:00:48,945 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 06:00:48,946 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 06:00:48,946 \tHypothesis: Onana u te ru nọ a rọ rehọ omobe - ovẹvẹ Uvie na mu hu .\n", "2020-01-18 06:00:48,946 Example #2\n", "2020-01-18 06:00:48,947 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 06:00:48,947 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 06:00:48,947 \tHypothesis: Fikiere , eva e te were omai kpobi nọ ma te bi horie eva mai kẹ abọ urere nana gbe ole oghọghọ nọ o rẹ kẹ evawere : “ Jọ odẹ [ Jesu Kristi ] Ovie na [ Kristi ] o re ti dhesẹ odẹ riẹ bẹdẹ bẹdẹ ; re o jọ bẹdẹ bẹdẹ bẹdẹ , re a jiri ei , re ọ ghale erẹwho na kpobi .\n", "2020-01-18 06:00:48,947 Example #3\n", "2020-01-18 06:00:48,948 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 06:00:48,948 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 06:00:48,948 \tHypothesis: Ghele na , eme uwou - eki e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 06:00:48,948 Validation result (greedy) at epoch 8, step 18000: bleu: 24.90, loss: 39395.8359, ppl: 5.4998, duration: 49.8837s\n", "2020-01-18 06:01:09,279 Epoch 8 Step: 18100 Batch Loss: 1.761263 Tokens per Sec: 10330, Lr: 0.000300\n", "2020-01-18 06:01:29,428 Epoch 8 Step: 18200 Batch Loss: 1.492776 Tokens per Sec: 10656, Lr: 0.000300\n", "2020-01-18 06:01:49,715 Epoch 8 Step: 18300 Batch Loss: 1.733003 Tokens per Sec: 11094, Lr: 0.000300\n", "2020-01-18 06:02:09,845 Epoch 8 Step: 18400 Batch Loss: 1.656059 Tokens per Sec: 10734, Lr: 0.000300\n", "2020-01-18 06:02:29,851 Epoch 8 Step: 18500 Batch Loss: 1.653363 Tokens per Sec: 10523, Lr: 0.000300\n", "2020-01-18 06:02:50,032 Epoch 8 Step: 18600 Batch Loss: 1.668311 Tokens per Sec: 10621, Lr: 0.000300\n", "2020-01-18 06:03:10,202 Epoch 8 Step: 18700 Batch Loss: 1.881935 Tokens per Sec: 10770, Lr: 0.000300\n", "2020-01-18 06:03:23,219 Epoch 8: total training loss 4044.46\n", "2020-01-18 06:03:23,219 EPOCH 9\n", "2020-01-18 06:03:30,551 Epoch 9 Step: 18800 Batch Loss: 1.718734 Tokens per Sec: 10197, Lr: 0.000300\n", "2020-01-18 06:03:50,759 Epoch 9 Step: 18900 Batch Loss: 1.830535 Tokens per Sec: 10837, Lr: 0.000300\n", "2020-01-18 06:04:10,832 Epoch 9 Step: 19000 Batch Loss: 1.695226 Tokens per Sec: 10860, Lr: 0.000300\n", "2020-01-18 06:04:58,846 Hooray! New best validation result [ppl]!\n", "2020-01-18 06:04:58,847 Saving new checkpoint.\n", "2020-01-18 06:05:00,626 Example #0\n", "2020-01-18 06:05:00,627 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 06:05:00,627 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 06:05:00,627 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 06:05:00,627 Example #1\n", "2020-01-18 06:05:00,628 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 06:05:00,628 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 06:05:00,628 \tHypothesis: A te je lele iei ta usiuwoma Uvie na ha .\n", "2020-01-18 06:05:00,628 Example #2\n", "2020-01-18 06:05:00,629 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 06:05:00,629 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 06:05:00,629 \tHypothesis: Fikiere , mai kpobi ma te ghọghọ te epanọ ma te rọ so ole nana avọ ole urirẹ nana nọ e rrọ ole nana : “ Jọ odẹ [ Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; re a jọ odẹ riẹ ghọghọ , re a jọ bẹdẹ bẹdẹ bẹdẹ bẹdẹ , re a rehọ odẹ riẹ jiri ei .\n", "2020-01-18 06:05:00,629 Example #3\n", "2020-01-18 06:05:00,629 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 06:05:00,629 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 06:05:00,629 \tHypothesis: Ghele na , eme uwou - uwou - odi e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 06:05:00,630 Validation result (greedy) at epoch 9, step 19000: bleu: 25.17, loss: 39077.6328, ppl: 5.4246, duration: 49.7967s\n", "2020-01-18 06:05:21,324 Epoch 9 Step: 19100 Batch Loss: 1.665095 Tokens per Sec: 10582, Lr: 0.000300\n", "2020-01-18 06:05:41,524 Epoch 9 Step: 19200 Batch Loss: 1.783295 Tokens per Sec: 10749, Lr: 0.000300\n", "2020-01-18 06:06:01,441 Epoch 9 Step: 19300 Batch Loss: 1.727905 Tokens per Sec: 10600, Lr: 0.000300\n", "2020-01-18 06:06:21,514 Epoch 9 Step: 19400 Batch Loss: 1.631455 Tokens per Sec: 10636, Lr: 0.000300\n", "2020-01-18 06:06:41,524 Epoch 9 Step: 19500 Batch Loss: 1.668850 Tokens per Sec: 10782, Lr: 0.000300\n", "2020-01-18 06:07:01,558 Epoch 9 Step: 19600 Batch Loss: 1.583359 Tokens per Sec: 10710, Lr: 0.000300\n", "2020-01-18 06:07:21,605 Epoch 9 Step: 19700 Batch Loss: 1.729663 Tokens per Sec: 10691, Lr: 0.000300\n", "2020-01-18 06:07:41,862 Epoch 9 Step: 19800 Batch Loss: 1.678271 Tokens per Sec: 10913, Lr: 0.000300\n", "2020-01-18 06:08:01,866 Epoch 9 Step: 19900 Batch Loss: 1.993254 Tokens per Sec: 10648, Lr: 0.000300\n", "2020-01-18 06:08:21,813 Epoch 9 Step: 20000 Batch Loss: 1.816716 Tokens per Sec: 10817, Lr: 0.000300\n", "2020-01-18 06:09:09,747 Hooray! New best validation result [ppl]!\n", "2020-01-18 06:09:09,747 Saving new checkpoint.\n", "2020-01-18 06:09:11,563 Example #0\n", "2020-01-18 06:09:11,563 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 06:09:11,564 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 06:09:11,564 \tHypothesis: Ma rẹ sae tubẹ nọ Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 06:09:11,564 Example #1\n", "2020-01-18 06:09:11,564 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 06:09:11,564 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 06:09:11,564 \tHypothesis: Onana u te je lele ovuẹ Uvie na , Ọrọ Ijo .\n", "2020-01-18 06:09:11,564 Example #2\n", "2020-01-18 06:09:11,565 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 06:09:11,565 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 06:09:11,565 \tHypothesis: Evaọ uzẹme , mai kpobi ma te ghọghọ fiki edo ole nana nọ e rrọ ole urirẹ nana , jẹ be kẹ uyere : “ Jọ odẹ [ Jesu Kristi ] , re a jọ bẹdẹ bẹdẹ bẹdẹ ; re a jiri ei , re a jiri ei , re a jiri erẹwho na kpobi re a jiri ei .\n", "2020-01-18 06:09:11,565 Example #3\n", "2020-01-18 06:09:11,565 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 06:09:11,565 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 06:09:11,565 \tHypothesis: Ghele na , eme uwou - eki e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 06:09:11,566 Validation result (greedy) at epoch 9, step 20000: bleu: 25.33, loss: 38751.5742, ppl: 5.3486, duration: 49.7524s\n", "2020-01-18 06:09:31,830 Epoch 9 Step: 20100 Batch Loss: 1.484097 Tokens per Sec: 10380, Lr: 0.000300\n", "2020-01-18 06:09:51,782 Epoch 9 Step: 20200 Batch Loss: 1.495858 Tokens per Sec: 10436, Lr: 0.000300\n", "2020-01-18 06:10:11,800 Epoch 9 Step: 20300 Batch Loss: 1.741375 Tokens per Sec: 10872, Lr: 0.000300\n", "2020-01-18 06:10:31,765 Epoch 9 Step: 20400 Batch Loss: 1.482388 Tokens per Sec: 10719, Lr: 0.000300\n", "2020-01-18 06:10:51,732 Epoch 9 Step: 20500 Batch Loss: 1.663832 Tokens per Sec: 10550, Lr: 0.000300\n", "2020-01-18 06:11:11,758 Epoch 9 Step: 20600 Batch Loss: 1.604363 Tokens per Sec: 10977, Lr: 0.000300\n", "2020-01-18 06:11:31,855 Epoch 9 Step: 20700 Batch Loss: 1.599837 Tokens per Sec: 10767, Lr: 0.000300\n", "2020-01-18 06:11:51,774 Epoch 9 Step: 20800 Batch Loss: 1.376583 Tokens per Sec: 10633, Lr: 0.000300\n", "2020-01-18 06:12:11,932 Epoch 9 Step: 20900 Batch Loss: 1.682360 Tokens per Sec: 10889, Lr: 0.000300\n", "2020-01-18 06:12:31,856 Epoch 9 Step: 21000 Batch Loss: 1.859462 Tokens per Sec: 10667, Lr: 0.000300\n", "2020-01-18 06:13:19,760 Hooray! New best validation result [ppl]!\n", "2020-01-18 06:13:19,761 Saving new checkpoint.\n", "2020-01-18 06:13:21,725 Example #0\n", "2020-01-18 06:13:21,727 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 06:13:21,727 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 06:13:21,727 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 06:13:21,727 Example #1\n", "2020-01-18 06:13:21,729 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 06:13:21,729 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 06:13:21,729 \tHypothesis: Onana o jọ orọ Usi Uvie Na Ijo .\n", "2020-01-18 06:13:21,730 Example #2\n", "2020-01-18 06:13:21,731 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 06:13:21,731 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 06:13:21,731 \tHypothesis: Fikiere , mai kpobi ma te ghọghọ , ma ve ti ku unu mai họ abọ urere ọrọ ole urirẹ nana gbe ole oghọghọ nọ e rrọ obe na : “ Jọ odẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ bẹdẹ ; re a jiri ei , re a jiri ei .\n", "2020-01-18 06:13:21,731 Example #3\n", "2020-01-18 06:13:21,732 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 06:13:21,732 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 06:13:21,732 \tHypothesis: Ghele na , eme - unu - unu e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 06:13:21,732 Validation result (greedy) at epoch 9, step 21000: bleu: 25.50, loss: 38392.2227, ppl: 5.2661, duration: 49.8759s\n", "2020-01-18 06:13:41,723 Epoch 9 Step: 21100 Batch Loss: 1.709613 Tokens per Sec: 10449, Lr: 0.000300\n", "2020-01-18 06:13:43,714 Epoch 9: total training loss 3907.16\n", "2020-01-18 06:13:43,715 EPOCH 10\n", "2020-01-18 06:14:02,163 Epoch 10 Step: 21200 Batch Loss: 1.656151 Tokens per Sec: 10789, Lr: 0.000300\n", "2020-01-18 06:14:22,251 Epoch 10 Step: 21300 Batch Loss: 1.189998 Tokens per Sec: 10804, Lr: 0.000300\n", "2020-01-18 06:14:42,337 Epoch 10 Step: 21400 Batch Loss: 1.774541 Tokens per Sec: 10831, Lr: 0.000300\n", "2020-01-18 06:15:02,328 Epoch 10 Step: 21500 Batch Loss: 1.720720 Tokens per Sec: 10779, Lr: 0.000300\n", "2020-01-18 06:15:22,382 Epoch 10 Step: 21600 Batch Loss: 1.721195 Tokens per Sec: 10586, Lr: 0.000300\n", "2020-01-18 06:15:42,387 Epoch 10 Step: 21700 Batch Loss: 1.478782 Tokens per Sec: 10518, Lr: 0.000300\n", "2020-01-18 06:16:02,516 Epoch 10 Step: 21800 Batch Loss: 1.550064 Tokens per Sec: 10540, Lr: 0.000300\n", "2020-01-18 06:16:22,578 Epoch 10 Step: 21900 Batch Loss: 1.570261 Tokens per Sec: 10584, Lr: 0.000300\n", "2020-01-18 06:16:42,470 Epoch 10 Step: 22000 Batch Loss: 1.725858 Tokens per Sec: 10657, Lr: 0.000300\n", "2020-01-18 06:17:30,379 Hooray! New best validation result [ppl]!\n", "2020-01-18 06:17:30,379 Saving new checkpoint.\n", "2020-01-18 06:17:32,561 Example #0\n", "2020-01-18 06:17:32,562 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 06:17:32,562 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 06:17:32,562 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 06:17:32,562 Example #1\n", "2020-01-18 06:17:32,563 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 06:17:32,563 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 06:17:32,563 \tHypothesis: Onana u te ru nọ ma rọ rehọ Uvie na mu hu .\n", "2020-01-18 06:17:32,563 Example #2\n", "2020-01-18 06:17:32,564 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 06:17:32,564 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 06:17:32,564 \tHypothesis: Fikiere , mai kpobi ma te rọ evawere se isẹri mai inọ ma be ruẹ abọ owoma nana gbe ile iwoma nana : “ Jọ odẹ Jesu Kristi Ovie na o jọ bẹdẹ bẹdẹ ; re a jọ bẹdẹ bẹdẹ bẹdẹ , re a jiri odẹ riẹ , re a jiri ei , re a jiri ei , re a jiri ei , re a ruẹse ghale erẹwho kpobi .\n", "2020-01-18 06:17:32,564 Example #3\n", "2020-01-18 06:17:32,565 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 06:17:32,565 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 06:17:32,565 \tHypothesis: Ghele na , eme uwou - eki e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 06:17:32,565 Validation result (greedy) at epoch 10, step 22000: bleu: 25.75, loss: 38281.6562, ppl: 5.2409, duration: 50.0945s\n", "2020-01-18 06:17:52,986 Epoch 10 Step: 22100 Batch Loss: 1.502277 Tokens per Sec: 10662, Lr: 0.000300\n", "2020-01-18 06:18:13,100 Epoch 10 Step: 22200 Batch Loss: 1.533386 Tokens per Sec: 10823, Lr: 0.000300\n", "2020-01-18 06:18:33,084 Epoch 10 Step: 22300 Batch Loss: 1.750031 Tokens per Sec: 10954, Lr: 0.000300\n", "2020-01-18 06:18:53,347 Epoch 10 Step: 22400 Batch Loss: 1.660972 Tokens per Sec: 10630, Lr: 0.000300\n", "2020-01-18 06:19:13,211 Epoch 10 Step: 22500 Batch Loss: 1.474328 Tokens per Sec: 10646, Lr: 0.000300\n", "2020-01-18 06:19:33,355 Epoch 10 Step: 22600 Batch Loss: 1.757831 Tokens per Sec: 10598, Lr: 0.000300\n", "2020-01-18 06:19:53,337 Epoch 10 Step: 22700 Batch Loss: 1.734263 Tokens per Sec: 10659, Lr: 0.000300\n", "2020-01-18 06:20:13,413 Epoch 10 Step: 22800 Batch Loss: 1.606854 Tokens per Sec: 10577, Lr: 0.000300\n", "2020-01-18 06:20:33,467 Epoch 10 Step: 22900 Batch Loss: 1.719287 Tokens per Sec: 10973, Lr: 0.000300\n", "2020-01-18 06:20:53,455 Epoch 10 Step: 23000 Batch Loss: 1.577102 Tokens per Sec: 10894, Lr: 0.000300\n", "2020-01-18 06:21:41,333 Hooray! New best validation result [ppl]!\n", "2020-01-18 06:21:41,333 Saving new checkpoint.\n", "2020-01-18 06:21:43,367 Example #0\n", "2020-01-18 06:21:43,367 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 06:21:43,367 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 06:21:43,368 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 06:21:43,368 Example #1\n", "2020-01-18 06:21:43,368 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 06:21:43,368 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 06:21:43,368 \tHypothesis: Onana o jọ ere ẹkwoma Usi Uvie na Ijo .\n", "2020-01-18 06:21:43,369 Example #2\n", "2020-01-18 06:21:43,369 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 06:21:43,369 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 06:21:43,369 \tHypothesis: Fikiere , mai kpobi ma te ghọghọ fiki edo nọ ma be rọ so ole oghọghọ nana , jẹ be kẹ ole oghọghọ nana : “ Jọ odẹ riẹ [ Jesu Ovie na ] o jọ bẹdẹ bẹdẹ ; re ma ruẹse rehọ odẹ riẹ jiri ei , re o jọ oghale ulogbo kẹ erẹwho kpobi ; re a se isẹi riẹ , re a jiri ei ; keme erẹwho kpobi a rẹ ghale iẹe .\n", "2020-01-18 06:21:43,369 Example #3\n", "2020-01-18 06:21:43,369 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 06:21:43,369 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 06:21:43,369 \tHypothesis: Ghele na , eme - unu e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 06:21:43,370 Validation result (greedy) at epoch 10, step 23000: bleu: 25.67, loss: 37930.9922, ppl: 5.1620, duration: 49.9137s\n", "2020-01-18 06:22:03,830 Epoch 10 Step: 23100 Batch Loss: 1.475272 Tokens per Sec: 10633, Lr: 0.000300\n", "2020-01-18 06:22:23,779 Epoch 10 Step: 23200 Batch Loss: 1.691947 Tokens per Sec: 10772, Lr: 0.000300\n", "2020-01-18 06:22:43,760 Epoch 10 Step: 23300 Batch Loss: 1.729373 Tokens per Sec: 10835, Lr: 0.000300\n", "2020-01-18 06:23:03,562 Epoch 10 Step: 23400 Batch Loss: 1.654450 Tokens per Sec: 10737, Lr: 0.000300\n", "2020-01-18 06:23:14,296 Epoch 10: total training loss 3786.17\n", "2020-01-18 06:23:14,297 EPOCH 11\n", "2020-01-18 06:23:23,646 Epoch 11 Step: 23500 Batch Loss: 1.484642 Tokens per Sec: 10078, Lr: 0.000300\n", "2020-01-18 06:23:43,555 Epoch 11 Step: 23600 Batch Loss: 1.462011 Tokens per Sec: 10807, Lr: 0.000300\n", "2020-01-18 06:24:03,546 Epoch 11 Step: 23700 Batch Loss: 1.657533 Tokens per Sec: 10730, Lr: 0.000300\n", "2020-01-18 06:24:23,476 Epoch 11 Step: 23800 Batch Loss: 1.431029 Tokens per Sec: 10605, Lr: 0.000300\n", "2020-01-18 06:24:43,403 Epoch 11 Step: 23900 Batch Loss: 1.395174 Tokens per Sec: 10739, Lr: 0.000300\n", "2020-01-18 06:25:03,178 Epoch 11 Step: 24000 Batch Loss: 1.568600 Tokens per Sec: 10774, Lr: 0.000300\n", "2020-01-18 06:25:51,060 Hooray! New best validation result [ppl]!\n", "2020-01-18 06:25:51,060 Saving new checkpoint.\n", "2020-01-18 06:25:53,093 Example #0\n", "2020-01-18 06:25:53,094 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 06:25:53,094 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 06:25:53,094 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 06:25:53,094 Example #1\n", "2020-01-18 06:25:53,094 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 06:25:53,094 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 06:25:53,094 \tHypothesis: A ru onana avọ omobe - ovẹvẹ Uvie na ha .\n", "2020-01-18 06:25:53,094 Example #2\n", "2020-01-18 06:25:53,095 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 06:25:53,095 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 06:25:53,095 \tHypothesis: Fikiere , mai kpobi ma te reawere ole oghọghọ nana gbe ole oghọghọ nana : “ Jọ odẹ riẹ [ Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; re a jiri ei , re o ru ai kpobi wo eghale riẹ .\n", "2020-01-18 06:25:53,095 Example #3\n", "2020-01-18 06:25:53,095 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 06:25:53,095 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 06:25:53,095 \tHypothesis: Ghele na , eme - unu e rẹ jọ gaga nọ ma tẹ be rọ udu - uwou ru udhedhẹ .\n", "2020-01-18 06:25:53,096 Validation result (greedy) at epoch 11, step 24000: bleu: 26.36, loss: 37916.4961, ppl: 5.1588, duration: 49.9174s\n", "2020-01-18 06:26:13,723 Epoch 11 Step: 24100 Batch Loss: 1.683333 Tokens per Sec: 10286, Lr: 0.000300\n", "2020-01-18 06:26:33,673 Epoch 11 Step: 24200 Batch Loss: 1.661890 Tokens per Sec: 10690, Lr: 0.000300\n", "2020-01-18 06:26:53,812 Epoch 11 Step: 24300 Batch Loss: 1.673903 Tokens per Sec: 10950, Lr: 0.000300\n", "2020-01-18 06:27:13,798 Epoch 11 Step: 24400 Batch Loss: 1.485886 Tokens per Sec: 10601, Lr: 0.000300\n", "2020-01-18 06:27:33,683 Epoch 11 Step: 24500 Batch Loss: 1.667358 Tokens per Sec: 10828, Lr: 0.000300\n", "2020-01-18 06:27:53,680 Epoch 11 Step: 24600 Batch Loss: 1.545190 Tokens per Sec: 10526, Lr: 0.000300\n", "2020-01-18 06:28:13,590 Epoch 11 Step: 24700 Batch Loss: 1.432198 Tokens per Sec: 10686, Lr: 0.000300\n", "2020-01-18 06:28:33,624 Epoch 11 Step: 24800 Batch Loss: 1.584525 Tokens per Sec: 10982, Lr: 0.000300\n", "2020-01-18 06:28:53,610 Epoch 11 Step: 24900 Batch Loss: 1.403587 Tokens per Sec: 10528, Lr: 0.000300\n", "2020-01-18 06:29:13,611 Epoch 11 Step: 25000 Batch Loss: 1.653786 Tokens per Sec: 10669, Lr: 0.000300\n", "2020-01-18 06:30:01,524 Hooray! New best validation result [ppl]!\n", "2020-01-18 06:30:01,525 Saving new checkpoint.\n", "2020-01-18 06:30:03,544 Example #0\n", "2020-01-18 06:30:03,545 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 06:30:03,545 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 06:30:03,545 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu . ’\n", "2020-01-18 06:30:03,546 Example #1\n", "2020-01-18 06:30:03,546 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 06:30:03,546 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 06:30:03,546 \tHypothesis: A rehọ omobe Usi Uvie na lele iei .\n", "2020-01-18 06:30:03,546 Example #2\n", "2020-01-18 06:30:03,547 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 06:30:03,547 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 06:30:03,547 \tHypothesis: Evaọ abọdekọ riẹ , mai kpobi ma te ghọghọ fiki edo ole nana nọ i wo erru gaga na , jẹ so ole evawere nana : “ Jọ odẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ bẹdẹ ; re o jiri odẹ riẹ , re o jiri ai , re o jiri erẹwho na kpobi ; re a jiri ei .\n", "2020-01-18 06:30:03,547 Example #3\n", "2020-01-18 06:30:03,548 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 06:30:03,548 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 06:30:03,548 \tHypothesis: Ghele na , ẹme uwou - uwou o rẹ jọ ogaga gaga re ma sai wo udhedhẹ .\n", "2020-01-18 06:30:03,548 Validation result (greedy) at epoch 11, step 25000: bleu: 26.57, loss: 37368.5742, ppl: 5.0379, duration: 49.9363s\n", "2020-01-18 06:30:23,774 Epoch 11 Step: 25100 Batch Loss: 1.426818 Tokens per Sec: 10569, Lr: 0.000300\n", "2020-01-18 06:30:43,752 Epoch 11 Step: 25200 Batch Loss: 1.545781 Tokens per Sec: 10679, Lr: 0.000300\n", "2020-01-18 06:31:03,800 Epoch 11 Step: 25300 Batch Loss: 1.684869 Tokens per Sec: 11000, Lr: 0.000300\n", "2020-01-18 06:31:23,938 Epoch 11 Step: 25400 Batch Loss: 1.578326 Tokens per Sec: 10670, Lr: 0.000300\n", "2020-01-18 06:31:43,988 Epoch 11 Step: 25500 Batch Loss: 1.534964 Tokens per Sec: 10772, Lr: 0.000300\n", "2020-01-18 06:32:04,081 Epoch 11 Step: 25600 Batch Loss: 1.693871 Tokens per Sec: 10820, Lr: 0.000300\n", "2020-01-18 06:32:24,142 Epoch 11 Step: 25700 Batch Loss: 1.733857 Tokens per Sec: 10585, Lr: 0.000300\n", "2020-01-18 06:32:44,102 Epoch 11 Step: 25800 Batch Loss: 1.618583 Tokens per Sec: 10733, Lr: 0.000300\n", "2020-01-18 06:32:45,329 Epoch 11: total training loss 3697.05\n", "2020-01-18 06:32:45,329 EPOCH 12\n", "2020-01-18 06:33:04,545 Epoch 12 Step: 25900 Batch Loss: 1.602427 Tokens per Sec: 10460, Lr: 0.000300\n", "2020-01-18 06:33:24,673 Epoch 12 Step: 26000 Batch Loss: 1.319862 Tokens per Sec: 10739, Lr: 0.000300\n", "2020-01-18 06:34:12,476 Hooray! New best validation result [ppl]!\n", "2020-01-18 06:34:12,477 Saving new checkpoint.\n", "2020-01-18 06:34:14,707 Example #0\n", "2020-01-18 06:34:14,708 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 06:34:14,708 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 06:34:14,708 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 06:34:14,708 Example #1\n", "2020-01-18 06:34:14,709 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 06:34:14,709 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 06:34:14,709 \tHypothesis: A te lele iei ta ẹme , Ọrọ Avọ Ijo .\n", "2020-01-18 06:34:14,709 Example #2\n", "2020-01-18 06:34:14,710 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 06:34:14,710 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 06:34:14,710 \tHypothesis: Fikiere , mai kpobi ma te ghọghọ fiki eware nọ ma be rọ so ole oghọghọ nana : “ Jọ odẹ riẹ [ Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; re ọre na o lo , re o jiri ei , re o jiri ai , re a ghale erẹwho kpobi , re a jiri ei .\n", "2020-01-18 06:34:14,710 Example #3\n", "2020-01-18 06:34:14,711 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 06:34:14,711 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 06:34:14,711 \tHypothesis: Ghele na , eme uwou - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 06:34:14,712 Validation result (greedy) at epoch 12, step 26000: bleu: 26.89, loss: 37189.5664, ppl: 4.9990, duration: 50.0379s\n", "2020-01-18 06:34:34,938 Epoch 12 Step: 26100 Batch Loss: 1.543481 Tokens per Sec: 10515, Lr: 0.000300\n", "2020-01-18 06:34:55,045 Epoch 12 Step: 26200 Batch Loss: 1.576636 Tokens per Sec: 10580, Lr: 0.000300\n", "2020-01-18 06:35:14,962 Epoch 12 Step: 26300 Batch Loss: 1.520515 Tokens per Sec: 10800, Lr: 0.000300\n", "2020-01-18 06:35:34,914 Epoch 12 Step: 26400 Batch Loss: 1.723162 Tokens per Sec: 10669, Lr: 0.000300\n", "2020-01-18 06:35:55,089 Epoch 12 Step: 26500 Batch Loss: 1.284044 Tokens per Sec: 10884, Lr: 0.000300\n", "2020-01-18 06:36:15,116 Epoch 12 Step: 26600 Batch Loss: 1.649428 Tokens per Sec: 10745, Lr: 0.000300\n", "2020-01-18 06:36:35,262 Epoch 12 Step: 26700 Batch Loss: 1.616244 Tokens per Sec: 10578, Lr: 0.000300\n", "2020-01-18 06:36:55,356 Epoch 12 Step: 26800 Batch Loss: 1.520015 Tokens per Sec: 10699, Lr: 0.000300\n", "2020-01-18 06:37:15,412 Epoch 12 Step: 26900 Batch Loss: 1.583951 Tokens per Sec: 10744, Lr: 0.000300\n", "2020-01-18 06:37:35,327 Epoch 12 Step: 27000 Batch Loss: 1.513562 Tokens per Sec: 10627, Lr: 0.000300\n", "2020-01-18 06:38:23,259 Hooray! New best validation result [ppl]!\n", "2020-01-18 06:38:23,259 Saving new checkpoint.\n", "2020-01-18 06:38:25,356 Example #0\n", "2020-01-18 06:38:25,357 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 06:38:25,357 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 06:38:25,357 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ emamọ eva . ’\n", "2020-01-18 06:38:25,357 Example #1\n", "2020-01-18 06:38:25,357 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 06:38:25,358 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 06:38:25,358 \tHypothesis: A te lele iei ta usiuwoma , Ọrọ Avọ 1\n", "2020-01-18 06:38:25,358 Example #2\n", "2020-01-18 06:38:25,358 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 06:38:25,358 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 06:38:25,358 \tHypothesis: Fikiere , mai kpobi ma te ghọghọ je fiba urru mai nọ ma te rọ so ole oghọghọ nana : “ Jọ odẹ riẹ [ Ovie na ] o jọ bẹdẹ bẹdẹ ; re wha jọ bẹdẹ bẹdẹ , re wha jiri odẹ riẹ , re o jiri ei , wha jiri ei ; wha jiri ei , re ọ ghale ae .\n", "2020-01-18 06:38:25,358 Example #3\n", "2020-01-18 06:38:25,358 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 06:38:25,359 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 06:38:25,359 \tHypothesis: Ghele na , eme - unu - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 06:38:25,359 Validation result (greedy) at epoch 12, step 27000: bleu: 27.04, loss: 36990.9141, ppl: 4.9562, duration: 50.0310s\n", "2020-01-18 06:38:45,926 Epoch 12 Step: 27100 Batch Loss: 1.404680 Tokens per Sec: 10603, Lr: 0.000300\n", "2020-01-18 06:39:06,013 Epoch 12 Step: 27200 Batch Loss: 1.542531 Tokens per Sec: 10755, Lr: 0.000300\n", "2020-01-18 06:39:26,006 Epoch 12 Step: 27300 Batch Loss: 1.572638 Tokens per Sec: 10587, Lr: 0.000300\n", "2020-01-18 06:39:46,158 Epoch 12 Step: 27400 Batch Loss: 1.577376 Tokens per Sec: 10776, Lr: 0.000300\n", "2020-01-18 06:40:06,204 Epoch 12 Step: 27500 Batch Loss: 1.422031 Tokens per Sec: 10687, Lr: 0.000300\n", "2020-01-18 06:40:26,200 Epoch 12 Step: 27600 Batch Loss: 1.378873 Tokens per Sec: 10607, Lr: 0.000300\n", "2020-01-18 06:40:46,365 Epoch 12 Step: 27700 Batch Loss: 1.763687 Tokens per Sec: 10970, Lr: 0.000300\n", "2020-01-18 06:41:06,360 Epoch 12 Step: 27800 Batch Loss: 1.313040 Tokens per Sec: 10787, Lr: 0.000300\n", "2020-01-18 06:41:26,477 Epoch 12 Step: 27900 Batch Loss: 1.657410 Tokens per Sec: 10709, Lr: 0.000300\n", "2020-01-18 06:41:46,653 Epoch 12 Step: 28000 Batch Loss: 1.717716 Tokens per Sec: 10735, Lr: 0.000300\n", "2020-01-18 06:42:34,636 Hooray! New best validation result [ppl]!\n", "2020-01-18 06:42:34,637 Saving new checkpoint.\n", "2020-01-18 06:42:37,466 Example #0\n", "2020-01-18 06:42:37,467 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 06:42:37,467 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 06:42:37,467 \tHypothesis: Ma rẹ sae yare Ọghẹnẹ re ọ ‘ rehọ udu mai kpobi ma . ’\n", "2020-01-18 06:42:37,467 Example #1\n", "2020-01-18 06:42:37,467 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 06:42:37,467 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 06:42:37,467 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 06:42:37,467 Example #2\n", "2020-01-18 06:42:37,468 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 06:42:37,468 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 06:42:37,468 \tHypothesis: Fikiere , mai kpobi ma te rọ oghọghọ fiba urru mai nọ ma te bi ku ole urirẹ nana gbe ole urirẹ nana : “ Jọ odẹ [ Ovie na ] Jesu Kristi o jọ bẹdẹ ; re ọre na o lo , re o jiri odẹ riẹ , re o jiri erẹwho kpobi ; re a jiri ei ; re a jiri ei , re a ghale ae .\n", "2020-01-18 06:42:37,468 Example #3\n", "2020-01-18 06:42:37,468 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 06:42:37,468 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 06:42:37,468 \tHypothesis: Ghele na , eme uwou - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 06:42:37,468 Validation result (greedy) at epoch 12, step 28000: bleu: 27.30, loss: 36714.2539, ppl: 4.8973, duration: 50.8146s\n", "2020-01-18 06:42:57,906 Epoch 12 Step: 28100 Batch Loss: 1.603504 Tokens per Sec: 10503, Lr: 0.000300\n", "2020-01-18 06:43:07,828 Epoch 12: total training loss 3596.06\n", "2020-01-18 06:43:07,828 EPOCH 13\n", "2020-01-18 06:43:18,189 Epoch 13 Step: 28200 Batch Loss: 1.577993 Tokens per Sec: 10332, Lr: 0.000300\n", "2020-01-18 06:43:38,208 Epoch 13 Step: 28300 Batch Loss: 1.181407 Tokens per Sec: 10916, Lr: 0.000300\n", "2020-01-18 06:43:58,299 Epoch 13 Step: 28400 Batch Loss: 1.434973 Tokens per Sec: 10740, Lr: 0.000300\n", "2020-01-18 06:44:18,270 Epoch 13 Step: 28500 Batch Loss: 1.583469 Tokens per Sec: 10723, Lr: 0.000300\n", "2020-01-18 06:44:38,249 Epoch 13 Step: 28600 Batch Loss: 1.634947 Tokens per Sec: 10487, Lr: 0.000300\n", "2020-01-18 06:44:58,291 Epoch 13 Step: 28700 Batch Loss: 1.241905 Tokens per Sec: 10733, Lr: 0.000300\n", "2020-01-18 06:45:18,056 Epoch 13 Step: 28800 Batch Loss: 1.405541 Tokens per Sec: 10657, Lr: 0.000300\n", "2020-01-18 06:45:38,088 Epoch 13 Step: 28900 Batch Loss: 1.514402 Tokens per Sec: 10716, Lr: 0.000300\n", "2020-01-18 06:45:57,931 Epoch 13 Step: 29000 Batch Loss: 1.713717 Tokens per Sec: 10707, Lr: 0.000300\n", "2020-01-18 06:46:45,882 Example #0\n", "2020-01-18 06:46:45,883 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 06:46:45,884 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 06:46:45,884 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 06:46:45,884 Example #1\n", "2020-01-18 06:46:45,885 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 06:46:45,885 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 06:46:45,885 \tHypothesis: A te lele iei ta usiuwoma na ha .\n", "2020-01-18 06:46:45,885 Example #2\n", "2020-01-18 06:46:45,885 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 06:46:45,886 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 06:46:45,886 \tHypothesis: Evaọ uzẹme , mai kpobi ma te ghọghọ re ma jiri abọ urere nana gbe ole oghọghọ nana : “ Jọ odẹ Jesu Kristi Ovie na o jọ bẹdẹ bẹdẹ ; re ọre riẹ o lo , re o jiri ei , re ọ ghale erẹwho na kpobi ; re a ruẹse ghale iẹe , re a ruẹse ghale ae kẹ ae ; re a ruẹse jọ erẹwho na kpobi .\n", "2020-01-18 06:46:45,886 Example #3\n", "2020-01-18 06:46:45,886 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 06:46:45,887 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 06:46:45,887 \tHypothesis: Ghele na , eme uwou - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 06:46:45,887 Validation result (greedy) at epoch 13, step 29000: bleu: 27.50, loss: 37003.5781, ppl: 4.9589, duration: 47.9550s\n", "2020-01-18 06:47:05,821 Epoch 13 Step: 29100 Batch Loss: 1.536117 Tokens per Sec: 10480, Lr: 0.000300\n", "2020-01-18 06:47:25,748 Epoch 13 Step: 29200 Batch Loss: 1.592738 Tokens per Sec: 10899, Lr: 0.000300\n", "2020-01-18 06:47:45,709 Epoch 13 Step: 29300 Batch Loss: 1.592473 Tokens per Sec: 10857, Lr: 0.000300\n", "2020-01-18 06:48:05,524 Epoch 13 Step: 29400 Batch Loss: 1.327575 Tokens per Sec: 10731, Lr: 0.000300\n", "2020-01-18 06:48:25,399 Epoch 13 Step: 29500 Batch Loss: 1.483862 Tokens per Sec: 10655, Lr: 0.000300\n", "2020-01-18 06:48:45,394 Epoch 13 Step: 29600 Batch Loss: 1.495827 Tokens per Sec: 10550, Lr: 0.000300\n", "2020-01-18 06:49:05,482 Epoch 13 Step: 29700 Batch Loss: 1.533761 Tokens per Sec: 10768, Lr: 0.000300\n", "2020-01-18 06:49:25,461 Epoch 13 Step: 29800 Batch Loss: 1.590343 Tokens per Sec: 10697, Lr: 0.000300\n", "2020-01-18 06:49:45,340 Epoch 13 Step: 29900 Batch Loss: 1.309302 Tokens per Sec: 10835, Lr: 0.000300\n", "2020-01-18 06:50:05,328 Epoch 13 Step: 30000 Batch Loss: 1.181688 Tokens per Sec: 10829, Lr: 0.000300\n", "2020-01-18 06:50:53,199 Hooray! New best validation result [ppl]!\n", "2020-01-18 06:50:53,199 Saving new checkpoint.\n", "2020-01-18 06:50:55,214 Example #0\n", "2020-01-18 06:50:55,216 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 06:50:55,216 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 06:50:55,217 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 06:50:55,217 Example #1\n", "2020-01-18 06:50:55,217 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 06:50:55,217 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 06:50:55,217 \tHypothesis: A lele onana evaọ ovuẹ Uvie na ha .\n", "2020-01-18 06:50:55,217 Example #2\n", "2020-01-18 06:50:55,218 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 06:50:55,218 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 06:50:55,218 \tHypothesis: Koyehọ , mai kpobi ma te rọ evawere fiba ole nana gbe ole urirẹ nana : “ Jọ odẹ riẹ [ Ovie na ] o jọ bẹdẹ bẹdẹ ; re o jọ bẹdẹ bẹdẹ ; re o ru odẹ riẹ ghọghọ , re o ruẹse ghale ae , re a jiri ei , re a jiri ei , re a jiri ei .\n", "2020-01-18 06:50:55,218 Example #3\n", "2020-01-18 06:50:55,219 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 06:50:55,219 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 06:50:55,219 \tHypothesis: Ghele na , eme unu - unu e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 06:50:55,219 Validation result (greedy) at epoch 13, step 30000: bleu: 27.26, loss: 36578.5742, ppl: 4.8686, duration: 49.8909s\n", "2020-01-18 06:51:16,307 Epoch 13 Step: 30100 Batch Loss: 1.582632 Tokens per Sec: 10512, Lr: 0.000300\n", "2020-01-18 06:51:36,286 Epoch 13 Step: 30200 Batch Loss: 1.601105 Tokens per Sec: 10674, Lr: 0.000300\n", "2020-01-18 06:51:56,341 Epoch 13 Step: 30300 Batch Loss: 1.588550 Tokens per Sec: 10716, Lr: 0.000300\n", "2020-01-18 06:52:16,256 Epoch 13 Step: 30400 Batch Loss: 1.647412 Tokens per Sec: 10700, Lr: 0.000300\n", "2020-01-18 06:52:36,115 Epoch 13 Step: 30500 Batch Loss: 1.338451 Tokens per Sec: 10658, Lr: 0.000300\n", "2020-01-18 06:52:36,688 Epoch 13: total training loss 3532.06\n", "2020-01-18 06:52:36,688 EPOCH 14\n", "2020-01-18 06:52:56,345 Epoch 14 Step: 30600 Batch Loss: 1.556479 Tokens per Sec: 10545, Lr: 0.000300\n", "2020-01-18 06:53:16,434 Epoch 14 Step: 30700 Batch Loss: 1.357392 Tokens per Sec: 10452, Lr: 0.000300\n", "2020-01-18 06:53:36,500 Epoch 14 Step: 30800 Batch Loss: 1.244550 Tokens per Sec: 10900, Lr: 0.000300\n", "2020-01-18 06:53:56,626 Epoch 14 Step: 30900 Batch Loss: 1.013505 Tokens per Sec: 10574, Lr: 0.000300\n", "2020-01-18 06:54:16,717 Epoch 14 Step: 31000 Batch Loss: 1.462535 Tokens per Sec: 10691, Lr: 0.000300\n", "2020-01-18 06:55:04,643 Hooray! New best validation result [ppl]!\n", "2020-01-18 06:55:04,643 Saving new checkpoint.\n", "2020-01-18 06:55:06,747 Example #0\n", "2020-01-18 06:55:06,748 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 06:55:06,749 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 06:55:06,749 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 06:55:06,749 Example #1\n", "2020-01-18 06:55:06,750 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 06:55:06,750 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 06:55:06,750 \tHypothesis: A lele iei ta ẹme na , Ọrọ Avọ Ijo .\n", "2020-01-18 06:55:06,750 Example #2\n", "2020-01-18 06:55:06,751 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 06:55:06,751 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 06:55:06,751 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba urru mai nọ ma te rọ so ole iwoma nana jẹ be so ole oghọghọ nana : “ Jọ odẹ [ Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; re ọre na ọ jọ bẹdẹ bẹdẹ ; re o jiri odẹ riẹ , re o jiri ai , re a jiri ei , re a jiri ai kpobi .\n", "2020-01-18 06:55:06,751 Example #3\n", "2020-01-18 06:55:06,752 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 06:55:06,752 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 06:55:06,752 \tHypothesis: Ghele na , eme uwou - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 06:55:06,752 Validation result (greedy) at epoch 14, step 31000: bleu: 27.45, loss: 36510.4609, ppl: 4.8543, duration: 50.0347s\n", "2020-01-18 06:55:27,097 Epoch 14 Step: 31100 Batch Loss: 1.375691 Tokens per Sec: 10655, Lr: 0.000300\n", "2020-01-18 06:55:47,163 Epoch 14 Step: 31200 Batch Loss: 1.579467 Tokens per Sec: 10820, Lr: 0.000300\n", "2020-01-18 06:56:07,284 Epoch 14 Step: 31300 Batch Loss: 1.340196 Tokens per Sec: 10858, Lr: 0.000300\n", "2020-01-18 06:56:27,339 Epoch 14 Step: 31400 Batch Loss: 1.549211 Tokens per Sec: 10769, Lr: 0.000300\n", "2020-01-18 06:56:47,135 Epoch 14 Step: 31500 Batch Loss: 1.544534 Tokens per Sec: 10590, Lr: 0.000300\n", "2020-01-18 06:57:07,245 Epoch 14 Step: 31600 Batch Loss: 1.445992 Tokens per Sec: 10860, Lr: 0.000300\n", "2020-01-18 06:57:27,143 Epoch 14 Step: 31700 Batch Loss: 1.666610 Tokens per Sec: 10757, Lr: 0.000300\n", "2020-01-18 06:57:47,153 Epoch 14 Step: 31800 Batch Loss: 1.410275 Tokens per Sec: 10763, Lr: 0.000300\n", "2020-01-18 06:58:07,102 Epoch 14 Step: 31900 Batch Loss: 1.371162 Tokens per Sec: 10960, Lr: 0.000300\n", "2020-01-18 06:58:27,024 Epoch 14 Step: 32000 Batch Loss: 1.259764 Tokens per Sec: 10679, Lr: 0.000300\n", "2020-01-18 06:59:14,887 Hooray! New best validation result [ppl]!\n", "2020-01-18 06:59:14,888 Saving new checkpoint.\n", "2020-01-18 06:59:16,970 Example #0\n", "2020-01-18 06:59:16,971 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 06:59:16,971 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 06:59:16,971 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 06:59:16,971 Example #1\n", "2020-01-18 06:59:16,972 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 06:59:16,972 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 06:59:16,972 \tHypothesis: A lele iei ta usiuwoma Uvie na ha .\n", "2020-01-18 06:59:16,972 Example #2\n", "2020-01-18 06:59:16,973 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 06:59:16,973 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 06:59:16,973 \tHypothesis: O tẹ rrọ ere , mai kpobi ma te rọ evawere jiri abọ urere nana nọ o wo erru gaga na , jẹ so ole evawere nọ e rẹ kẹ evawere : “ Jọ odẹ riẹ [ Ovie na ] o jọ bẹdẹ bẹdẹ ; re ọre na o te vihọ , re o jiri ai , re a jiri ei ; re a jọ erẹwho na kpobi ; jọ erẹwho na kpobi a jiri ei .\n", "2020-01-18 06:59:16,973 Example #3\n", "2020-01-18 06:59:16,973 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 06:59:16,973 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 06:59:16,973 \tHypothesis: Ghele na , eme uwou - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 06:59:16,973 Validation result (greedy) at epoch 14, step 32000: bleu: 27.88, loss: 36220.8750, ppl: 4.7938, duration: 49.9487s\n", "2020-01-18 06:59:37,346 Epoch 14 Step: 32100 Batch Loss: 1.561976 Tokens per Sec: 10518, Lr: 0.000300\n", "2020-01-18 06:59:57,370 Epoch 14 Step: 32200 Batch Loss: 1.487674 Tokens per Sec: 11032, Lr: 0.000300\n", "2020-01-18 07:00:17,366 Epoch 14 Step: 32300 Batch Loss: 1.496971 Tokens per Sec: 10639, Lr: 0.000300\n", "2020-01-18 07:00:37,441 Epoch 14 Step: 32400 Batch Loss: 1.703684 Tokens per Sec: 10694, Lr: 0.000300\n", "2020-01-18 07:00:57,367 Epoch 14 Step: 32500 Batch Loss: 1.506147 Tokens per Sec: 10638, Lr: 0.000300\n", "2020-01-18 07:01:17,425 Epoch 14 Step: 32600 Batch Loss: 1.601020 Tokens per Sec: 10793, Lr: 0.000300\n", "2020-01-18 07:01:37,193 Epoch 14 Step: 32700 Batch Loss: 1.656706 Tokens per Sec: 10797, Lr: 0.000300\n", "2020-01-18 07:01:57,073 Epoch 14 Step: 32800 Batch Loss: 1.433264 Tokens per Sec: 10549, Lr: 0.000300\n", "2020-01-18 07:02:06,880 Epoch 14: total training loss 3451.65\n", "2020-01-18 07:02:06,880 EPOCH 15\n", "2020-01-18 07:02:17,247 Epoch 15 Step: 32900 Batch Loss: 1.672243 Tokens per Sec: 10319, Lr: 0.000300\n", "2020-01-18 07:02:37,206 Epoch 15 Step: 33000 Batch Loss: 1.500341 Tokens per Sec: 10552, Lr: 0.000300\n", "2020-01-18 07:03:25,130 Example #0\n", "2020-01-18 07:03:25,131 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 07:03:25,132 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 07:03:25,132 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 07:03:25,132 Example #1\n", "2020-01-18 07:03:25,132 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 07:03:25,132 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 07:03:25,133 \tHypothesis: A lele iei ta usiuwoma na No , Ọrọ Avọ 4\n", "2020-01-18 07:03:25,133 Example #2\n", "2020-01-18 07:03:25,133 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 07:03:25,133 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 07:03:25,133 \tHypothesis: O tẹ rrọ ere , ma te rọ oghọghọ fiba urru mai nọ ma te bi ku ole oghọghọ nana họ : “ Jọ odẹ [ Ovie na ] Jesu Kristi Ovie na ọ jọ bẹdẹ bẹdẹ , jọ odẹ riẹ o jọ bẹdẹ , re o jiri ei , re o jiri ai . . .\n", "2020-01-18 07:03:25,134 Example #3\n", "2020-01-18 07:03:25,134 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 07:03:25,134 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 07:03:25,134 \tHypothesis: Ghele na , eme unu - unu e rẹ jọ ẹgba gaga re a ru udhedhẹ .\n", "2020-01-18 07:03:25,134 Validation result (greedy) at epoch 15, step 33000: bleu: 27.72, loss: 36649.0586, ppl: 4.8835, duration: 47.9278s\n", "2020-01-18 07:03:44,983 Epoch 15 Step: 33100 Batch Loss: 1.546409 Tokens per Sec: 10651, Lr: 0.000300\n", "2020-01-18 07:04:05,097 Epoch 15 Step: 33200 Batch Loss: 1.205803 Tokens per Sec: 10895, Lr: 0.000300\n", "2020-01-18 07:04:24,963 Epoch 15 Step: 33300 Batch Loss: 1.457515 Tokens per Sec: 10437, Lr: 0.000300\n", "2020-01-18 07:04:44,969 Epoch 15 Step: 33400 Batch Loss: 1.350075 Tokens per Sec: 10657, Lr: 0.000300\n", "2020-01-18 07:05:05,104 Epoch 15 Step: 33500 Batch Loss: 1.527105 Tokens per Sec: 10747, Lr: 0.000300\n", "2020-01-18 07:05:25,055 Epoch 15 Step: 33600 Batch Loss: 1.405978 Tokens per Sec: 10384, Lr: 0.000300\n", "2020-01-18 07:05:45,127 Epoch 15 Step: 33700 Batch Loss: 1.447579 Tokens per Sec: 11131, Lr: 0.000300\n", "2020-01-18 07:06:05,019 Epoch 15 Step: 33800 Batch Loss: 1.549440 Tokens per Sec: 10826, Lr: 0.000300\n", "2020-01-18 07:06:25,119 Epoch 15 Step: 33900 Batch Loss: 1.581588 Tokens per Sec: 10750, Lr: 0.000300\n", "2020-01-18 07:06:44,936 Epoch 15 Step: 34000 Batch Loss: 1.422628 Tokens per Sec: 10640, Lr: 0.000300\n", "2020-01-18 07:07:32,845 Hooray! New best validation result [ppl]!\n", "2020-01-18 07:07:32,846 Saving new checkpoint.\n", "2020-01-18 07:07:35,422 Example #0\n", "2020-01-18 07:07:35,422 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 07:07:35,422 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 07:07:35,422 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ k’omai udu ofuafo . ’\n", "2020-01-18 07:07:35,422 Example #1\n", "2020-01-18 07:07:35,423 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 07:07:35,423 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 07:07:35,423 \tHypothesis: A je lele iei ta usiuwoma na , Ọrọ Avọ 4\n", "2020-01-18 07:07:35,423 Example #2\n", "2020-01-18 07:07:35,423 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 07:07:35,423 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 07:07:35,423 \tHypothesis: Fikiere , mai kpobi ma te rọ oghọghọ fiba ole nana nọ o vọ avọ oghọghọ na , onọ o ta nọ : “ Jọ odẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ bẹdẹ ; re ọre na o te vihọ , re o jiri ai , re erẹwho na kpobi a ruẹse jiri ei ; re a jiri ei .\n", "2020-01-18 07:07:35,424 Example #3\n", "2020-01-18 07:07:35,424 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 07:07:35,424 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 07:07:35,424 \tHypothesis: Ghele na , eme uwou - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 07:07:35,424 Validation result (greedy) at epoch 15, step 34000: bleu: 27.65, loss: 36003.9961, ppl: 4.7490, duration: 50.4871s\n", "2020-01-18 07:07:55,942 Epoch 15 Step: 34100 Batch Loss: 1.553090 Tokens per Sec: 10644, Lr: 0.000300\n", "2020-01-18 07:08:16,127 Epoch 15 Step: 34200 Batch Loss: 1.326538 Tokens per Sec: 10759, Lr: 0.000300\n", "2020-01-18 07:08:36,104 Epoch 15 Step: 34300 Batch Loss: 1.569235 Tokens per Sec: 10953, Lr: 0.000300\n", "2020-01-18 07:08:55,972 Epoch 15 Step: 34400 Batch Loss: 1.447606 Tokens per Sec: 10641, Lr: 0.000300\n", "2020-01-18 07:09:16,221 Epoch 15 Step: 34500 Batch Loss: 1.600495 Tokens per Sec: 10910, Lr: 0.000300\n", "2020-01-18 07:09:36,180 Epoch 15 Step: 34600 Batch Loss: 1.612551 Tokens per Sec: 10541, Lr: 0.000300\n", "2020-01-18 07:09:56,068 Epoch 15 Step: 34700 Batch Loss: 1.515254 Tokens per Sec: 11046, Lr: 0.000300\n", "2020-01-18 07:10:16,111 Epoch 15 Step: 34800 Batch Loss: 1.312220 Tokens per Sec: 10786, Lr: 0.000300\n", "2020-01-18 07:10:36,142 Epoch 15 Step: 34900 Batch Loss: 1.539102 Tokens per Sec: 10651, Lr: 0.000300\n", "2020-01-18 07:10:56,141 Epoch 15 Step: 35000 Batch Loss: 1.503417 Tokens per Sec: 10661, Lr: 0.000300\n", "2020-01-18 07:11:43,971 Hooray! New best validation result [ppl]!\n", "2020-01-18 07:11:43,972 Saving new checkpoint.\n", "2020-01-18 07:11:45,955 Example #0\n", "2020-01-18 07:11:45,956 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 07:11:45,956 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 07:11:45,956 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 07:11:45,956 Example #1\n", "2020-01-18 07:11:45,956 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 07:11:45,956 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 07:11:45,956 \tHypothesis: A rehọ omobe Usi Uvie na Ru Iruo Ziezi , Ọrọ Avọ 2\n", "2020-01-18 07:11:45,957 Example #2\n", "2020-01-18 07:11:45,957 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 07:11:45,957 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 07:11:45,957 \tHypothesis: Koyehọ mai kpobi ma te rehọ oghọghọ fiba abọ urere nana gbe ole oghọghọ nana : “ Jọ odẹ riẹ [ Ovie na ] Jesu Kristi Ovie na o jọ bẹdẹ bẹdẹ ; re ọre riẹ o vihọ , re o jiri ai , re a jiri ei , re a jiri ei , re a jiri ei .\n", "2020-01-18 07:11:45,957 Example #3\n", "2020-01-18 07:11:45,957 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 07:11:45,957 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 07:11:45,958 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 07:11:45,958 Validation result (greedy) at epoch 15, step 35000: bleu: 28.25, loss: 35898.0039, ppl: 4.7273, duration: 49.8157s\n", "2020-01-18 07:12:06,381 Epoch 15 Step: 35100 Batch Loss: 1.707447 Tokens per Sec: 10521, Lr: 0.000300\n", "2020-01-18 07:12:25,645 Epoch 15: total training loss 3392.67\n", "2020-01-18 07:12:25,646 EPOCH 16\n", "2020-01-18 07:12:26,493 Epoch 16 Step: 35200 Batch Loss: 1.251716 Tokens per Sec: 6091, Lr: 0.000300\n", "2020-01-18 07:12:46,595 Epoch 16 Step: 35300 Batch Loss: 1.343683 Tokens per Sec: 10785, Lr: 0.000300\n", "2020-01-18 07:13:06,585 Epoch 16 Step: 35400 Batch Loss: 1.358266 Tokens per Sec: 10843, Lr: 0.000300\n", "2020-01-18 07:13:26,632 Epoch 16 Step: 35500 Batch Loss: 1.449778 Tokens per Sec: 10853, Lr: 0.000300\n", "2020-01-18 07:13:46,541 Epoch 16 Step: 35600 Batch Loss: 1.456171 Tokens per Sec: 10716, Lr: 0.000300\n", "2020-01-18 07:14:06,630 Epoch 16 Step: 35700 Batch Loss: 1.455434 Tokens per Sec: 10891, Lr: 0.000300\n", "2020-01-18 07:14:26,525 Epoch 16 Step: 35800 Batch Loss: 1.486414 Tokens per Sec: 10674, Lr: 0.000300\n", "2020-01-18 07:14:46,633 Epoch 16 Step: 35900 Batch Loss: 1.334743 Tokens per Sec: 10673, Lr: 0.000300\n", "2020-01-18 07:15:06,545 Epoch 16 Step: 36000 Batch Loss: 1.661178 Tokens per Sec: 10731, Lr: 0.000300\n", "2020-01-18 07:15:54,400 Example #0\n", "2020-01-18 07:15:54,401 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 07:15:54,401 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 07:15:54,401 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 07:15:54,401 Example #1\n", "2020-01-18 07:15:54,402 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 07:15:54,402 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 07:15:54,402 \tHypothesis: A lele iei ta usiuwoma , Ọrọ Avọ 4\n", "2020-01-18 07:15:54,402 Example #2\n", "2020-01-18 07:15:54,403 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 07:15:54,403 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 07:15:54,403 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ re ma ku ole oghọghọ nana gbe ole oghọghọ nana họ : “ Jọ odẹ riẹ [ Ovie na ] Jesu Kristi ọ jọ bẹdẹ bẹdẹ ; re ọre o te ti vihọ , re [ jọ ] ọ ghale ae , re a jiri ei , re a jiri ei , re a jiri ei , re a jiri ei kẹ erẹwho na kpobi ; re a se isẹi riẹ . .\n", "2020-01-18 07:15:54,403 Example #3\n", "2020-01-18 07:15:54,403 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 07:15:54,403 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 07:15:54,404 \tHypothesis: Ghele na , eme uwou - odi e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 07:15:54,404 Validation result (greedy) at epoch 16, step 36000: bleu: 28.31, loss: 36018.2266, ppl: 4.7520, duration: 47.8582s\n", "2020-01-18 07:16:14,565 Epoch 16 Step: 36100 Batch Loss: 1.250866 Tokens per Sec: 10736, Lr: 0.000300\n", "2020-01-18 07:16:34,533 Epoch 16 Step: 36200 Batch Loss: 1.552537 Tokens per Sec: 10704, Lr: 0.000300\n", "2020-01-18 07:16:54,743 Epoch 16 Step: 36300 Batch Loss: 1.477466 Tokens per Sec: 10956, Lr: 0.000300\n", "2020-01-18 07:17:14,682 Epoch 16 Step: 36400 Batch Loss: 1.568467 Tokens per Sec: 10733, Lr: 0.000300\n", "2020-01-18 07:17:34,632 Epoch 16 Step: 36500 Batch Loss: 1.220455 Tokens per Sec: 10641, Lr: 0.000300\n", "2020-01-18 07:17:54,702 Epoch 16 Step: 36600 Batch Loss: 1.382872 Tokens per Sec: 10840, Lr: 0.000300\n", "2020-01-18 07:18:14,776 Epoch 16 Step: 36700 Batch Loss: 1.547505 Tokens per Sec: 10666, Lr: 0.000300\n", "2020-01-18 07:18:34,873 Epoch 16 Step: 36800 Batch Loss: 1.455929 Tokens per Sec: 10830, Lr: 0.000300\n", "2020-01-18 07:18:55,004 Epoch 16 Step: 36900 Batch Loss: 1.420023 Tokens per Sec: 10788, Lr: 0.000300\n", "2020-01-18 07:19:14,969 Epoch 16 Step: 37000 Batch Loss: 1.407121 Tokens per Sec: 10727, Lr: 0.000300\n", "2020-01-18 07:20:02,870 Hooray! New best validation result [ppl]!\n", "2020-01-18 07:20:02,870 Saving new checkpoint.\n", "2020-01-18 07:20:05,459 Example #0\n", "2020-01-18 07:20:05,460 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 07:20:05,460 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 07:20:05,460 \tHypothesis: Ma rẹ sae yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 07:20:05,460 Example #1\n", "2020-01-18 07:20:05,460 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 07:20:05,461 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 07:20:05,461 \tHypothesis: A rehọ omobe - ovẹvẹ Uvie na Ru onana , Ọrọ Avọ 4\n", "2020-01-18 07:20:05,461 Example #2\n", "2020-01-18 07:20:05,461 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 07:20:05,461 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 07:20:05,462 \tHypothesis: O tẹ rrọ ere , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i bi kuhọ evaọ abọ urere nana , jẹ so ole oghọghọ nana : “ Jọ odẹ riẹ [ Ovie na ] o jọ bẹdẹ bẹdẹ ; re ọre riẹ o te vihọ , re o jiri ei , re ọ ghale erẹwho kpobi ; re a se ai kpobi ba ẹghale kẹ e . . .\n", "2020-01-18 07:20:05,462 Example #3\n", "2020-01-18 07:20:05,462 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 07:20:05,462 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 07:20:05,462 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 07:20:05,462 Validation result (greedy) at epoch 16, step 37000: bleu: 28.77, loss: 35545.4727, ppl: 4.6557, duration: 50.4930s\n", "2020-01-18 07:20:25,790 Epoch 16 Step: 37100 Batch Loss: 1.367937 Tokens per Sec: 10405, Lr: 0.000300\n", "2020-01-18 07:20:45,753 Epoch 16 Step: 37200 Batch Loss: 1.476149 Tokens per Sec: 10648, Lr: 0.000300\n", "2020-01-18 07:21:05,621 Epoch 16 Step: 37300 Batch Loss: 1.267397 Tokens per Sec: 10672, Lr: 0.000300\n", "2020-01-18 07:21:25,532 Epoch 16 Step: 37400 Batch Loss: 1.441347 Tokens per Sec: 10910, Lr: 0.000300\n", "2020-01-18 07:21:45,596 Epoch 16 Step: 37500 Batch Loss: 1.307712 Tokens per Sec: 10847, Lr: 0.000300\n", "2020-01-18 07:21:53,180 Epoch 16: total training loss 3328.87\n", "2020-01-18 07:21:53,181 EPOCH 17\n", "2020-01-18 07:22:05,469 Epoch 17 Step: 37600 Batch Loss: 1.605061 Tokens per Sec: 10599, Lr: 0.000300\n", "2020-01-18 07:22:25,453 Epoch 17 Step: 37700 Batch Loss: 1.210009 Tokens per Sec: 10852, Lr: 0.000300\n", "2020-01-18 07:22:45,467 Epoch 17 Step: 37800 Batch Loss: 1.458300 Tokens per Sec: 10629, Lr: 0.000300\n", "2020-01-18 07:23:05,409 Epoch 17 Step: 37900 Batch Loss: 1.505524 Tokens per Sec: 10591, Lr: 0.000300\n", "2020-01-18 07:23:25,329 Epoch 17 Step: 38000 Batch Loss: 1.160690 Tokens per Sec: 10721, Lr: 0.000300\n", "2020-01-18 07:24:13,239 Example #0\n", "2020-01-18 07:24:13,239 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 07:24:13,239 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 07:24:13,239 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 07:24:13,240 Example #1\n", "2020-01-18 07:24:13,240 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 07:24:13,240 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 07:24:13,240 \tHypothesis: A ru onana avọ omobe - ovẹvẹ Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 07:24:13,240 Example #2\n", "2020-01-18 07:24:13,241 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 07:24:13,241 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 07:24:13,241 \tHypothesis: Fikiere , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ abọ urere ọrọ ole oghọghọ nana : “ Jọ odẹ [ Ovie Jesu Kristi ] o jọ bẹdẹ ; re ọre na ọ jọ bẹdẹ ; re o te ru odẹ riẹ wo oghale , re erẹwho kpobi e se odẹ riẹ , re a se odẹ riẹ , re a se ai kpobi a jọ erẹwho na e ghọghọ .\n", "2020-01-18 07:24:13,241 Example #3\n", "2020-01-18 07:24:13,241 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 07:24:13,242 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 07:24:13,242 \tHypothesis: Ghele na , eme uwou - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 07:24:13,242 Validation result (greedy) at epoch 17, step 38000: bleu: 28.58, loss: 35780.0625, ppl: 4.7032, duration: 47.9125s\n", "2020-01-18 07:24:33,259 Epoch 17 Step: 38100 Batch Loss: 1.488076 Tokens per Sec: 10668, Lr: 0.000300\n", "2020-01-18 07:24:53,245 Epoch 17 Step: 38200 Batch Loss: 1.588775 Tokens per Sec: 10771, Lr: 0.000300\n", "2020-01-18 07:25:13,014 Epoch 17 Step: 38300 Batch Loss: 1.524590 Tokens per Sec: 10838, Lr: 0.000300\n", "2020-01-18 07:25:33,177 Epoch 17 Step: 38400 Batch Loss: 1.484911 Tokens per Sec: 10647, Lr: 0.000300\n", "2020-01-18 07:25:53,126 Epoch 17 Step: 38500 Batch Loss: 1.325557 Tokens per Sec: 10688, Lr: 0.000300\n", "2020-01-18 07:26:13,061 Epoch 17 Step: 38600 Batch Loss: 1.429464 Tokens per Sec: 10767, Lr: 0.000300\n", "2020-01-18 07:26:33,123 Epoch 17 Step: 38700 Batch Loss: 1.373146 Tokens per Sec: 10841, Lr: 0.000300\n", "2020-01-18 07:26:52,974 Epoch 17 Step: 38800 Batch Loss: 1.552732 Tokens per Sec: 10555, Lr: 0.000300\n", "2020-01-18 07:27:13,073 Epoch 17 Step: 38900 Batch Loss: 1.499638 Tokens per Sec: 10835, Lr: 0.000300\n", "2020-01-18 07:27:33,180 Epoch 17 Step: 39000 Batch Loss: 1.182215 Tokens per Sec: 11022, Lr: 0.000300\n", "2020-01-18 07:28:21,010 Hooray! New best validation result [ppl]!\n", "2020-01-18 07:28:21,011 Saving new checkpoint.\n", "2020-01-18 07:28:23,078 Example #0\n", "2020-01-18 07:28:23,079 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 07:28:23,080 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 07:28:23,080 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ emamọ eva . ’\n", "2020-01-18 07:28:23,081 Example #1\n", "2020-01-18 07:28:23,081 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 07:28:23,081 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 07:28:23,081 \tHypothesis: A lele iei ta ẹme , Ọrọ Avọ 4\n", "2020-01-18 07:28:23,081 Example #2\n", "2020-01-18 07:28:23,081 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 07:28:23,081 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 07:28:23,082 \tHypothesis: Evaọ oke yena , mai kpobi ma te rọ evawere fiba ole urere nana nọ o vọ avọ oghọghọ na , onọ o ta nọ : “ Jọ odẹ riẹ [ Ovie na Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; re ọre na o te ti wo odẹ riẹ , re o jiri ei , re o jiri ai , re a jiri ei , re a jiri ei .\n", "2020-01-18 07:28:23,082 Example #3\n", "2020-01-18 07:28:23,082 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 07:28:23,082 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 07:28:23,082 \tHypothesis: Ghele na , eme uwou - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 07:28:23,082 Validation result (greedy) at epoch 17, step 39000: bleu: 28.60, loss: 35450.5625, ppl: 4.6367, duration: 49.9022s\n", "2020-01-18 07:28:43,236 Epoch 17 Step: 39100 Batch Loss: 1.354239 Tokens per Sec: 10497, Lr: 0.000300\n", "2020-01-18 07:29:03,140 Epoch 17 Step: 39200 Batch Loss: 1.476352 Tokens per Sec: 10678, Lr: 0.000300\n", "2020-01-18 07:29:23,031 Epoch 17 Step: 39300 Batch Loss: 1.627146 Tokens per Sec: 10738, Lr: 0.000300\n", "2020-01-18 07:29:43,014 Epoch 17 Step: 39400 Batch Loss: 1.470805 Tokens per Sec: 10668, Lr: 0.000300\n", "2020-01-18 07:30:02,839 Epoch 17 Step: 39500 Batch Loss: 1.492045 Tokens per Sec: 10678, Lr: 0.000300\n", "2020-01-18 07:30:23,010 Epoch 17 Step: 39600 Batch Loss: 1.594678 Tokens per Sec: 10838, Lr: 0.000300\n", "2020-01-18 07:30:43,179 Epoch 17 Step: 39700 Batch Loss: 1.372329 Tokens per Sec: 10863, Lr: 0.000300\n", "2020-01-18 07:31:03,127 Epoch 17 Step: 39800 Batch Loss: 1.429562 Tokens per Sec: 10732, Lr: 0.000300\n", "2020-01-18 07:31:21,039 Epoch 17: total training loss 3295.67\n", "2020-01-18 07:31:21,040 EPOCH 18\n", "2020-01-18 07:31:23,028 Epoch 18 Step: 39900 Batch Loss: 1.485010 Tokens per Sec: 9625, Lr: 0.000300\n", "2020-01-18 07:31:43,033 Epoch 18 Step: 40000 Batch Loss: 1.433671 Tokens per Sec: 10780, Lr: 0.000300\n", "2020-01-18 07:32:31,001 Example #0\n", "2020-01-18 07:32:31,003 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 07:32:31,003 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 07:32:31,003 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ emamọ eva . ’\n", "2020-01-18 07:32:31,003 Example #1\n", "2020-01-18 07:32:31,003 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 07:32:31,004 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 07:32:31,004 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 07:32:31,004 Example #2\n", "2020-01-18 07:32:31,004 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 07:32:31,004 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 07:32:31,004 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai kpobi nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana , onọ o rẹ sasa oma : “ Jọ odẹ riẹ [ Ovie Jesu Kristi ] ọ jọ bẹdẹ bẹdẹ ; re ọre na ọ jọ bẹdẹ bẹdẹ ; re o jiri odẹ riẹ , re o jiri erẹwho akpọ na kpobi ; jọ erẹwho na kpobi e ghale ae .\n", "2020-01-18 07:32:31,005 Example #3\n", "2020-01-18 07:32:31,005 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 07:32:31,005 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 07:32:31,005 \tHypothesis: Ghele na , eme uwou - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 07:32:31,005 Validation result (greedy) at epoch 18, step 40000: bleu: 28.60, loss: 35579.9219, ppl: 4.6627, duration: 47.9724s\n", "2020-01-18 07:32:50,966 Epoch 18 Step: 40100 Batch Loss: 1.252155 Tokens per Sec: 10832, Lr: 0.000300\n", "2020-01-18 07:33:10,916 Epoch 18 Step: 40200 Batch Loss: 1.196141 Tokens per Sec: 10606, Lr: 0.000300\n", "2020-01-18 07:33:30,844 Epoch 18 Step: 40300 Batch Loss: 1.124102 Tokens per Sec: 10669, Lr: 0.000300\n", "2020-01-18 07:33:51,038 Epoch 18 Step: 40400 Batch Loss: 1.057000 Tokens per Sec: 10646, Lr: 0.000300\n", "2020-01-18 07:34:10,787 Epoch 18 Step: 40500 Batch Loss: 1.410959 Tokens per Sec: 10858, Lr: 0.000300\n", "2020-01-18 07:34:30,955 Epoch 18 Step: 40600 Batch Loss: 1.561197 Tokens per Sec: 10628, Lr: 0.000300\n", "2020-01-18 07:34:50,955 Epoch 18 Step: 40700 Batch Loss: 1.331983 Tokens per Sec: 10969, Lr: 0.000300\n", "2020-01-18 07:35:10,832 Epoch 18 Step: 40800 Batch Loss: 1.407473 Tokens per Sec: 10839, Lr: 0.000300\n", "2020-01-18 07:35:30,669 Epoch 18 Step: 40900 Batch Loss: 1.335044 Tokens per Sec: 10784, Lr: 0.000300\n", "2020-01-18 07:35:50,748 Epoch 18 Step: 41000 Batch Loss: 1.212010 Tokens per Sec: 10672, Lr: 0.000300\n", "2020-01-18 07:36:38,609 Hooray! New best validation result [ppl]!\n", "2020-01-18 07:36:38,610 Saving new checkpoint.\n", "2020-01-18 07:36:40,637 Example #0\n", "2020-01-18 07:36:40,638 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 07:36:40,638 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 07:36:40,638 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 07:36:40,638 Example #1\n", "2020-01-18 07:36:40,639 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 07:36:40,639 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 07:36:40,639 \tHypothesis: A rehọ omobe - ovẹvẹ Uvie na “ Wuhrẹ Ahwo ” ( A .\n", "2020-01-18 07:36:40,639 Example #2\n", "2020-01-18 07:36:40,639 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 07:36:40,640 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 07:36:40,640 \tHypothesis: Fikiere , mai kpobi ma te rọ evawere fiba irru mai avọ oghọghọ orọ ole oghọghọ nana : “ Jọ odẹ riẹ [ Ovie na Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; re ọre na ọ ruẹse jiri odẹ riẹ , re o jiri erẹwho na kpobi ; re a ruẹse jiri ei , re a ruẹse ghale ae , re a ruẹse ghale ae . . . .\n", "2020-01-18 07:36:40,640 Example #3\n", "2020-01-18 07:36:40,640 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 07:36:40,640 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 07:36:40,641 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 07:36:40,641 Validation result (greedy) at epoch 18, step 41000: bleu: 28.94, loss: 35408.5977, ppl: 4.6282, duration: 49.8921s\n", "2020-01-18 07:37:01,077 Epoch 18 Step: 41100 Batch Loss: 1.361779 Tokens per Sec: 10588, Lr: 0.000300\n", "2020-01-18 07:37:20,991 Epoch 18 Step: 41200 Batch Loss: 1.223220 Tokens per Sec: 10513, Lr: 0.000300\n", "2020-01-18 07:37:41,248 Epoch 18 Step: 41300 Batch Loss: 1.312202 Tokens per Sec: 10759, Lr: 0.000300\n", "2020-01-18 07:38:01,191 Epoch 18 Step: 41400 Batch Loss: 1.345863 Tokens per Sec: 10686, Lr: 0.000300\n", "2020-01-18 07:38:21,096 Epoch 18 Step: 41500 Batch Loss: 1.555451 Tokens per Sec: 10707, Lr: 0.000300\n", "2020-01-18 07:38:41,096 Epoch 18 Step: 41600 Batch Loss: 1.361452 Tokens per Sec: 10551, Lr: 0.000300\n", "2020-01-18 07:39:01,014 Epoch 18 Step: 41700 Batch Loss: 1.342587 Tokens per Sec: 10670, Lr: 0.000300\n", "2020-01-18 07:39:21,291 Epoch 18 Step: 41800 Batch Loss: 1.458442 Tokens per Sec: 10766, Lr: 0.000300\n", "2020-01-18 07:39:41,366 Epoch 18 Step: 41900 Batch Loss: 1.529309 Tokens per Sec: 10863, Lr: 0.000300\n", "2020-01-18 07:40:01,401 Epoch 18 Step: 42000 Batch Loss: 1.619513 Tokens per Sec: 10465, Lr: 0.000300\n", "2020-01-18 07:40:49,282 Hooray! New best validation result [ppl]!\n", "2020-01-18 07:40:49,283 Saving new checkpoint.\n", "2020-01-18 07:40:51,789 Example #0\n", "2020-01-18 07:40:51,789 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 07:40:51,789 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 07:40:51,789 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ emamọ eva . ’\n", "2020-01-18 07:40:51,789 Example #1\n", "2020-01-18 07:40:51,790 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 07:40:51,790 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 07:40:51,790 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 07:40:51,790 Example #2\n", "2020-01-18 07:40:51,790 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 07:40:51,790 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 07:40:51,790 \tHypothesis: Fikiere , mai kpobi ma te rọ oghọghọ fiba ole owoma nana gbe ole oghọghọ nana : “ Jọ odẹ riẹ [ Ovie na Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; re ọre na ọ te rehọ odẹ riẹ jiri ei , re o ru re o wo oghale , re o jọ ujiro kẹ ahwo kpobi ; re o jọ ujiro riẹ , re o jọ kẹ ae kpobi oro .\n", "2020-01-18 07:40:51,790 Example #3\n", "2020-01-18 07:40:51,791 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 07:40:51,791 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 07:40:51,791 \tHypothesis: Ghele na , eme uwou - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 07:40:51,791 Validation result (greedy) at epoch 18, step 42000: bleu: 28.68, loss: 35205.0117, ppl: 4.5876, duration: 50.3891s\n", "2020-01-18 07:41:12,077 Epoch 18 Step: 42100 Batch Loss: 1.476315 Tokens per Sec: 10516, Lr: 0.000300\n", "2020-01-18 07:41:32,363 Epoch 18 Step: 42200 Batch Loss: 1.230944 Tokens per Sec: 10798, Lr: 0.000300\n", "2020-01-18 07:41:40,122 Epoch 18: total training loss 3239.58\n", "2020-01-18 07:41:40,122 EPOCH 19\n", "2020-01-18 07:41:52,815 Epoch 19 Step: 42300 Batch Loss: 1.380158 Tokens per Sec: 10610, Lr: 0.000300\n", "2020-01-18 07:42:12,772 Epoch 19 Step: 42400 Batch Loss: 1.389973 Tokens per Sec: 10834, Lr: 0.000300\n", "2020-01-18 07:42:32,869 Epoch 19 Step: 42500 Batch Loss: 1.423778 Tokens per Sec: 10792, Lr: 0.000300\n", "2020-01-18 07:42:52,716 Epoch 19 Step: 42600 Batch Loss: 1.271419 Tokens per Sec: 10642, Lr: 0.000300\n", "2020-01-18 07:43:12,586 Epoch 19 Step: 42700 Batch Loss: 1.718878 Tokens per Sec: 11039, Lr: 0.000300\n", "2020-01-18 07:43:32,714 Epoch 19 Step: 42800 Batch Loss: 1.305312 Tokens per Sec: 10882, Lr: 0.000300\n", "2020-01-18 07:43:52,910 Epoch 19 Step: 42900 Batch Loss: 1.451074 Tokens per Sec: 10643, Lr: 0.000300\n", "2020-01-18 07:44:12,781 Epoch 19 Step: 43000 Batch Loss: 1.246700 Tokens per Sec: 11002, Lr: 0.000300\n", "2020-01-18 07:45:00,670 Example #0\n", "2020-01-18 07:45:00,671 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 07:45:00,672 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 07:45:00,672 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 07:45:00,672 Example #1\n", "2020-01-18 07:45:00,672 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 07:45:00,672 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 07:45:00,672 \tHypothesis: A rehọ omobe - ovẹvẹ Uvie na lele iei , Ọrọ Avọ 4\n", "2020-01-18 07:45:00,673 Example #2\n", "2020-01-18 07:45:00,673 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 07:45:00,673 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 07:45:00,673 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba urru mai nọ ma te horie abọ urere ọrọ ole oghọghọ nana , jẹ so ole oghọghọ : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre na ọ jọ bẹdẹ ; re o ru odẹ riẹ vihọ , re o jiri ai ; re o jiri ai .\n", "2020-01-18 07:45:00,673 Example #3\n", "2020-01-18 07:45:00,674 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 07:45:00,674 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 07:45:00,674 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 07:45:00,674 Validation result (greedy) at epoch 19, step 43000: bleu: 28.76, loss: 35346.2266, ppl: 4.6158, duration: 47.8927s\n", "2020-01-18 07:45:20,457 Epoch 19 Step: 43100 Batch Loss: 1.500628 Tokens per Sec: 10614, Lr: 0.000300\n", "2020-01-18 07:45:40,650 Epoch 19 Step: 43200 Batch Loss: 1.366591 Tokens per Sec: 10928, Lr: 0.000300\n", "2020-01-18 07:46:00,650 Epoch 19 Step: 43300 Batch Loss: 1.535833 Tokens per Sec: 10624, Lr: 0.000300\n", "2020-01-18 07:46:20,453 Epoch 19 Step: 43400 Batch Loss: 1.230575 Tokens per Sec: 10907, Lr: 0.000300\n", "2020-01-18 07:46:40,296 Epoch 19 Step: 43500 Batch Loss: 1.145455 Tokens per Sec: 10669, Lr: 0.000300\n", "2020-01-18 07:47:00,463 Epoch 19 Step: 43600 Batch Loss: 1.475590 Tokens per Sec: 10576, Lr: 0.000300\n", "2020-01-18 07:47:20,461 Epoch 19 Step: 43700 Batch Loss: 1.098913 Tokens per Sec: 10742, Lr: 0.000300\n", "2020-01-18 07:47:40,393 Epoch 19 Step: 43800 Batch Loss: 1.528338 Tokens per Sec: 10612, Lr: 0.000300\n", "2020-01-18 07:48:00,410 Epoch 19 Step: 43900 Batch Loss: 1.488710 Tokens per Sec: 10676, Lr: 0.000300\n", "2020-01-18 07:48:20,191 Epoch 19 Step: 44000 Batch Loss: 1.300468 Tokens per Sec: 10610, Lr: 0.000300\n", "2020-01-18 07:49:08,179 Hooray! New best validation result [ppl]!\n", "2020-01-18 07:49:08,179 Saving new checkpoint.\n", "2020-01-18 07:49:10,314 Example #0\n", "2020-01-18 07:49:10,315 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 07:49:10,315 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 07:49:10,315 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 07:49:10,315 Example #1\n", "2020-01-18 07:49:10,316 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 07:49:10,316 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 07:49:10,316 \tHypothesis: A rehọ omobe Usi Uvie na “ Ru onana ” ( F .\n", "2020-01-18 07:49:10,316 Example #2\n", "2020-01-18 07:49:10,317 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 07:49:10,317 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 07:49:10,317 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba urru mai nọ u ti kuhọ avọ ole owoma nana , onọ o ta nọ : “ Jọ odẹ riẹ [ Ovie na Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre na ọ jọ bẹdẹ bẹdẹ , re odẹ riẹ o jọ ruaro , re o jiri ai kpobi ; re a jiri ei .\n", "2020-01-18 07:49:10,317 Example #3\n", "2020-01-18 07:49:10,318 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 07:49:10,318 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 07:49:10,318 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ogaga kẹ udhedhẹ .\n", "2020-01-18 07:49:10,318 Validation result (greedy) at epoch 19, step 44000: bleu: 28.91, loss: 35156.0508, ppl: 4.5779, duration: 50.1269s\n", "2020-01-18 07:49:30,689 Epoch 19 Step: 44100 Batch Loss: 1.469175 Tokens per Sec: 10385, Lr: 0.000300\n", "2020-01-18 07:49:50,494 Epoch 19 Step: 44200 Batch Loss: 1.128919 Tokens per Sec: 10636, Lr: 0.000300\n", "2020-01-18 07:50:10,544 Epoch 19 Step: 44300 Batch Loss: 1.466178 Tokens per Sec: 10846, Lr: 0.000300\n", "2020-01-18 07:50:30,608 Epoch 19 Step: 44400 Batch Loss: 1.203102 Tokens per Sec: 10561, Lr: 0.000300\n", "2020-01-18 07:50:50,671 Epoch 19 Step: 44500 Batch Loss: 1.301054 Tokens per Sec: 10638, Lr: 0.000300\n", "2020-01-18 07:51:08,367 Epoch 19: total training loss 3198.81\n", "2020-01-18 07:51:08,367 EPOCH 20\n", "2020-01-18 07:51:11,026 Epoch 20 Step: 44600 Batch Loss: 1.360538 Tokens per Sec: 9436, Lr: 0.000300\n", "2020-01-18 07:51:31,077 Epoch 20 Step: 44700 Batch Loss: 1.153853 Tokens per Sec: 11005, Lr: 0.000300\n", "2020-01-18 07:51:50,829 Epoch 20 Step: 44800 Batch Loss: 1.387803 Tokens per Sec: 11030, Lr: 0.000300\n", "2020-01-18 07:52:10,772 Epoch 20 Step: 44900 Batch Loss: 1.385661 Tokens per Sec: 10654, Lr: 0.000300\n", "2020-01-18 07:52:30,780 Epoch 20 Step: 45000 Batch Loss: 1.331513 Tokens per Sec: 10762, Lr: 0.000300\n", "2020-01-18 07:53:18,719 Example #0\n", "2020-01-18 07:53:18,720 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 07:53:18,721 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 07:53:18,721 \tHypothesis: Ma rẹ sae yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 07:53:18,721 Example #1\n", "2020-01-18 07:53:18,721 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 07:53:18,722 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 07:53:18,722 \tHypothesis: A rehọ omobe Usi Uvie na No Ze , Ọrọ Avọ 4\n", "2020-01-18 07:53:18,722 Example #2\n", "2020-01-18 07:53:18,722 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 07:53:18,722 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 07:53:18,723 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba eme urere nana nọ i ti kuhọ avọ ole evawere nana : “ Jọ odẹ riẹ [ Ovie na Jesu Kristi ] ọ jọ bẹdẹ bẹdẹ ; re ọre o te ti vihọ , re o jiri ai , re o jiri ai , re ọ ghale ae kpobi ; re a jiri ei .\n", "2020-01-18 07:53:18,723 Example #3\n", "2020-01-18 07:53:18,723 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 07:53:18,723 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 07:53:18,724 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 07:53:18,724 Validation result (greedy) at epoch 20, step 45000: bleu: 29.42, loss: 35223.7852, ppl: 4.5914, duration: 47.9436s\n", "2020-01-18 07:53:38,620 Epoch 20 Step: 45100 Batch Loss: 1.306087 Tokens per Sec: 10447, Lr: 0.000300\n", "2020-01-18 07:53:58,874 Epoch 20 Step: 45200 Batch Loss: 1.166879 Tokens per Sec: 10639, Lr: 0.000300\n", "2020-01-18 07:54:19,024 Epoch 20 Step: 45300 Batch Loss: 1.458781 Tokens per Sec: 10670, Lr: 0.000300\n", "2020-01-18 07:54:38,999 Epoch 20 Step: 45400 Batch Loss: 1.301023 Tokens per Sec: 10856, Lr: 0.000300\n", "2020-01-18 07:54:58,991 Epoch 20 Step: 45500 Batch Loss: 1.521506 Tokens per Sec: 10850, Lr: 0.000300\n", "2020-01-18 07:55:18,864 Epoch 20 Step: 45600 Batch Loss: 1.483567 Tokens per Sec: 10691, Lr: 0.000300\n", "2020-01-18 07:55:38,809 Epoch 20 Step: 45700 Batch Loss: 1.218983 Tokens per Sec: 10723, Lr: 0.000300\n", "2020-01-18 07:55:58,738 Epoch 20 Step: 45800 Batch Loss: 1.583645 Tokens per Sec: 10850, Lr: 0.000300\n", "2020-01-18 07:56:18,689 Epoch 20 Step: 45900 Batch Loss: 1.338513 Tokens per Sec: 10905, Lr: 0.000300\n", "2020-01-18 07:56:38,704 Epoch 20 Step: 46000 Batch Loss: 1.271620 Tokens per Sec: 10792, Lr: 0.000300\n", "2020-01-18 07:57:26,566 Hooray! New best validation result [ppl]!\n", "2020-01-18 07:57:26,567 Saving new checkpoint.\n", "2020-01-18 07:57:28,720 Example #0\n", "2020-01-18 07:57:28,720 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 07:57:28,720 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 07:57:28,720 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 07:57:28,720 Example #1\n", "2020-01-18 07:57:28,721 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 07:57:28,721 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 07:57:28,721 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 07:57:28,721 Example #2\n", "2020-01-18 07:57:28,721 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 07:57:28,721 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 07:57:28,721 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba urru mai nọ ma te se abọjọ ole owoma nana , onọ o rẹ sasa oma : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ bẹdẹ ; re ọre na o te ti vihọ , re o jiri ei , re ọ ghale erẹwho na kpobi ; re a jiri ei .\n", "2020-01-18 07:57:28,721 Example #3\n", "2020-01-18 07:57:28,722 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 07:57:28,722 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 07:57:28,722 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 07:57:28,722 Validation result (greedy) at epoch 20, step 46000: bleu: 28.96, loss: 34995.0156, ppl: 4.5461, duration: 50.0174s\n", "2020-01-18 07:57:49,804 Epoch 20 Step: 46100 Batch Loss: 1.375950 Tokens per Sec: 10127, Lr: 0.000300\n", "2020-01-18 07:58:09,864 Epoch 20 Step: 46200 Batch Loss: 1.449447 Tokens per Sec: 11012, Lr: 0.000300\n", "2020-01-18 07:58:30,051 Epoch 20 Step: 46300 Batch Loss: 1.225489 Tokens per Sec: 10828, Lr: 0.000300\n", "2020-01-18 07:58:50,138 Epoch 20 Step: 46400 Batch Loss: 1.380264 Tokens per Sec: 10644, Lr: 0.000300\n", "2020-01-18 07:59:10,123 Epoch 20 Step: 46500 Batch Loss: 1.260869 Tokens per Sec: 10782, Lr: 0.000300\n", "2020-01-18 07:59:30,206 Epoch 20 Step: 46600 Batch Loss: 1.271563 Tokens per Sec: 10768, Lr: 0.000300\n", "2020-01-18 07:59:50,033 Epoch 20 Step: 46700 Batch Loss: 1.064790 Tokens per Sec: 10548, Lr: 0.000300\n", "2020-01-18 08:00:10,158 Epoch 20 Step: 46800 Batch Loss: 1.432777 Tokens per Sec: 10488, Lr: 0.000300\n", "2020-01-18 08:00:30,233 Epoch 20 Step: 46900 Batch Loss: 1.198740 Tokens per Sec: 10841, Lr: 0.000300\n", "2020-01-18 08:00:35,994 Epoch 20: total training loss 3141.79\n", "2020-01-18 08:00:35,994 EPOCH 21\n", "2020-01-18 08:00:50,453 Epoch 21 Step: 47000 Batch Loss: 1.376979 Tokens per Sec: 10795, Lr: 0.000300\n", "2020-01-18 08:01:38,367 Hooray! New best validation result [ppl]!\n", "2020-01-18 08:01:38,368 Saving new checkpoint.\n", "2020-01-18 08:01:40,402 Example #0\n", "2020-01-18 08:01:40,402 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 08:01:40,402 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 08:01:40,402 \tHypothesis: Ma rẹ sae yare Ọghẹnẹ re ọ ‘ ma omai evaọ emamọ eva . ’\n", "2020-01-18 08:01:40,403 Example #1\n", "2020-01-18 08:01:40,403 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 08:01:40,403 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 08:01:40,403 \tHypothesis: A rehọ omobe - ovẹvẹ Uvie na Ru onana , Ọrọ Avọ 4\n", "2020-01-18 08:01:40,403 Example #2\n", "2020-01-18 08:01:40,403 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 08:01:40,403 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 08:01:40,403 \tHypothesis: Koyehọ mai kpobi ma te rọ evawere fiba uvo mai avọ ole owoma nana , onọ o rẹ kẹ omosasọ : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre riẹ o te vihọ , re o jiri ai kpobi ; re o jiri ai kpobi ; re o jiri ai .\n", "2020-01-18 08:01:40,404 Example #3\n", "2020-01-18 08:01:40,404 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 08:01:40,404 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 08:01:40,404 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ogaga gaga kẹ udhedhẹ .\n", "2020-01-18 08:01:40,404 Validation result (greedy) at epoch 21, step 47000: bleu: 29.09, loss: 34964.6250, ppl: 4.5402, duration: 49.9502s\n", "2020-01-18 08:02:00,603 Epoch 21 Step: 47100 Batch Loss: 1.325776 Tokens per Sec: 10797, Lr: 0.000300\n", "2020-01-18 08:02:20,789 Epoch 21 Step: 47200 Batch Loss: 1.329996 Tokens per Sec: 10720, Lr: 0.000300\n", "2020-01-18 08:02:40,895 Epoch 21 Step: 47300 Batch Loss: 1.387656 Tokens per Sec: 10852, Lr: 0.000300\n", "2020-01-18 08:03:00,954 Epoch 21 Step: 47400 Batch Loss: 1.429197 Tokens per Sec: 10608, Lr: 0.000300\n", "2020-01-18 08:03:21,114 Epoch 21 Step: 47500 Batch Loss: 1.239972 Tokens per Sec: 10921, Lr: 0.000300\n", "2020-01-18 08:03:40,943 Epoch 21 Step: 47600 Batch Loss: 1.279609 Tokens per Sec: 10898, Lr: 0.000300\n", "2020-01-18 08:04:01,215 Epoch 21 Step: 47700 Batch Loss: 1.141259 Tokens per Sec: 10727, Lr: 0.000300\n", "2020-01-18 08:04:21,242 Epoch 21 Step: 47800 Batch Loss: 1.500119 Tokens per Sec: 10716, Lr: 0.000300\n", "2020-01-18 08:04:41,421 Epoch 21 Step: 47900 Batch Loss: 1.526005 Tokens per Sec: 10735, Lr: 0.000300\n", "2020-01-18 08:05:01,462 Epoch 21 Step: 48000 Batch Loss: 1.106135 Tokens per Sec: 10675, Lr: 0.000300\n", "2020-01-18 08:05:49,381 Hooray! New best validation result [ppl]!\n", "2020-01-18 08:05:49,381 Saving new checkpoint.\n", "2020-01-18 08:05:51,379 Example #0\n", "2020-01-18 08:05:51,380 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 08:05:51,380 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 08:05:51,380 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ emamọ eva . ’\n", "2020-01-18 08:05:51,380 Example #1\n", "2020-01-18 08:05:51,381 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 08:05:51,381 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 08:05:51,381 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 08:05:51,381 Example #2\n", "2020-01-18 08:05:51,382 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 08:05:51,382 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 08:05:51,382 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba irru mai re ma ku ole owoma nana gbe ole omosasọ nana họ : “ Jọ odẹ riẹ [ Ovie na Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; re ọre na o te ti ru odẹ riẹ ghọghọ , re o jiri ai , re o jiri erẹwho kpobi ; re a jiri ei .\n", "2020-01-18 08:05:51,382 Example #3\n", "2020-01-18 08:05:51,383 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 08:05:51,383 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 08:05:51,383 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 08:05:51,383 Validation result (greedy) at epoch 21, step 48000: bleu: 28.96, loss: 34925.3242, ppl: 4.5325, duration: 49.9202s\n", "2020-01-18 08:06:11,455 Epoch 21 Step: 48100 Batch Loss: 1.412856 Tokens per Sec: 10645, Lr: 0.000300\n", "2020-01-18 08:06:31,348 Epoch 21 Step: 48200 Batch Loss: 0.964000 Tokens per Sec: 10606, Lr: 0.000300\n", "2020-01-18 08:06:51,339 Epoch 21 Step: 48300 Batch Loss: 1.406074 Tokens per Sec: 10695, Lr: 0.000300\n", "2020-01-18 08:07:11,302 Epoch 21 Step: 48400 Batch Loss: 1.347398 Tokens per Sec: 10728, Lr: 0.000300\n", "2020-01-18 08:07:31,017 Epoch 21 Step: 48500 Batch Loss: 1.289991 Tokens per Sec: 10709, Lr: 0.000300\n", "2020-01-18 08:07:50,874 Epoch 21 Step: 48600 Batch Loss: 1.491852 Tokens per Sec: 10594, Lr: 0.000300\n", "2020-01-18 08:08:10,882 Epoch 21 Step: 48700 Batch Loss: 1.416115 Tokens per Sec: 10708, Lr: 0.000300\n", "2020-01-18 08:08:30,837 Epoch 21 Step: 48800 Batch Loss: 1.547986 Tokens per Sec: 10775, Lr: 0.000300\n", "2020-01-18 08:08:50,890 Epoch 21 Step: 48900 Batch Loss: 1.383715 Tokens per Sec: 10527, Lr: 0.000300\n", "2020-01-18 08:09:10,869 Epoch 21 Step: 49000 Batch Loss: 1.272665 Tokens per Sec: 10809, Lr: 0.000300\n", "2020-01-18 08:09:58,856 Hooray! New best validation result [ppl]!\n", "2020-01-18 08:09:58,857 Saving new checkpoint.\n", "2020-01-18 08:10:00,863 Example #0\n", "2020-01-18 08:10:00,863 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 08:10:00,863 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 08:10:00,864 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 08:10:00,864 Example #1\n", "2020-01-18 08:10:00,864 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 08:10:00,864 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 08:10:00,864 \tHypothesis: A rehọ omobe - ovẹvẹ Uvie na No , Ọrọ Avọ Ijo .\n", "2020-01-18 08:10:00,864 Example #2\n", "2020-01-18 08:10:00,864 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 08:10:00,864 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 08:10:00,864 \tHypothesis: O wọhọ ẹsenọ mai kpobi ma te rọ evawere koko irru mai họ re ma ku ole owoma nana gbe ole evawere nana họ : “ Jọ odẹ riẹ [ Ovie na Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; re ọre na o te ru odẹ riẹ kẹre , re o jiri ei , re o jiri erẹwho akpọ na kpobi ; re a jiri ei .\n", "2020-01-18 08:10:00,865 Example #3\n", "2020-01-18 08:10:00,865 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 08:10:00,865 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 08:10:00,865 \tHypothesis: Ghele na , eme uwou - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 08:10:00,865 Validation result (greedy) at epoch 21, step 49000: bleu: 29.09, loss: 34836.8320, ppl: 4.5151, duration: 49.9954s\n", "2020-01-18 08:10:21,223 Epoch 21 Step: 49100 Batch Loss: 1.455827 Tokens per Sec: 10615, Lr: 0.000300\n", "2020-01-18 08:10:41,266 Epoch 21 Step: 49200 Batch Loss: 1.437428 Tokens per Sec: 10693, Lr: 0.000300\n", "2020-01-18 08:10:55,988 Epoch 21: total training loss 3111.55\n", "2020-01-18 08:10:55,988 EPOCH 22\n", "2020-01-18 08:11:01,360 Epoch 22 Step: 49300 Batch Loss: 1.272516 Tokens per Sec: 9906, Lr: 0.000300\n", "2020-01-18 08:11:21,297 Epoch 22 Step: 49400 Batch Loss: 1.368730 Tokens per Sec: 10958, Lr: 0.000300\n", "2020-01-18 08:11:41,380 Epoch 22 Step: 49500 Batch Loss: 1.270614 Tokens per Sec: 10839, Lr: 0.000300\n", "2020-01-18 08:12:01,310 Epoch 22 Step: 49600 Batch Loss: 1.402286 Tokens per Sec: 10650, Lr: 0.000300\n", "2020-01-18 08:12:21,401 Epoch 22 Step: 49700 Batch Loss: 1.009780 Tokens per Sec: 11271, Lr: 0.000300\n", "2020-01-18 08:12:41,054 Epoch 22 Step: 49800 Batch Loss: 1.279547 Tokens per Sec: 10569, Lr: 0.000300\n", "2020-01-18 08:13:01,044 Epoch 22 Step: 49900 Batch Loss: 1.380828 Tokens per Sec: 10639, Lr: 0.000300\n", "2020-01-18 08:13:20,901 Epoch 22 Step: 50000 Batch Loss: 1.288526 Tokens per Sec: 10548, Lr: 0.000300\n", "2020-01-18 08:14:08,772 Example #0\n", "2020-01-18 08:14:08,772 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 08:14:08,772 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 08:14:08,773 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ emamọ eva . ’\n", "2020-01-18 08:14:08,773 Example #1\n", "2020-01-18 08:14:08,773 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 08:14:08,773 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 08:14:08,774 \tHypothesis: A te ru onana , Ọrọ Avọ 4\n", "2020-01-18 08:14:08,774 Example #2\n", "2020-01-18 08:14:08,774 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 08:14:08,774 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 08:14:08,775 \tHypothesis: O wọhọ ẹsenọ mai kpobi ma te rọ oghọghọ fiba ole oghọghọ nana gbe ole omosasọ nana : “ Jọ odẹ riẹ [ Ovie na Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; jọ ọre o lo mu ei , re o ru re ahwo kpobi a jiri ei , re a jiri ei .\n", "2020-01-18 08:14:08,775 Example #3\n", "2020-01-18 08:14:08,775 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 08:14:08,775 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 08:14:08,775 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ogaga gaga kẹ udhedhẹ .\n", "2020-01-18 08:14:08,776 Validation result (greedy) at epoch 22, step 50000: bleu: 29.51, loss: 34988.9531, ppl: 4.5450, duration: 47.8745s\n", "2020-01-18 08:14:28,701 Epoch 22 Step: 50100 Batch Loss: 1.401965 Tokens per Sec: 10563, Lr: 0.000300\n", "2020-01-18 08:14:48,641 Epoch 22 Step: 50200 Batch Loss: 1.441787 Tokens per Sec: 10631, Lr: 0.000300\n", "2020-01-18 08:15:08,627 Epoch 22 Step: 50300 Batch Loss: 1.363623 Tokens per Sec: 10902, Lr: 0.000300\n", "2020-01-18 08:15:28,689 Epoch 22 Step: 50400 Batch Loss: 1.034179 Tokens per Sec: 10723, Lr: 0.000300\n", "2020-01-18 08:15:48,774 Epoch 22 Step: 50500 Batch Loss: 1.487871 Tokens per Sec: 10759, Lr: 0.000300\n", "2020-01-18 08:16:08,815 Epoch 22 Step: 50600 Batch Loss: 1.334423 Tokens per Sec: 10918, Lr: 0.000300\n", "2020-01-18 08:16:28,832 Epoch 22 Step: 50700 Batch Loss: 1.197383 Tokens per Sec: 10844, Lr: 0.000300\n", "2020-01-18 08:16:48,717 Epoch 22 Step: 50800 Batch Loss: 1.202737 Tokens per Sec: 10555, Lr: 0.000300\n", "2020-01-18 08:17:08,693 Epoch 22 Step: 50900 Batch Loss: 1.338594 Tokens per Sec: 10719, Lr: 0.000300\n", "2020-01-18 08:17:28,801 Epoch 22 Step: 51000 Batch Loss: 1.476505 Tokens per Sec: 10619, Lr: 0.000300\n", "2020-01-18 08:18:16,762 Hooray! New best validation result [ppl]!\n", "2020-01-18 08:18:16,763 Saving new checkpoint.\n", "2020-01-18 08:18:18,895 Example #0\n", "2020-01-18 08:18:18,895 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 08:18:18,896 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 08:18:18,896 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 08:18:18,896 Example #1\n", "2020-01-18 08:18:18,896 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 08:18:18,897 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 08:18:18,897 \tHypothesis: A rehọ omobe - ovẹvẹ Uvie na Ru onana , Ọrọ Avọ Ijo .\n", "2020-01-18 08:18:18,897 Example #2\n", "2020-01-18 08:18:18,897 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 08:18:18,897 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 08:18:18,898 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba abọ urere ọrọ ole oghọghọ nana gbe ole oghọghọ : “ Jọ odẹ riẹ [ koyehọ Jesu Kristi Ovie na ] o jọ bẹdẹ bẹdẹ ; re ọre o te lo , re o jiri odẹ riẹ , re o jiri erẹwho na kpobi ; re a jiri ei .\n", "2020-01-18 08:18:18,898 Example #3\n", "2020-01-18 08:18:18,898 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 08:18:18,898 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 08:18:18,899 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re a ru udhedhẹ .\n", "2020-01-18 08:18:18,899 Validation result (greedy) at epoch 22, step 51000: bleu: 29.75, loss: 34817.0352, ppl: 4.5113, duration: 50.0976s\n", "2020-01-18 08:18:39,499 Epoch 22 Step: 51100 Batch Loss: 1.037926 Tokens per Sec: 10654, Lr: 0.000300\n", "2020-01-18 08:18:59,521 Epoch 22 Step: 51200 Batch Loss: 1.275745 Tokens per Sec: 10885, Lr: 0.000300\n", "2020-01-18 08:19:19,538 Epoch 22 Step: 51300 Batch Loss: 1.236592 Tokens per Sec: 10645, Lr: 0.000300\n", "2020-01-18 08:19:39,472 Epoch 22 Step: 51400 Batch Loss: 1.321240 Tokens per Sec: 10728, Lr: 0.000300\n", "2020-01-18 08:19:59,555 Epoch 22 Step: 51500 Batch Loss: 1.478963 Tokens per Sec: 10636, Lr: 0.000300\n", "2020-01-18 08:20:19,648 Epoch 22 Step: 51600 Batch Loss: 1.390687 Tokens per Sec: 10476, Lr: 0.000300\n", "2020-01-18 08:20:24,213 Epoch 22: total training loss 3081.11\n", "2020-01-18 08:20:24,213 EPOCH 23\n", "2020-01-18 08:20:39,797 Epoch 23 Step: 51700 Batch Loss: 1.108505 Tokens per Sec: 10508, Lr: 0.000300\n", "2020-01-18 08:20:59,931 Epoch 23 Step: 51800 Batch Loss: 1.304594 Tokens per Sec: 10948, Lr: 0.000300\n", "2020-01-18 08:21:20,057 Epoch 23 Step: 51900 Batch Loss: 1.368002 Tokens per Sec: 10393, Lr: 0.000300\n", "2020-01-18 08:21:39,958 Epoch 23 Step: 52000 Batch Loss: 1.310570 Tokens per Sec: 10976, Lr: 0.000300\n", "2020-01-18 08:22:27,839 Example #0\n", "2020-01-18 08:22:27,841 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 08:22:27,841 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 08:22:27,841 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 08:22:27,841 Example #1\n", "2020-01-18 08:22:27,842 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 08:22:27,842 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 08:22:27,842 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 2\n", "2020-01-18 08:22:27,842 Example #2\n", "2020-01-18 08:22:27,843 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 08:22:27,843 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 08:22:27,843 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba ole oghọghọ nana gbe ole oghọghọ nana : “ Jọ odẹ riẹ [ Ovie na ] o jọ bẹdẹ ; re ọre o te lo , re o jiri odẹ riẹ , re o jiri erẹwho kpobi ; re a jiri ei .\n", "2020-01-18 08:22:27,843 Example #3\n", "2020-01-18 08:22:27,844 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 08:22:27,844 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 08:22:27,844 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ọgaga nọ a re ro ru udhedhẹ .\n", "2020-01-18 08:22:27,844 Validation result (greedy) at epoch 23, step 52000: bleu: 29.48, loss: 34967.6758, ppl: 4.5408, duration: 47.8862s\n", "2020-01-18 08:22:47,969 Epoch 23 Step: 52100 Batch Loss: 1.185170 Tokens per Sec: 10773, Lr: 0.000300\n", "2020-01-18 08:23:07,957 Epoch 23 Step: 52200 Batch Loss: 1.282430 Tokens per Sec: 10697, Lr: 0.000300\n", "2020-01-18 08:23:28,008 Epoch 23 Step: 52300 Batch Loss: 1.304889 Tokens per Sec: 10709, Lr: 0.000300\n", "2020-01-18 08:23:47,768 Epoch 23 Step: 52400 Batch Loss: 1.341553 Tokens per Sec: 10495, Lr: 0.000300\n", "2020-01-18 08:24:07,808 Epoch 23 Step: 52500 Batch Loss: 1.239015 Tokens per Sec: 10938, Lr: 0.000300\n", "2020-01-18 08:24:28,178 Epoch 23 Step: 52600 Batch Loss: 1.337984 Tokens per Sec: 10749, Lr: 0.000300\n", "2020-01-18 08:24:48,199 Epoch 23 Step: 52700 Batch Loss: 1.280060 Tokens per Sec: 10863, Lr: 0.000300\n", "2020-01-18 08:25:08,157 Epoch 23 Step: 52800 Batch Loss: 1.309275 Tokens per Sec: 10804, Lr: 0.000300\n", "2020-01-18 08:25:28,319 Epoch 23 Step: 52900 Batch Loss: 1.332407 Tokens per Sec: 10958, Lr: 0.000300\n", "2020-01-18 08:25:48,389 Epoch 23 Step: 53000 Batch Loss: 1.279435 Tokens per Sec: 10834, Lr: 0.000300\n", "2020-01-18 08:26:36,202 Hooray! New best validation result [ppl]!\n", "2020-01-18 08:26:36,202 Saving new checkpoint.\n", "2020-01-18 08:26:38,199 Example #0\n", "2020-01-18 08:26:38,199 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 08:26:38,200 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 08:26:38,200 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ emamọ eva . ’\n", "2020-01-18 08:26:38,201 Example #1\n", "2020-01-18 08:26:38,201 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 08:26:38,202 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 08:26:38,202 \tHypothesis: A te lele iei Usi Uvie Na No , Ọrọ Avọ Ijo .\n", "2020-01-18 08:26:38,202 Example #2\n", "2020-01-18 08:26:38,202 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 08:26:38,202 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 08:26:38,202 \tHypothesis: Koyehọ , mai kpobi ma te rehọ evawere fiba uvo mai avọ ole owoma nana nọ o vọ avọ evawere na : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre o te lo , re o ru odẹ riẹ vihọ , re o jiri ei , re erẹwho kpobi e ghọghọ .\n", "2020-01-18 08:26:38,202 Example #3\n", "2020-01-18 08:26:38,203 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 08:26:38,203 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 08:26:38,203 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba ọgaga kẹ udhedhẹ .\n", "2020-01-18 08:26:38,203 Validation result (greedy) at epoch 23, step 53000: bleu: 29.83, loss: 34793.4492, ppl: 4.5067, duration: 49.8138s\n", "2020-01-18 08:26:58,607 Epoch 23 Step: 53100 Batch Loss: 1.485858 Tokens per Sec: 10296, Lr: 0.000300\n", "2020-01-18 08:27:18,553 Epoch 23 Step: 53200 Batch Loss: 1.417555 Tokens per Sec: 10845, Lr: 0.000300\n", "2020-01-18 08:27:38,558 Epoch 23 Step: 53300 Batch Loss: 1.104755 Tokens per Sec: 10417, Lr: 0.000300\n", "2020-01-18 08:27:58,503 Epoch 23 Step: 53400 Batch Loss: 1.387427 Tokens per Sec: 10722, Lr: 0.000300\n", "2020-01-18 08:28:18,476 Epoch 23 Step: 53500 Batch Loss: 1.419432 Tokens per Sec: 10554, Lr: 0.000300\n", "2020-01-18 08:28:38,411 Epoch 23 Step: 53600 Batch Loss: 1.353385 Tokens per Sec: 10684, Lr: 0.000300\n", "2020-01-18 08:28:58,521 Epoch 23 Step: 53700 Batch Loss: 1.314952 Tokens per Sec: 10850, Lr: 0.000300\n", "2020-01-18 08:29:18,391 Epoch 23 Step: 53800 Batch Loss: 1.451269 Tokens per Sec: 10411, Lr: 0.000300\n", "2020-01-18 08:29:38,394 Epoch 23 Step: 53900 Batch Loss: 1.358744 Tokens per Sec: 10764, Lr: 0.000300\n", "2020-01-18 08:29:52,469 Epoch 23: total training loss 3044.35\n", "2020-01-18 08:29:52,469 EPOCH 24\n", "2020-01-18 08:29:58,713 Epoch 24 Step: 54000 Batch Loss: 1.156111 Tokens per Sec: 10283, Lr: 0.000300\n", "2020-01-18 08:30:46,591 Hooray! New best validation result [ppl]!\n", "2020-01-18 08:30:46,591 Saving new checkpoint.\n", "2020-01-18 08:30:48,673 Example #0\n", "2020-01-18 08:30:48,673 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 08:30:48,674 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 08:30:48,674 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 08:30:48,674 Example #1\n", "2020-01-18 08:30:48,674 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 08:30:48,674 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 08:30:48,675 \tHypothesis: A rehọ omobe Usi Uvie na No Ze , Ọrọ Avọ Ijo .\n", "2020-01-18 08:30:48,675 Example #2\n", "2020-01-18 08:30:48,675 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 08:30:48,675 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 08:30:48,676 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ je fiba eme urere erọ ole owoma nana : “ Jọ odẹ riẹ [ Ovie na ] Jesu Kristi na ọ jọ bẹdẹ bẹdẹ ; re ọre na ọ ruẹse te jọ bẹdẹ bẹdẹ , re o jiri odẹ riẹ , re o jiri ai , re a jiri ei kẹ erẹwho kpobi ; re a jiri ei .\n", "2020-01-18 08:30:48,676 Example #3\n", "2020-01-18 08:30:48,676 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 08:30:48,676 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 08:30:48,677 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ a re ro ru udhedhẹ .\n", "2020-01-18 08:30:48,677 Validation result (greedy) at epoch 24, step 54000: bleu: 29.68, loss: 34634.9062, ppl: 4.4759, duration: 49.9627s\n", "2020-01-18 08:31:08,950 Epoch 24 Step: 54100 Batch Loss: 1.274743 Tokens per Sec: 10569, Lr: 0.000300\n", "2020-01-18 08:31:28,894 Epoch 24 Step: 54200 Batch Loss: 1.201700 Tokens per Sec: 10916, Lr: 0.000300\n", "2020-01-18 08:31:48,853 Epoch 24 Step: 54300 Batch Loss: 1.364601 Tokens per Sec: 10794, Lr: 0.000300\n", "2020-01-18 08:32:08,727 Epoch 24 Step: 54400 Batch Loss: 1.232834 Tokens per Sec: 10714, Lr: 0.000300\n", "2020-01-18 08:32:28,782 Epoch 24 Step: 54500 Batch Loss: 1.292854 Tokens per Sec: 10822, Lr: 0.000300\n", "2020-01-18 08:32:48,703 Epoch 24 Step: 54600 Batch Loss: 1.383616 Tokens per Sec: 10615, Lr: 0.000300\n", "2020-01-18 08:33:08,656 Epoch 24 Step: 54700 Batch Loss: 1.359449 Tokens per Sec: 10905, Lr: 0.000300\n", "2020-01-18 08:33:28,658 Epoch 24 Step: 54800 Batch Loss: 1.198861 Tokens per Sec: 10780, Lr: 0.000300\n", "2020-01-18 08:33:48,626 Epoch 24 Step: 54900 Batch Loss: 1.493926 Tokens per Sec: 10402, Lr: 0.000300\n", "2020-01-18 08:34:08,697 Epoch 24 Step: 55000 Batch Loss: 1.451183 Tokens per Sec: 11054, Lr: 0.000300\n", "2020-01-18 08:34:56,536 Example #0\n", "2020-01-18 08:34:56,537 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 08:34:56,537 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 08:34:56,537 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 08:34:56,537 Example #1\n", "2020-01-18 08:34:56,538 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 08:34:56,538 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 08:34:56,538 \tHypothesis: A rehọ omobe - ovẹvẹ Uvie na No Ze , Ọrọ Avọ Ijo .\n", "2020-01-18 08:34:56,538 Example #2\n", "2020-01-18 08:34:56,539 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 08:34:56,539 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 08:34:56,539 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba irru mai re ma se ole owoma nana nọ ọ vọ avọ evawere na : “ Jọ odẹ riẹ [ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te ti wo odẹ riẹ , re o ru re ọ ghale ae kpobi ; re o jiri ai kpobi ; re a jiri ei .\n", "2020-01-18 08:34:56,539 Example #3\n", "2020-01-18 08:34:56,539 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 08:34:56,540 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 08:34:56,540 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 08:34:56,540 Validation result (greedy) at epoch 24, step 55000: bleu: 29.90, loss: 34746.2422, ppl: 4.4975, duration: 47.8422s\n", "2020-01-18 08:35:16,645 Epoch 24 Step: 55100 Batch Loss: 1.367460 Tokens per Sec: 10772, Lr: 0.000300\n", "2020-01-18 08:35:36,787 Epoch 24 Step: 55200 Batch Loss: 1.200083 Tokens per Sec: 10914, Lr: 0.000300\n", "2020-01-18 08:35:56,846 Epoch 24 Step: 55300 Batch Loss: 1.117318 Tokens per Sec: 10801, Lr: 0.000300\n", "2020-01-18 08:36:17,011 Epoch 24 Step: 55400 Batch Loss: 1.327429 Tokens per Sec: 11109, Lr: 0.000300\n", "2020-01-18 08:36:37,015 Epoch 24 Step: 55500 Batch Loss: 1.300427 Tokens per Sec: 10658, Lr: 0.000300\n", "2020-01-18 08:36:56,897 Epoch 24 Step: 55600 Batch Loss: 1.311691 Tokens per Sec: 10461, Lr: 0.000300\n", "2020-01-18 08:37:16,978 Epoch 24 Step: 55700 Batch Loss: 1.332365 Tokens per Sec: 10918, Lr: 0.000300\n", "2020-01-18 08:37:36,881 Epoch 24 Step: 55800 Batch Loss: 1.372640 Tokens per Sec: 10863, Lr: 0.000300\n", "2020-01-18 08:37:56,789 Epoch 24 Step: 55900 Batch Loss: 1.412012 Tokens per Sec: 10730, Lr: 0.000300\n", "2020-01-18 08:38:16,722 Epoch 24 Step: 56000 Batch Loss: 1.127688 Tokens per Sec: 10591, Lr: 0.000300\n", "2020-01-18 08:39:04,571 Hooray! New best validation result [ppl]!\n", "2020-01-18 08:39:04,571 Saving new checkpoint.\n", "2020-01-18 08:39:06,592 Example #0\n", "2020-01-18 08:39:06,593 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 08:39:06,593 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 08:39:06,593 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 08:39:06,593 Example #1\n", "2020-01-18 08:39:06,593 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 08:39:06,593 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 08:39:06,593 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 08:39:06,594 Example #2\n", "2020-01-18 08:39:06,594 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 08:39:06,594 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 08:39:06,594 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba uvo mai re ma so ole owoma nana : “ Jọ odẹ riẹ [ Ovie na ] o jọ bẹdẹ ; re ọre na o te lo , re o ru odẹ riẹ kẹre , re o jiri ei , re o jiri ai eva ewere ai kpobi ; re ọre na ọ ghale ae .\n", "2020-01-18 08:39:06,594 Example #3\n", "2020-01-18 08:39:06,594 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 08:39:06,594 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 08:39:06,594 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 08:39:06,595 Validation result (greedy) at epoch 24, step 56000: bleu: 30.21, loss: 34388.3750, ppl: 4.4284, duration: 49.8722s\n", "2020-01-18 08:39:26,900 Epoch 24 Step: 56100 Batch Loss: 1.429530 Tokens per Sec: 10593, Lr: 0.000300\n", "2020-01-18 08:39:47,028 Epoch 24 Step: 56200 Batch Loss: 1.128296 Tokens per Sec: 10563, Lr: 0.000300\n", "2020-01-18 08:40:06,968 Epoch 24 Step: 56300 Batch Loss: 1.300982 Tokens per Sec: 10628, Lr: 0.000300\n", "2020-01-18 08:40:09,360 Epoch 24: total training loss 3010.08\n", "2020-01-18 08:40:09,361 EPOCH 25\n", "2020-01-18 08:40:27,358 Epoch 25 Step: 56400 Batch Loss: 1.192364 Tokens per Sec: 10525, Lr: 0.000300\n", "2020-01-18 08:40:47,423 Epoch 25 Step: 56500 Batch Loss: 1.298473 Tokens per Sec: 10726, Lr: 0.000300\n", "2020-01-18 08:41:07,289 Epoch 25 Step: 56600 Batch Loss: 1.187985 Tokens per Sec: 10570, Lr: 0.000300\n", "2020-01-18 08:41:27,307 Epoch 25 Step: 56700 Batch Loss: 1.399969 Tokens per Sec: 10982, Lr: 0.000300\n", "2020-01-18 08:41:47,125 Epoch 25 Step: 56800 Batch Loss: 1.131754 Tokens per Sec: 10775, Lr: 0.000300\n", "2020-01-18 08:42:07,254 Epoch 25 Step: 56900 Batch Loss: 1.377333 Tokens per Sec: 10725, Lr: 0.000300\n", "2020-01-18 08:42:27,239 Epoch 25 Step: 57000 Batch Loss: 1.162829 Tokens per Sec: 10807, Lr: 0.000300\n", "2020-01-18 08:43:15,226 Example #0\n", "2020-01-18 08:43:15,227 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 08:43:15,227 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 08:43:15,227 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 08:43:15,227 Example #1\n", "2020-01-18 08:43:15,227 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 08:43:15,228 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 08:43:15,228 \tHypothesis: A rehọ omobe Usi Uvie na No Ze , Ọrọ Avọ 4\n", "2020-01-18 08:43:15,228 Example #2\n", "2020-01-18 08:43:15,228 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 08:43:15,228 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 08:43:15,228 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba urru mai re ma so ole owoma nana jọ nọ o rẹ sasa oma : “ Jọ odẹ riẹ [ Ovie na ] ọ jọ bẹdẹ ; re ọre o te ti wo odẹ riẹ , re o jiri ei , re o jiri ai kpobi ; re o jiri ai kẹ erẹwho kpobi ; re a jiri ei .\n", "2020-01-18 08:43:15,229 Example #3\n", "2020-01-18 08:43:15,229 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 08:43:15,229 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 08:43:15,229 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 08:43:15,229 Validation result (greedy) at epoch 25, step 57000: bleu: 29.71, loss: 34675.3867, ppl: 4.4837, duration: 47.9906s\n", "2020-01-18 08:43:35,121 Epoch 25 Step: 57100 Batch Loss: 1.256044 Tokens per Sec: 10613, Lr: 0.000300\n", "2020-01-18 08:43:55,235 Epoch 25 Step: 57200 Batch Loss: 1.019804 Tokens per Sec: 10629, Lr: 0.000300\n", "2020-01-18 08:44:15,289 Epoch 25 Step: 57300 Batch Loss: 1.278086 Tokens per Sec: 10761, Lr: 0.000300\n", "2020-01-18 08:44:35,398 Epoch 25 Step: 57400 Batch Loss: 1.362764 Tokens per Sec: 10696, Lr: 0.000300\n", "2020-01-18 08:44:55,416 Epoch 25 Step: 57500 Batch Loss: 1.245298 Tokens per Sec: 10692, Lr: 0.000300\n", "2020-01-18 08:45:15,317 Epoch 25 Step: 57600 Batch Loss: 1.383219 Tokens per Sec: 10824, Lr: 0.000300\n", "2020-01-18 08:45:35,217 Epoch 25 Step: 57700 Batch Loss: 1.480929 Tokens per Sec: 10732, Lr: 0.000300\n", "2020-01-18 08:45:55,295 Epoch 25 Step: 57800 Batch Loss: 1.426140 Tokens per Sec: 10415, Lr: 0.000300\n", "2020-01-18 08:46:15,409 Epoch 25 Step: 57900 Batch Loss: 1.305050 Tokens per Sec: 10910, Lr: 0.000300\n", "2020-01-18 08:46:35,470 Epoch 25 Step: 58000 Batch Loss: 1.414144 Tokens per Sec: 10833, Lr: 0.000300\n", "2020-01-18 08:47:23,406 Example #0\n", "2020-01-18 08:47:23,407 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 08:47:23,407 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 08:47:23,408 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ emamọ eva . ’\n", "2020-01-18 08:47:23,408 Example #1\n", "2020-01-18 08:47:23,408 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 08:47:23,408 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 08:47:23,408 \tHypothesis: A rehọ omobe - ovẹvẹ Uvie na Ru onana , Ọrọ Avọ Ijo .\n", "2020-01-18 08:47:23,409 Example #2\n", "2020-01-18 08:47:23,409 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 08:47:23,409 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 08:47:23,409 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba urru mai nọ ma te ku ole oghọghọ nana họ : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ bẹdẹ ; re ọre riẹ o te ru odẹ riẹ vihọ , re o jiri ai , re o jiri ai kpobi ; wha suile kẹe .\n", "2020-01-18 08:47:23,409 Example #3\n", "2020-01-18 08:47:23,410 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 08:47:23,410 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 08:47:23,410 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 08:47:23,410 Validation result (greedy) at epoch 25, step 58000: bleu: 29.59, loss: 34435.1016, ppl: 4.4373, duration: 47.9399s\n", "2020-01-18 08:47:43,647 Epoch 25 Step: 58100 Batch Loss: 1.268020 Tokens per Sec: 10584, Lr: 0.000300\n", "2020-01-18 08:48:03,714 Epoch 25 Step: 58200 Batch Loss: 1.317527 Tokens per Sec: 10928, Lr: 0.000300\n", "2020-01-18 08:48:23,631 Epoch 25 Step: 58300 Batch Loss: 1.033286 Tokens per Sec: 10564, Lr: 0.000300\n", "2020-01-18 08:48:43,607 Epoch 25 Step: 58400 Batch Loss: 1.244017 Tokens per Sec: 10696, Lr: 0.000300\n", "2020-01-18 08:49:03,608 Epoch 25 Step: 58500 Batch Loss: 1.128464 Tokens per Sec: 10740, Lr: 0.000300\n", "2020-01-18 08:49:23,357 Epoch 25 Step: 58600 Batch Loss: 1.366149 Tokens per Sec: 10709, Lr: 0.000300\n", "2020-01-18 08:49:35,707 Epoch 25: total training loss 2988.40\n", "2020-01-18 08:49:35,708 EPOCH 26\n", "2020-01-18 08:49:43,682 Epoch 26 Step: 58700 Batch Loss: 1.020357 Tokens per Sec: 10712, Lr: 0.000300\n", "2020-01-18 08:50:03,756 Epoch 26 Step: 58800 Batch Loss: 1.289564 Tokens per Sec: 10704, Lr: 0.000300\n", "2020-01-18 08:50:23,763 Epoch 26 Step: 58900 Batch Loss: 1.290438 Tokens per Sec: 10724, Lr: 0.000300\n", "2020-01-18 08:50:43,949 Epoch 26 Step: 59000 Batch Loss: 1.212638 Tokens per Sec: 10915, Lr: 0.000300\n", "2020-01-18 08:51:31,866 Example #0\n", "2020-01-18 08:51:31,867 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 08:51:31,867 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 08:51:31,868 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 08:51:31,868 Example #1\n", "2020-01-18 08:51:31,868 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 08:51:31,868 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 08:51:31,868 \tHypothesis: A rehọ omobe - ovẹvẹ Uvie na lele iei , Ọrọ Avọ 4\n", "2020-01-18 08:51:31,869 Example #2\n", "2020-01-18 08:51:31,869 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 08:51:31,869 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 08:51:31,869 \tHypothesis: O tẹ rrọ ere , mai kpobi ma te rehọ oghọghọ fiba irru mai nọ i ti kuhọ kẹle oria ole owoma nana jẹ kẹ uyere : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ bẹdẹ ; re ọre na o te ti vihọ , re o jiri odẹ riẹ , re o jiri ai kpobi ; jọ erẹwho kpobi a jiri ei .\n", "2020-01-18 08:51:31,869 Example #3\n", "2020-01-18 08:51:31,870 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 08:51:31,870 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 08:51:31,870 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ gaga nọ ma tẹ be hai ru udhedhẹ .\n", "2020-01-18 08:51:31,870 Validation result (greedy) at epoch 26, step 59000: bleu: 29.76, loss: 34613.4453, ppl: 4.4717, duration: 47.9212s\n", "2020-01-18 08:51:51,748 Epoch 26 Step: 59100 Batch Loss: 1.338194 Tokens per Sec: 10558, Lr: 0.000300\n", "2020-01-18 08:52:11,715 Epoch 26 Step: 59200 Batch Loss: 1.377235 Tokens per Sec: 10784, Lr: 0.000300\n", "2020-01-18 08:52:31,849 Epoch 26 Step: 59300 Batch Loss: 1.053064 Tokens per Sec: 10849, Lr: 0.000300\n", "2020-01-18 08:52:52,101 Epoch 26 Step: 59400 Batch Loss: 1.183595 Tokens per Sec: 10781, Lr: 0.000300\n", "2020-01-18 08:53:12,138 Epoch 26 Step: 59500 Batch Loss: 1.381884 Tokens per Sec: 10870, Lr: 0.000300\n", "2020-01-18 08:53:32,318 Epoch 26 Step: 59600 Batch Loss: 1.380097 Tokens per Sec: 10816, Lr: 0.000300\n", "2020-01-18 08:53:52,313 Epoch 26 Step: 59700 Batch Loss: 1.457081 Tokens per Sec: 10601, Lr: 0.000300\n", "2020-01-18 08:54:12,264 Epoch 26 Step: 59800 Batch Loss: 1.386224 Tokens per Sec: 10437, Lr: 0.000300\n", "2020-01-18 08:54:32,145 Epoch 26 Step: 59900 Batch Loss: 1.211108 Tokens per Sec: 10598, Lr: 0.000300\n", "2020-01-18 08:54:52,071 Epoch 26 Step: 60000 Batch Loss: 1.458359 Tokens per Sec: 10602, Lr: 0.000300\n", "2020-01-18 08:55:40,005 Example #0\n", "2020-01-18 08:55:40,006 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 08:55:40,006 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 08:55:40,006 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ emamọ eva . ’\n", "2020-01-18 08:55:40,006 Example #1\n", "2020-01-18 08:55:40,007 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 08:55:40,007 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 08:55:40,007 \tHypothesis: A rọ omobe ovẹvẹ Uvie na Wuhrẹ Ahwo , Ọrọ Avọ 4\n", "2020-01-18 08:55:40,007 Example #2\n", "2020-01-18 08:55:40,007 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 08:55:40,008 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 08:55:40,008 \tHypothesis: Koyehọ mai kpobi ma te rọ oghọghọ fiba irru mai re ma ruẹ abọ urere ọrọ ole owoma nana nọ o rẹ sasa oma na : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ bẹdẹ ; re ọre na o te ti ru odẹ riẹ vihọ , re o jiri ei , re ahwo erẹwho kpobi a jiri ei .\n", "2020-01-18 08:55:40,008 Example #3\n", "2020-01-18 08:55:40,008 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 08:55:40,008 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 08:55:40,009 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ a re ro ru udhedhẹ .\n", "2020-01-18 08:55:40,009 Validation result (greedy) at epoch 26, step 60000: bleu: 30.01, loss: 34748.6797, ppl: 4.4979, duration: 47.9370s\n", "2020-01-18 08:56:00,081 Epoch 26 Step: 60100 Batch Loss: 1.336832 Tokens per Sec: 10908, Lr: 0.000300\n", "2020-01-18 08:56:20,159 Epoch 26 Step: 60200 Batch Loss: 1.379132 Tokens per Sec: 10513, Lr: 0.000300\n", "2020-01-18 08:56:40,311 Epoch 26 Step: 60300 Batch Loss: 1.278006 Tokens per Sec: 10488, Lr: 0.000300\n", "2020-01-18 08:57:00,307 Epoch 26 Step: 60400 Batch Loss: 1.155008 Tokens per Sec: 10683, Lr: 0.000300\n", "2020-01-18 08:57:20,309 Epoch 26 Step: 60500 Batch Loss: 1.158612 Tokens per Sec: 10673, Lr: 0.000300\n", "2020-01-18 08:57:40,290 Epoch 26 Step: 60600 Batch Loss: 1.463534 Tokens per Sec: 10744, Lr: 0.000300\n", "2020-01-18 08:58:00,463 Epoch 26 Step: 60700 Batch Loss: 0.847744 Tokens per Sec: 10890, Lr: 0.000300\n", "2020-01-18 08:58:20,423 Epoch 26 Step: 60800 Batch Loss: 1.385299 Tokens per Sec: 10842, Lr: 0.000300\n", "2020-01-18 08:58:40,577 Epoch 26 Step: 60900 Batch Loss: 1.228592 Tokens per Sec: 10764, Lr: 0.000300\n", "2020-01-18 08:59:00,718 Epoch 26 Step: 61000 Batch Loss: 1.308807 Tokens per Sec: 10716, Lr: 0.000300\n", "2020-01-18 08:59:48,729 Hooray! New best validation result [ppl]!\n", "2020-01-18 08:59:48,730 Saving new checkpoint.\n", "2020-01-18 08:59:50,787 Example #0\n", "2020-01-18 08:59:50,788 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 08:59:50,788 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 08:59:50,789 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 08:59:50,789 Example #1\n", "2020-01-18 08:59:50,789 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 08:59:50,789 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 08:59:50,790 \tHypothesis: A rehọ omobe - ovẹvẹ Uvie na No Ze , Ọrọ Avọ Ijo .\n", "2020-01-18 08:59:50,790 Example #2\n", "2020-01-18 08:59:50,790 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 08:59:50,790 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 08:59:50,791 \tHypothesis: O wọhọ ẹsenọ mai kpobi ma te rọ evawere fiba uvo mai re ma so ole owoma nana : “ Jọ odẹ riẹ [ Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; re ọre na o lo , re o ru odẹ riẹ lo , re o jọ ẹvi kẹ ae , re a jiri ei ; re a jiri ei kẹ erẹwho kpobi .\n", "2020-01-18 08:59:50,791 Example #3\n", "2020-01-18 08:59:50,791 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 08:59:50,791 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 08:59:50,792 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga kẹ udhedhẹ .\n", "2020-01-18 08:59:50,792 Validation result (greedy) at epoch 26, step 61000: bleu: 29.94, loss: 34362.5234, ppl: 4.4234, duration: 50.0735s\n", "2020-01-18 08:59:52,030 Epoch 26: total training loss 2956.72\n", "2020-01-18 08:59:52,031 EPOCH 27\n", "2020-01-18 09:00:11,421 Epoch 27 Step: 61100 Batch Loss: 1.304470 Tokens per Sec: 10501, Lr: 0.000300\n", "2020-01-18 09:00:31,456 Epoch 27 Step: 61200 Batch Loss: 1.364458 Tokens per Sec: 10639, Lr: 0.000300\n", "2020-01-18 09:00:51,357 Epoch 27 Step: 61300 Batch Loss: 1.306295 Tokens per Sec: 10777, Lr: 0.000300\n", "2020-01-18 09:01:11,483 Epoch 27 Step: 61400 Batch Loss: 1.248283 Tokens per Sec: 10976, Lr: 0.000300\n", "2020-01-18 09:01:31,437 Epoch 27 Step: 61500 Batch Loss: 1.317080 Tokens per Sec: 10528, Lr: 0.000300\n", "2020-01-18 09:01:51,449 Epoch 27 Step: 61600 Batch Loss: 1.349480 Tokens per Sec: 10789, Lr: 0.000300\n", "2020-01-18 09:02:11,358 Epoch 27 Step: 61700 Batch Loss: 1.193791 Tokens per Sec: 10704, Lr: 0.000300\n", "2020-01-18 09:02:31,587 Epoch 27 Step: 61800 Batch Loss: 1.305912 Tokens per Sec: 10827, Lr: 0.000300\n", "2020-01-18 09:02:51,699 Epoch 27 Step: 61900 Batch Loss: 1.311744 Tokens per Sec: 10906, Lr: 0.000300\n", "2020-01-18 09:03:11,656 Epoch 27 Step: 62000 Batch Loss: 1.336018 Tokens per Sec: 10522, Lr: 0.000300\n", "2020-01-18 09:03:59,452 Example #0\n", "2020-01-18 09:03:59,453 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 09:03:59,453 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 09:03:59,453 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 09:03:59,453 Example #1\n", "2020-01-18 09:03:59,453 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 09:03:59,453 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 09:03:59,454 \tHypothesis: Usi Uvie na U Muhọ No , Ọrọ Avọ 2\n", "2020-01-18 09:03:59,454 Example #2\n", "2020-01-18 09:03:59,454 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 09:03:59,454 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 09:03:59,454 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba iru mai re ma so ole owoma nana jẹ sasa oma : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre o te lo nwranwranwra , re o jiri odẹ riẹ , re o jiri ai kpobi ; re a jiri ei kẹ erẹwho kpobi oro .\n", "2020-01-18 09:03:59,454 Example #3\n", "2020-01-18 09:03:59,454 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 09:03:59,454 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 09:03:59,454 \tHypothesis: Ghele na , eme unu - uwou e rẹ wọ omai ru udhedhẹ .\n", "2020-01-18 09:03:59,455 Validation result (greedy) at epoch 27, step 62000: bleu: 29.73, loss: 34572.6523, ppl: 4.4638, duration: 47.7985s\n", "2020-01-18 09:04:19,367 Epoch 27 Step: 62100 Batch Loss: 1.275606 Tokens per Sec: 10614, Lr: 0.000300\n", "2020-01-18 09:04:39,373 Epoch 27 Step: 62200 Batch Loss: 1.355272 Tokens per Sec: 10585, Lr: 0.000300\n", "2020-01-18 09:04:59,376 Epoch 27 Step: 62300 Batch Loss: 0.989210 Tokens per Sec: 10537, Lr: 0.000300\n", "2020-01-18 09:05:19,294 Epoch 27 Step: 62400 Batch Loss: 1.376126 Tokens per Sec: 10829, Lr: 0.000300\n", "2020-01-18 09:05:39,214 Epoch 27 Step: 62500 Batch Loss: 1.247906 Tokens per Sec: 10809, Lr: 0.000300\n", "2020-01-18 09:05:59,077 Epoch 27 Step: 62600 Batch Loss: 1.303424 Tokens per Sec: 10930, Lr: 0.000300\n", "2020-01-18 09:06:19,169 Epoch 27 Step: 62700 Batch Loss: 0.999405 Tokens per Sec: 10822, Lr: 0.000300\n", "2020-01-18 09:06:39,272 Epoch 27 Step: 62800 Batch Loss: 1.404353 Tokens per Sec: 10998, Lr: 0.000300\n", "2020-01-18 09:06:59,313 Epoch 27 Step: 62900 Batch Loss: 1.277671 Tokens per Sec: 10748, Lr: 0.000300\n", "2020-01-18 09:07:19,522 Epoch 27 Step: 63000 Batch Loss: 1.205345 Tokens per Sec: 10696, Lr: 0.000300\n", "2020-01-18 09:08:07,362 Hooray! New best validation result [ppl]!\n", "2020-01-18 09:08:07,362 Saving new checkpoint.\n", "2020-01-18 09:08:09,388 Example #0\n", "2020-01-18 09:08:09,388 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 09:08:09,389 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 09:08:09,389 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 09:08:09,389 Example #1\n", "2020-01-18 09:08:09,389 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 09:08:09,389 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 09:08:09,390 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 09:08:09,390 Example #2\n", "2020-01-18 09:08:09,390 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 09:08:09,390 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 09:08:09,391 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai re ma ku ole owoma nana họ jẹ sasa oma : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre na o te lo , re o te ru odẹ riẹ vihọ , re o jiri ai kpobi ; re o jiri ai kpobi ; re a jiri ei kẹ erẹwho na kpobi .\n", "2020-01-18 09:08:09,391 Example #3\n", "2020-01-18 09:08:09,391 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 09:08:09,392 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 09:08:09,392 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 09:08:09,392 Validation result (greedy) at epoch 27, step 63000: bleu: 30.51, loss: 34222.0039, ppl: 4.3966, duration: 49.8699s\n", "2020-01-18 09:08:30,402 Epoch 27 Step: 63100 Batch Loss: 1.182924 Tokens per Sec: 10106, Lr: 0.000300\n", "2020-01-18 09:08:50,226 Epoch 27 Step: 63200 Batch Loss: 1.276093 Tokens per Sec: 10703, Lr: 0.000300\n", "2020-01-18 09:09:10,325 Epoch 27 Step: 63300 Batch Loss: 1.312593 Tokens per Sec: 10645, Lr: 0.000300\n", "2020-01-18 09:09:20,132 Epoch 27: total training loss 2923.78\n", "2020-01-18 09:09:20,132 EPOCH 28\n", "2020-01-18 09:09:30,575 Epoch 28 Step: 63400 Batch Loss: 1.112085 Tokens per Sec: 10616, Lr: 0.000300\n", "2020-01-18 09:09:50,537 Epoch 28 Step: 63500 Batch Loss: 1.188851 Tokens per Sec: 10803, Lr: 0.000300\n", "2020-01-18 09:10:10,567 Epoch 28 Step: 63600 Batch Loss: 1.222679 Tokens per Sec: 10692, Lr: 0.000300\n", "2020-01-18 09:10:30,527 Epoch 28 Step: 63700 Batch Loss: 1.021073 Tokens per Sec: 10475, Lr: 0.000300\n", "2020-01-18 09:10:50,525 Epoch 28 Step: 63800 Batch Loss: 1.156255 Tokens per Sec: 10992, Lr: 0.000300\n", "2020-01-18 09:11:10,330 Epoch 28 Step: 63900 Batch Loss: 1.324194 Tokens per Sec: 10733, Lr: 0.000300\n", "2020-01-18 09:11:30,178 Epoch 28 Step: 64000 Batch Loss: 1.261751 Tokens per Sec: 10727, Lr: 0.000300\n", "2020-01-18 09:12:18,052 Example #0\n", "2020-01-18 09:12:18,053 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 09:12:18,054 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 09:12:18,054 \tHypothesis: Ma rẹ sae tubẹ lẹ Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 09:12:18,054 Example #1\n", "2020-01-18 09:12:18,054 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 09:12:18,054 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 09:12:18,055 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 09:12:18,055 Example #2\n", "2020-01-18 09:12:18,055 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 09:12:18,055 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 09:12:18,055 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba urru mai re ma ku ole owoma nana họ jẹ sasa oma : “ Jọ odẹ riẹ [ orọ Ovie na ] o jọ bẹdẹ ; re ọre o te lo , re o ru odẹ riẹ vihọ , re o jiri ei , re ahwo kpobi a jiri ei .\n", "2020-01-18 09:12:18,056 Example #3\n", "2020-01-18 09:12:18,056 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 09:12:18,056 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 09:12:18,056 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ gaga kẹ udhedhẹ .\n", "2020-01-18 09:12:18,056 Validation result (greedy) at epoch 28, step 64000: bleu: 29.91, loss: 34579.4297, ppl: 4.4651, duration: 47.8779s\n", "2020-01-18 09:12:37,970 Epoch 28 Step: 64100 Batch Loss: 1.165244 Tokens per Sec: 10626, Lr: 0.000300\n", "2020-01-18 09:12:58,113 Epoch 28 Step: 64200 Batch Loss: 1.375286 Tokens per Sec: 11014, Lr: 0.000300\n", "2020-01-18 09:13:17,968 Epoch 28 Step: 64300 Batch Loss: 1.278816 Tokens per Sec: 10529, Lr: 0.000300\n", "2020-01-18 09:13:37,885 Epoch 28 Step: 64400 Batch Loss: 1.136212 Tokens per Sec: 10838, Lr: 0.000300\n", "2020-01-18 09:13:58,050 Epoch 28 Step: 64500 Batch Loss: 1.181832 Tokens per Sec: 10743, Lr: 0.000300\n", "2020-01-18 09:14:18,055 Epoch 28 Step: 64600 Batch Loss: 1.331098 Tokens per Sec: 10504, Lr: 0.000300\n", "2020-01-18 09:14:38,267 Epoch 28 Step: 64700 Batch Loss: 1.222093 Tokens per Sec: 10793, Lr: 0.000300\n", "2020-01-18 09:14:58,092 Epoch 28 Step: 64800 Batch Loss: 1.308305 Tokens per Sec: 10896, Lr: 0.000300\n", "2020-01-18 09:15:18,080 Epoch 28 Step: 64900 Batch Loss: 1.394638 Tokens per Sec: 10633, Lr: 0.000300\n", "2020-01-18 09:15:38,053 Epoch 28 Step: 65000 Batch Loss: 1.076300 Tokens per Sec: 10711, Lr: 0.000300\n", "2020-01-18 09:16:25,877 Example #0\n", "2020-01-18 09:16:25,878 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 09:16:25,878 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 09:16:25,878 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 09:16:25,878 Example #1\n", "2020-01-18 09:16:25,879 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 09:16:25,879 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 09:16:25,879 \tHypothesis: A te ru onana , Ọrọ Avọ 4\n", "2020-01-18 09:16:25,879 Example #2\n", "2020-01-18 09:16:25,879 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 09:16:25,880 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 09:16:25,880 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ ole owoma nana nọ o vọ avọ omosasọ na : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre na o te ru odẹ riẹ vihọ , re o jiri ai , re erẹwho kpobi i wo oghale .\n", "2020-01-18 09:16:25,880 Example #3\n", "2020-01-18 09:16:25,880 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 09:16:25,881 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 09:16:25,881 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 09:16:25,881 Validation result (greedy) at epoch 28, step 65000: bleu: 30.56, loss: 34338.7070, ppl: 4.4189, duration: 47.8277s\n", "2020-01-18 09:16:45,794 Epoch 28 Step: 65100 Batch Loss: 1.274948 Tokens per Sec: 10554, Lr: 0.000300\n", "2020-01-18 09:17:05,971 Epoch 28 Step: 65200 Batch Loss: 1.389452 Tokens per Sec: 10564, Lr: 0.000300\n", "2020-01-18 09:17:25,948 Epoch 28 Step: 65300 Batch Loss: 1.300349 Tokens per Sec: 10656, Lr: 0.000300\n", "2020-01-18 09:17:45,935 Epoch 28 Step: 65400 Batch Loss: 1.270298 Tokens per Sec: 10742, Lr: 0.000300\n", "2020-01-18 09:18:06,098 Epoch 28 Step: 65500 Batch Loss: 1.374395 Tokens per Sec: 10566, Lr: 0.000300\n", "2020-01-18 09:18:25,886 Epoch 28 Step: 65600 Batch Loss: 1.394720 Tokens per Sec: 10642, Lr: 0.000300\n", "2020-01-18 09:18:45,704 Epoch 28 Step: 65700 Batch Loss: 1.443883 Tokens per Sec: 10721, Lr: 0.000300\n", "2020-01-18 09:18:46,725 Epoch 28: total training loss 2915.88\n", "2020-01-18 09:18:46,725 EPOCH 29\n", "2020-01-18 09:19:06,011 Epoch 29 Step: 65800 Batch Loss: 1.242174 Tokens per Sec: 10691, Lr: 0.000300\n", "2020-01-18 09:19:26,168 Epoch 29 Step: 65900 Batch Loss: 1.149108 Tokens per Sec: 10966, Lr: 0.000300\n", "2020-01-18 09:19:46,018 Epoch 29 Step: 66000 Batch Loss: 1.357699 Tokens per Sec: 10598, Lr: 0.000300\n", "2020-01-18 09:20:33,874 Example #0\n", "2020-01-18 09:20:33,875 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 09:20:33,876 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 09:20:33,876 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 09:20:33,876 Example #1\n", "2020-01-18 09:20:33,876 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 09:20:33,876 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 09:20:33,877 \tHypothesis: A rehọ omobe Usi Uvie na lele iei , Ọrọ Avọ Ijo .\n", "2020-01-18 09:20:33,877 Example #2\n", "2020-01-18 09:20:33,877 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 09:20:33,877 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 09:20:33,878 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ kugbe eme urere nana nọ i ti kuhọ na , jẹ kẹ omai ole oghọghọ nana : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] ọ jọ bẹdẹ bẹdẹ ; re ọre na o te ru odẹ riẹ vihọ , re o ru re erẹwho na kpobi e jiri ei ; re a jiri ei ; re erẹwho akpọ na kpobi .\n", "2020-01-18 09:20:33,878 Example #3\n", "2020-01-18 09:20:33,878 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 09:20:33,879 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 09:20:33,879 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ọgaga nọ ma re ro ru udhedhẹ .\n", "2020-01-18 09:20:33,879 Validation result (greedy) at epoch 29, step 66000: bleu: 30.36, loss: 34369.1016, ppl: 4.4247, duration: 47.8607s\n", "2020-01-18 09:20:53,734 Epoch 29 Step: 66100 Batch Loss: 1.146466 Tokens per Sec: 10547, Lr: 0.000300\n", "2020-01-18 09:21:13,590 Epoch 29 Step: 66200 Batch Loss: 1.178000 Tokens per Sec: 10691, Lr: 0.000300\n", "2020-01-18 09:21:33,615 Epoch 29 Step: 66300 Batch Loss: 1.130976 Tokens per Sec: 10863, Lr: 0.000300\n", "2020-01-18 09:21:53,621 Epoch 29 Step: 66400 Batch Loss: 1.246875 Tokens per Sec: 10980, Lr: 0.000300\n", "2020-01-18 09:22:13,803 Epoch 29 Step: 66500 Batch Loss: 1.167780 Tokens per Sec: 10792, Lr: 0.000300\n", "2020-01-18 09:22:33,641 Epoch 29 Step: 66600 Batch Loss: 1.347962 Tokens per Sec: 10592, Lr: 0.000300\n", "2020-01-18 09:22:53,708 Epoch 29 Step: 66700 Batch Loss: 1.259101 Tokens per Sec: 10776, Lr: 0.000300\n", "2020-01-18 09:23:13,473 Epoch 29 Step: 66800 Batch Loss: 0.952895 Tokens per Sec: 10608, Lr: 0.000300\n", "2020-01-18 09:23:33,591 Epoch 29 Step: 66900 Batch Loss: 1.411510 Tokens per Sec: 10822, Lr: 0.000300\n", "2020-01-18 09:23:53,654 Epoch 29 Step: 67000 Batch Loss: 1.275495 Tokens per Sec: 10832, Lr: 0.000300\n", "2020-01-18 09:24:41,464 Example #0\n", "2020-01-18 09:24:41,465 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 09:24:41,465 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 09:24:41,465 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 09:24:41,465 Example #1\n", "2020-01-18 09:24:41,466 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 09:24:41,466 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 09:24:41,466 \tHypothesis: A rehọ omobe Usi Uvie na lele iei , Ọrọ Avọ 4\n", "2020-01-18 09:24:41,466 Example #2\n", "2020-01-18 09:24:41,466 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 09:24:41,467 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 09:24:41,467 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba irru mai re ma ku ole owoma nana gbe ole oghọghọ nana họ : “ Jọ odẹ riẹ [ Ovie na Jesu Kristi ] ọ jọ bẹdẹ bẹdẹ ; re ọre na o te ru odẹ riẹ rro , re o ru odẹ riẹ kẹre , re o jọ oghale kẹe erẹwho akpọ na kpobi ; re o jiri ei .\n", "2020-01-18 09:24:41,467 Example #3\n", "2020-01-18 09:24:41,467 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 09:24:41,468 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 09:24:41,468 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ọgaga nọ ma re ro ru udhedhẹ .\n", "2020-01-18 09:24:41,468 Validation result (greedy) at epoch 29, step 67000: bleu: 30.10, loss: 34455.4297, ppl: 4.4412, duration: 47.8132s\n", "2020-01-18 09:25:01,428 Epoch 29 Step: 67100 Batch Loss: 1.295937 Tokens per Sec: 10555, Lr: 0.000300\n", "2020-01-18 09:25:21,648 Epoch 29 Step: 67200 Batch Loss: 1.139736 Tokens per Sec: 10697, Lr: 0.000300\n", "2020-01-18 09:25:41,717 Epoch 29 Step: 67300 Batch Loss: 1.365625 Tokens per Sec: 10809, Lr: 0.000300\n", "2020-01-18 09:26:01,705 Epoch 29 Step: 67400 Batch Loss: 1.264386 Tokens per Sec: 10675, Lr: 0.000300\n", "2020-01-18 09:26:21,686 Epoch 29 Step: 67500 Batch Loss: 1.090446 Tokens per Sec: 10849, Lr: 0.000300\n", "2020-01-18 09:26:41,522 Epoch 29 Step: 67600 Batch Loss: 1.387111 Tokens per Sec: 10629, Lr: 0.000300\n", "2020-01-18 09:27:01,423 Epoch 29 Step: 67700 Batch Loss: 1.367021 Tokens per Sec: 10857, Lr: 0.000300\n", "2020-01-18 09:27:21,487 Epoch 29 Step: 67800 Batch Loss: 1.230458 Tokens per Sec: 10760, Lr: 0.000300\n", "2020-01-18 09:27:41,543 Epoch 29 Step: 67900 Batch Loss: 1.264257 Tokens per Sec: 10956, Lr: 0.000300\n", "2020-01-18 09:28:01,577 Epoch 29 Step: 68000 Batch Loss: 1.301110 Tokens per Sec: 10720, Lr: 0.000300\n", "2020-01-18 09:28:49,410 Hooray! New best validation result [ppl]!\n", "2020-01-18 09:28:49,411 Saving new checkpoint.\n", "2020-01-18 09:28:51,353 Example #0\n", "2020-01-18 09:28:51,354 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 09:28:51,354 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 09:28:51,354 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 09:28:51,354 Example #1\n", "2020-01-18 09:28:51,355 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 09:28:51,355 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 09:28:51,355 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 09:28:51,355 Example #2\n", "2020-01-18 09:28:51,356 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 09:28:51,356 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 09:28:51,358 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana , jẹ so ole oghọghọ : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre o te ti lo , re odẹ riẹ u vihọ , re o jiri ai kpobi ; re erẹwho kpobi e jiri ei .\n", "2020-01-18 09:28:51,358 Example #3\n", "2020-01-18 09:28:51,359 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 09:28:51,359 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 09:28:51,359 \tHypothesis: Ghele na , eme unu - uwou yọ ogaga nọ ma re ro ru udhedhẹ .\n", "2020-01-18 09:28:51,359 Validation result (greedy) at epoch 29, step 68000: bleu: 30.41, loss: 33938.2422, ppl: 4.3429, duration: 49.7820s\n", "2020-01-18 09:29:01,526 Epoch 29: total training loss 2879.50\n", "2020-01-18 09:29:01,526 EPOCH 30\n", "2020-01-18 09:29:12,185 Epoch 30 Step: 68100 Batch Loss: 1.220853 Tokens per Sec: 10462, Lr: 0.000300\n", "2020-01-18 09:29:32,165 Epoch 30 Step: 68200 Batch Loss: 1.012691 Tokens per Sec: 10711, Lr: 0.000300\n", "2020-01-18 09:29:52,089 Epoch 30 Step: 68300 Batch Loss: 1.168931 Tokens per Sec: 10820, Lr: 0.000300\n", "2020-01-18 09:30:12,199 Epoch 30 Step: 68400 Batch Loss: 1.150295 Tokens per Sec: 10859, Lr: 0.000300\n", "2020-01-18 09:30:32,200 Epoch 30 Step: 68500 Batch Loss: 1.167180 Tokens per Sec: 10807, Lr: 0.000300\n", "2020-01-18 09:30:52,254 Epoch 30 Step: 68600 Batch Loss: 1.291481 Tokens per Sec: 10682, Lr: 0.000300\n", "2020-01-18 09:31:11,869 Epoch 30 Step: 68700 Batch Loss: 1.230348 Tokens per Sec: 10831, Lr: 0.000300\n", "2020-01-18 09:31:31,765 Epoch 30 Step: 68800 Batch Loss: 1.304006 Tokens per Sec: 10730, Lr: 0.000300\n", "2020-01-18 09:31:51,738 Epoch 30 Step: 68900 Batch Loss: 1.370682 Tokens per Sec: 10699, Lr: 0.000300\n", "2020-01-18 09:32:11,773 Epoch 30 Step: 69000 Batch Loss: 1.212303 Tokens per Sec: 10793, Lr: 0.000300\n", "2020-01-18 09:32:59,580 Example #0\n", "2020-01-18 09:32:59,581 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 09:32:59,581 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 09:32:59,581 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 09:32:59,581 Example #1\n", "2020-01-18 09:32:59,582 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 09:32:59,582 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 09:32:59,582 \tHypothesis: Omobe - ovẹvẹ Uvie na O Nya Lele Owhẹ No , Ọrọ Avọ Ijo .\n", "2020-01-18 09:32:59,582 Example #2\n", "2020-01-18 09:32:59,583 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 09:32:59,583 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 09:32:59,583 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba edo oghọghọ nana nọ o te jọ ole owoma nana nọ ọ ta nọ : “ Jọ odẹ riẹ [ Ovie na ] o jọ bẹdẹ bẹdẹ ; re ọre na o wo odẹ riẹ , re o vihọ , re o jiri ai ; erẹwho kpobi e rẹ ghale ae .\n", "2020-01-18 09:32:59,583 Example #3\n", "2020-01-18 09:32:59,583 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 09:32:59,584 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 09:32:59,584 \tHypothesis: Ghele na , eme unu - uwou yọ ogaga nọ ma re ro ru udhedhẹ .\n", "2020-01-18 09:32:59,584 Validation result (greedy) at epoch 30, step 69000: bleu: 30.30, loss: 34340.4414, ppl: 4.4192, duration: 47.8101s\n", "2020-01-18 09:33:19,748 Epoch 30 Step: 69100 Batch Loss: 1.078023 Tokens per Sec: 10877, Lr: 0.000300\n", "2020-01-18 09:33:39,735 Epoch 30 Step: 69200 Batch Loss: 1.218162 Tokens per Sec: 10607, Lr: 0.000300\n", "2020-01-18 09:33:59,753 Epoch 30 Step: 69300 Batch Loss: 1.450040 Tokens per Sec: 10645, Lr: 0.000300\n", "2020-01-18 09:34:19,862 Epoch 30 Step: 69400 Batch Loss: 1.356076 Tokens per Sec: 10513, Lr: 0.000300\n", "2020-01-18 09:34:39,817 Epoch 30 Step: 69500 Batch Loss: 0.979266 Tokens per Sec: 10483, Lr: 0.000300\n", "2020-01-18 09:34:59,973 Epoch 30 Step: 69600 Batch Loss: 1.263979 Tokens per Sec: 10809, Lr: 0.000300\n", "2020-01-18 09:35:19,934 Epoch 30 Step: 69700 Batch Loss: 1.305900 Tokens per Sec: 10710, Lr: 0.000300\n", "2020-01-18 09:35:40,047 Epoch 30 Step: 69800 Batch Loss: 1.346465 Tokens per Sec: 10747, Lr: 0.000300\n", "2020-01-18 09:35:59,792 Epoch 30 Step: 69900 Batch Loss: 1.379332 Tokens per Sec: 10986, Lr: 0.000300\n", "2020-01-18 09:36:19,826 Epoch 30 Step: 70000 Batch Loss: 1.293800 Tokens per Sec: 10665, Lr: 0.000300\n", "2020-01-18 09:37:07,766 Example #0\n", "2020-01-18 09:37:07,767 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 09:37:07,767 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 09:37:07,767 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 09:37:07,767 Example #1\n", "2020-01-18 09:37:07,768 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 09:37:07,768 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 09:37:07,768 \tHypothesis: A lele iei Usi Uvie na , Ọrọ Avọ Ijo .\n", "2020-01-18 09:37:07,768 Example #2\n", "2020-01-18 09:37:07,768 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 09:37:07,768 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 09:37:07,769 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ re ma ku unu mai gbe ole owoma nana nọ ọ vọ avọ omosasọ na họ : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre na o te lo , re o jiri odẹ riẹ , re o jọ erẹwho kpobi jiri ai ; re o jiri ai .\n", "2020-01-18 09:37:07,769 Example #3\n", "2020-01-18 09:37:07,769 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 09:37:07,769 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 09:37:07,769 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 09:37:07,770 Validation result (greedy) at epoch 30, step 70000: bleu: 30.24, loss: 34286.7031, ppl: 4.4089, duration: 47.9427s\n", "2020-01-18 09:37:27,687 Epoch 30 Step: 70100 Batch Loss: 1.015704 Tokens per Sec: 10587, Lr: 0.000300\n", "2020-01-18 09:37:47,824 Epoch 30 Step: 70200 Batch Loss: 1.208412 Tokens per Sec: 10701, Lr: 0.000300\n", "2020-01-18 09:38:07,908 Epoch 30 Step: 70300 Batch Loss: 1.216854 Tokens per Sec: 10911, Lr: 0.000300\n", "2020-01-18 09:38:27,229 Epoch 30: total training loss 2861.92\n", "2020-01-18 09:38:27,230 EPOCH 31\n", "2020-01-18 09:38:28,345 Epoch 31 Step: 70400 Batch Loss: 1.174221 Tokens per Sec: 7743, Lr: 0.000300\n", "2020-01-18 09:38:48,761 Epoch 31 Step: 70500 Batch Loss: 1.080328 Tokens per Sec: 10602, Lr: 0.000300\n", "2020-01-18 09:39:09,156 Epoch 31 Step: 70600 Batch Loss: 0.907226 Tokens per Sec: 10611, Lr: 0.000300\n", "2020-01-18 09:39:29,376 Epoch 31 Step: 70700 Batch Loss: 1.331746 Tokens per Sec: 10710, Lr: 0.000300\n", "2020-01-18 09:39:49,548 Epoch 31 Step: 70800 Batch Loss: 1.019959 Tokens per Sec: 10736, Lr: 0.000300\n", "2020-01-18 09:40:09,569 Epoch 31 Step: 70900 Batch Loss: 1.239955 Tokens per Sec: 10666, Lr: 0.000300\n", "2020-01-18 09:40:29,648 Epoch 31 Step: 71000 Batch Loss: 1.301160 Tokens per Sec: 10639, Lr: 0.000300\n", "2020-01-18 09:41:17,722 Example #0\n", "2020-01-18 09:41:17,723 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 09:41:17,723 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 09:41:17,723 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 09:41:17,723 Example #1\n", "2020-01-18 09:41:17,724 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 09:41:17,724 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 09:41:17,724 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 09:41:17,724 Example #2\n", "2020-01-18 09:41:17,725 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 09:41:17,725 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 09:41:17,725 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba irru mai nọ ma te ku ole owoma nana họ : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te ti vihọ , re o ru odẹ riẹ vihọ , re erẹwho kpobi e ghale ae ; se ai ba ẹghale oghale .\n", "2020-01-18 09:41:17,725 Example #3\n", "2020-01-18 09:41:17,726 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 09:41:17,726 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 09:41:17,726 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba ologbo kẹ eruo udhedhẹ .\n", "2020-01-18 09:41:17,726 Validation result (greedy) at epoch 31, step 71000: bleu: 30.34, loss: 34302.8281, ppl: 4.4120, duration: 48.0775s\n", "2020-01-18 09:41:37,990 Epoch 31 Step: 71100 Batch Loss: 1.065193 Tokens per Sec: 10655, Lr: 0.000300\n", "2020-01-18 09:41:58,243 Epoch 31 Step: 71200 Batch Loss: 1.159237 Tokens per Sec: 10733, Lr: 0.000300\n", "2020-01-18 09:42:18,447 Epoch 31 Step: 71300 Batch Loss: 1.112982 Tokens per Sec: 10390, Lr: 0.000300\n", "2020-01-18 09:42:38,715 Epoch 31 Step: 71400 Batch Loss: 1.197135 Tokens per Sec: 10356, Lr: 0.000300\n", "2020-01-18 09:42:58,888 Epoch 31 Step: 71500 Batch Loss: 1.380357 Tokens per Sec: 10324, Lr: 0.000300\n", "2020-01-18 09:43:19,048 Epoch 31 Step: 71600 Batch Loss: 0.979457 Tokens per Sec: 10818, Lr: 0.000300\n", "2020-01-18 09:43:39,446 Epoch 31 Step: 71700 Batch Loss: 1.091540 Tokens per Sec: 10517, Lr: 0.000300\n", "2020-01-18 09:43:59,672 Epoch 31 Step: 71800 Batch Loss: 0.955424 Tokens per Sec: 10567, Lr: 0.000300\n", "2020-01-18 09:44:19,883 Epoch 31 Step: 71900 Batch Loss: 1.284177 Tokens per Sec: 10533, Lr: 0.000300\n", "2020-01-18 09:44:39,864 Epoch 31 Step: 72000 Batch Loss: 1.197352 Tokens per Sec: 10807, Lr: 0.000300\n", "2020-01-18 09:45:27,782 Example #0\n", "2020-01-18 09:45:27,783 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 09:45:27,784 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 09:45:27,784 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 09:45:27,784 Example #1\n", "2020-01-18 09:45:27,784 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 09:45:27,785 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 09:45:27,785 \tHypothesis: Usi Uvie na O Wha Erere Se Omẹ No ( F .\n", "2020-01-18 09:45:27,785 Example #2\n", "2020-01-18 09:45:27,785 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 09:45:27,785 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 09:45:27,785 \tHypothesis: Koyehọ mai kpobi ma te rọ evawere fiba urru mai re ma ku ole owoma nana họ : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te lo , re o ru odẹ riẹ vihọ , re o jiri ai kpobi ; re erẹwho kpobi e ghale ae .\n", "2020-01-18 09:45:27,786 Example #3\n", "2020-01-18 09:45:27,786 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 09:45:27,786 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 09:45:27,786 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 09:45:27,786 Validation result (greedy) at epoch 31, step 72000: bleu: 30.39, loss: 34168.8711, ppl: 4.3865, duration: 47.9216s\n", "2020-01-18 09:45:47,911 Epoch 31 Step: 72100 Batch Loss: 1.347289 Tokens per Sec: 10719, Lr: 0.000300\n", "2020-01-18 09:46:07,857 Epoch 31 Step: 72200 Batch Loss: 1.405187 Tokens per Sec: 10548, Lr: 0.000300\n", "2020-01-18 09:46:28,000 Epoch 31 Step: 72300 Batch Loss: 1.189571 Tokens per Sec: 10699, Lr: 0.000300\n", "2020-01-18 09:46:48,041 Epoch 31 Step: 72400 Batch Loss: 1.260815 Tokens per Sec: 10777, Lr: 0.000300\n", "2020-01-18 09:47:08,234 Epoch 31 Step: 72500 Batch Loss: 1.250988 Tokens per Sec: 10550, Lr: 0.000300\n", "2020-01-18 09:47:28,398 Epoch 31 Step: 72600 Batch Loss: 1.240728 Tokens per Sec: 10731, Lr: 0.000300\n", "2020-01-18 09:47:48,455 Epoch 31 Step: 72700 Batch Loss: 1.188526 Tokens per Sec: 10743, Lr: 0.000300\n", "2020-01-18 09:47:57,415 Epoch 31: total training loss 2844.27\n", "2020-01-18 09:47:57,415 EPOCH 32\n", "2020-01-18 09:48:08,977 Epoch 32 Step: 72800 Batch Loss: 1.249241 Tokens per Sec: 10558, Lr: 0.000300\n", "2020-01-18 09:48:29,067 Epoch 32 Step: 72900 Batch Loss: 0.931170 Tokens per Sec: 10558, Lr: 0.000300\n", "2020-01-18 09:48:49,235 Epoch 32 Step: 73000 Batch Loss: 1.130699 Tokens per Sec: 10633, Lr: 0.000300\n", "2020-01-18 09:49:37,243 Example #0\n", "2020-01-18 09:49:37,244 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 09:49:37,244 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 09:49:37,244 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 09:49:37,244 Example #1\n", "2020-01-18 09:49:37,245 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 09:49:37,245 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 09:49:37,245 \tHypothesis: Onana o jọ orọ Usi Uvie na , Ọrọ Avọ Ijo .\n", "2020-01-18 09:49:37,245 Example #2\n", "2020-01-18 09:49:37,246 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 09:49:37,246 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 09:49:37,246 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ ku irru mai nọ i ti kuhọ evaọ ole owoma nana nọ o vọ avọ omosasọ na : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre na o te ti wo odẹ riẹ , re o ru re erẹwho kpobi e jiri ei ; re erẹwho akpọ na kpobi e jiri ei .\n", "2020-01-18 09:49:37,246 Example #3\n", "2020-01-18 09:49:37,246 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 09:49:37,247 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 09:49:37,247 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ọgaga nọ ma re ro ru udhedhẹ .\n", "2020-01-18 09:49:37,247 Validation result (greedy) at epoch 32, step 73000: bleu: 30.81, loss: 34083.2695, ppl: 4.3703, duration: 48.0114s\n", "2020-01-18 09:49:57,270 Epoch 32 Step: 73100 Batch Loss: 1.113669 Tokens per Sec: 10564, Lr: 0.000300\n", "2020-01-18 09:50:17,320 Epoch 32 Step: 73200 Batch Loss: 1.303942 Tokens per Sec: 10407, Lr: 0.000300\n", "2020-01-18 09:50:37,352 Epoch 32 Step: 73300 Batch Loss: 1.337190 Tokens per Sec: 10709, Lr: 0.000300\n", "2020-01-18 09:50:57,444 Epoch 32 Step: 73400 Batch Loss: 1.068808 Tokens per Sec: 10665, Lr: 0.000300\n", "2020-01-18 09:51:17,698 Epoch 32 Step: 73500 Batch Loss: 1.340851 Tokens per Sec: 10615, Lr: 0.000300\n", "2020-01-18 09:51:37,923 Epoch 32 Step: 73600 Batch Loss: 1.192291 Tokens per Sec: 10621, Lr: 0.000300\n", "2020-01-18 09:51:58,163 Epoch 32 Step: 73700 Batch Loss: 1.261885 Tokens per Sec: 10792, Lr: 0.000300\n", "2020-01-18 09:52:18,318 Epoch 32 Step: 73800 Batch Loss: 1.194679 Tokens per Sec: 10614, Lr: 0.000300\n", "2020-01-18 09:52:38,372 Epoch 32 Step: 73900 Batch Loss: 1.195976 Tokens per Sec: 10519, Lr: 0.000300\n", "2020-01-18 09:52:58,494 Epoch 32 Step: 74000 Batch Loss: 1.281215 Tokens per Sec: 10641, Lr: 0.000300\n", "2020-01-18 09:53:46,509 Example #0\n", "2020-01-18 09:53:46,509 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 09:53:46,510 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 09:53:46,510 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 09:53:46,510 Example #1\n", "2020-01-18 09:53:46,511 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 09:53:46,511 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 09:53:46,511 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 09:53:46,511 Example #2\n", "2020-01-18 09:53:46,512 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 09:53:46,512 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 09:53:46,512 \tHypothesis: Koyehọ , mai kpobi ma te rọ evawere fiba irru mai re ma so ole owoma nana : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te ti wo odẹ riẹ , re o jọ oghale kẹ ae erẹwho kpobi ; re erẹwho na kpobi e se odẹ riẹ ba ese .\n", "2020-01-18 09:53:46,512 Example #3\n", "2020-01-18 09:53:46,512 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 09:53:46,512 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 09:53:46,513 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 09:53:46,513 Validation result (greedy) at epoch 32, step 74000: bleu: 31.10, loss: 34243.0508, ppl: 4.4006, duration: 48.0175s\n", "2020-01-18 09:54:06,658 Epoch 32 Step: 74100 Batch Loss: 1.005735 Tokens per Sec: 10816, Lr: 0.000210\n", "2020-01-18 09:54:26,918 Epoch 32 Step: 74200 Batch Loss: 1.133260 Tokens per Sec: 10695, Lr: 0.000210\n", "2020-01-18 09:54:47,183 Epoch 32 Step: 74300 Batch Loss: 1.242482 Tokens per Sec: 10953, Lr: 0.000210\n", "2020-01-18 09:55:07,160 Epoch 32 Step: 74400 Batch Loss: 1.114924 Tokens per Sec: 10529, Lr: 0.000210\n", "2020-01-18 09:55:27,303 Epoch 32 Step: 74500 Batch Loss: 0.844776 Tokens per Sec: 10553, Lr: 0.000210\n", "2020-01-18 09:55:47,717 Epoch 32 Step: 74600 Batch Loss: 1.298914 Tokens per Sec: 10875, Lr: 0.000210\n", "2020-01-18 09:56:07,721 Epoch 32 Step: 74700 Batch Loss: 1.215454 Tokens per Sec: 10636, Lr: 0.000210\n", "2020-01-18 09:56:27,702 Epoch 32 Step: 74800 Batch Loss: 1.263041 Tokens per Sec: 10630, Lr: 0.000210\n", "2020-01-18 09:56:47,972 Epoch 32 Step: 74900 Batch Loss: 1.217940 Tokens per Sec: 10731, Lr: 0.000210\n", "2020-01-18 09:57:08,217 Epoch 32 Step: 75000 Batch Loss: 0.822123 Tokens per Sec: 10669, Lr: 0.000210\n", "2020-01-18 09:57:56,177 Hooray! New best validation result [ppl]!\n", "2020-01-18 09:57:56,177 Saving new checkpoint.\n", "2020-01-18 09:57:58,906 Example #0\n", "2020-01-18 09:57:58,906 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 09:57:58,906 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 09:57:58,906 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ udu efuafo . ’\n", "2020-01-18 09:57:58,907 Example #1\n", "2020-01-18 09:57:58,907 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 09:57:58,907 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 09:57:58,907 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 09:57:58,907 Example #2\n", "2020-01-18 09:57:58,907 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 09:57:58,907 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 09:57:58,908 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba urru mai re ma ku ole owoma nana họ : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re o ru odẹ riẹ lo , re o jọ oghale kẹ ae ; re erẹwho kpobi i jiri ei ; re a se erẹwho na kpobi oro .\n", "2020-01-18 09:57:58,908 Example #3\n", "2020-01-18 09:57:58,908 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 09:57:58,908 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 09:57:58,908 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 09:57:58,908 Validation result (greedy) at epoch 32, step 75000: bleu: 31.00, loss: 33749.2227, ppl: 4.3076, duration: 50.6911s\n", "2020-01-18 09:58:17,973 Epoch 32: total training loss 2798.11\n", "2020-01-18 09:58:17,974 EPOCH 33\n", "2020-01-18 09:58:19,470 Epoch 33 Step: 75100 Batch Loss: 1.146443 Tokens per Sec: 9224, Lr: 0.000210\n", "2020-01-18 09:58:39,568 Epoch 33 Step: 75200 Batch Loss: 1.019084 Tokens per Sec: 10693, Lr: 0.000210\n", "2020-01-18 09:58:59,639 Epoch 33 Step: 75300 Batch Loss: 1.169855 Tokens per Sec: 10761, Lr: 0.000210\n", "2020-01-18 09:59:19,781 Epoch 33 Step: 75400 Batch Loss: 0.926256 Tokens per Sec: 10677, Lr: 0.000210\n", "2020-01-18 09:59:39,877 Epoch 33 Step: 75500 Batch Loss: 1.158626 Tokens per Sec: 10903, Lr: 0.000210\n", "2020-01-18 09:59:59,873 Epoch 33 Step: 75600 Batch Loss: 1.231131 Tokens per Sec: 10651, Lr: 0.000210\n", "2020-01-18 10:00:19,714 Epoch 33 Step: 75700 Batch Loss: 1.163046 Tokens per Sec: 10620, Lr: 0.000210\n", "2020-01-18 10:00:39,610 Epoch 33 Step: 75800 Batch Loss: 1.122847 Tokens per Sec: 10698, Lr: 0.000210\n", "2020-01-18 10:00:59,880 Epoch 33 Step: 75900 Batch Loss: 1.141924 Tokens per Sec: 11048, Lr: 0.000210\n", "2020-01-18 10:01:19,921 Epoch 33 Step: 76000 Batch Loss: 1.228630 Tokens per Sec: 10477, Lr: 0.000210\n", "2020-01-18 10:02:07,834 Example #0\n", "2020-01-18 10:02:07,835 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 10:02:07,835 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 10:02:07,836 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 10:02:07,836 Example #1\n", "2020-01-18 10:02:07,837 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 10:02:07,837 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 10:02:07,837 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 10:02:07,837 Example #2\n", "2020-01-18 10:02:07,838 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 10:02:07,838 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 10:02:07,838 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba urru mai orọ urere ole owoma nana : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre o te lo , re o ru re odẹ riẹ o jọ ẹvi , re erẹwho na kpobi i jiri ei ; re o jiri ai kpobi .\n", "2020-01-18 10:02:07,838 Example #3\n", "2020-01-18 10:02:07,838 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 10:02:07,839 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 10:02:07,839 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 10:02:07,839 Validation result (greedy) at epoch 33, step 76000: bleu: 30.68, loss: 33998.8594, ppl: 4.3543, duration: 47.9169s\n", "2020-01-18 10:02:27,967 Epoch 33 Step: 76100 Batch Loss: 1.267030 Tokens per Sec: 10687, Lr: 0.000210\n", "2020-01-18 10:02:48,009 Epoch 33 Step: 76200 Batch Loss: 1.188625 Tokens per Sec: 10875, Lr: 0.000210\n", "2020-01-18 10:03:08,049 Epoch 33 Step: 76300 Batch Loss: 1.284346 Tokens per Sec: 10746, Lr: 0.000210\n", "2020-01-18 10:03:27,908 Epoch 33 Step: 76400 Batch Loss: 1.074913 Tokens per Sec: 10472, Lr: 0.000210\n", "2020-01-18 10:03:48,042 Epoch 33 Step: 76500 Batch Loss: 1.291898 Tokens per Sec: 10732, Lr: 0.000210\n", "2020-01-18 10:04:08,057 Epoch 33 Step: 76600 Batch Loss: 1.301372 Tokens per Sec: 10795, Lr: 0.000210\n", "2020-01-18 10:04:27,939 Epoch 33 Step: 76700 Batch Loss: 1.116111 Tokens per Sec: 10631, Lr: 0.000210\n", "2020-01-18 10:04:47,717 Epoch 33 Step: 76800 Batch Loss: 1.119862 Tokens per Sec: 10676, Lr: 0.000210\n", "2020-01-18 10:05:07,651 Epoch 33 Step: 76900 Batch Loss: 1.197465 Tokens per Sec: 10577, Lr: 0.000210\n", "2020-01-18 10:05:27,618 Epoch 33 Step: 77000 Batch Loss: 1.223256 Tokens per Sec: 10835, Lr: 0.000210\n", "2020-01-18 10:06:15,396 Example #0\n", "2020-01-18 10:06:15,397 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 10:06:15,397 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 10:06:15,397 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 10:06:15,397 Example #1\n", "2020-01-18 10:06:15,398 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 10:06:15,398 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 10:06:15,398 \tHypothesis: A rọ Unevaze Fialoma Via Evaọ Oke yena , Ọrọ Avọ 4\n", "2020-01-18 10:06:15,398 Example #2\n", "2020-01-18 10:06:15,398 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 10:06:15,399 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 10:06:15,399 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana , jẹ so ole evawere : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre o te lo , re o jiri odẹ riẹ , re o jọ erẹwho kpobi oro , re o jiri ei .\n", "2020-01-18 10:06:15,399 Example #3\n", "2020-01-18 10:06:15,399 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 10:06:15,400 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 10:06:15,400 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ọgaga nọ ma re ro ru udhedhẹ .\n", "2020-01-18 10:06:15,400 Validation result (greedy) at epoch 33, step 77000: bleu: 31.25, loss: 33832.4453, ppl: 4.3231, duration: 47.7819s\n", "2020-01-18 10:06:35,266 Epoch 33 Step: 77100 Batch Loss: 1.236198 Tokens per Sec: 10626, Lr: 0.000210\n", "2020-01-18 10:06:55,176 Epoch 33 Step: 77200 Batch Loss: 0.771135 Tokens per Sec: 10716, Lr: 0.000210\n", "2020-01-18 10:07:15,005 Epoch 33 Step: 77300 Batch Loss: 1.220318 Tokens per Sec: 10914, Lr: 0.000210\n", "2020-01-18 10:07:34,929 Epoch 33 Step: 77400 Batch Loss: 1.148776 Tokens per Sec: 10711, Lr: 0.000210\n", "2020-01-18 10:07:43,997 Epoch 33: total training loss 2735.35\n", "2020-01-18 10:07:43,998 EPOCH 34\n", "2020-01-18 10:07:55,297 Epoch 34 Step: 77500 Batch Loss: 1.330556 Tokens per Sec: 10725, Lr: 0.000210\n", "2020-01-18 10:08:15,017 Epoch 34 Step: 77600 Batch Loss: 1.280746 Tokens per Sec: 10710, Lr: 0.000210\n", "2020-01-18 10:08:34,912 Epoch 34 Step: 77700 Batch Loss: 1.050715 Tokens per Sec: 10556, Lr: 0.000210\n", "2020-01-18 10:08:54,899 Epoch 34 Step: 77800 Batch Loss: 1.071699 Tokens per Sec: 10784, Lr: 0.000210\n", "2020-01-18 10:09:14,792 Epoch 34 Step: 77900 Batch Loss: 1.211980 Tokens per Sec: 10824, Lr: 0.000210\n", "2020-01-18 10:09:34,777 Epoch 34 Step: 78000 Batch Loss: 1.034263 Tokens per Sec: 10859, Lr: 0.000210\n", "2020-01-18 10:10:22,625 Example #0\n", "2020-01-18 10:10:22,626 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 10:10:22,626 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 10:10:22,626 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 10:10:22,626 Example #1\n", "2020-01-18 10:10:22,627 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 10:10:22,627 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 10:10:22,627 \tHypothesis: Usi Uvie na U No Ze , Ọrọ Avọ 4\n", "2020-01-18 10:10:22,627 Example #2\n", "2020-01-18 10:10:22,628 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 10:10:22,628 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 10:10:22,628 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ ku irru mai họ evaọ ekuhọ ole owoma nana jẹ be sasa oma : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre na o te ti vihọ , re o ru odẹ riẹ vihọ , re o jiri ai erẹwho kpobi ; se ae ba ẹghale .\n", "2020-01-18 10:10:22,628 Example #3\n", "2020-01-18 10:10:22,628 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 10:10:22,629 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 10:10:22,629 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ọgaga nọ ma re ro ru udhedhẹ .\n", "2020-01-18 10:10:22,629 Validation result (greedy) at epoch 34, step 78000: bleu: 31.19, loss: 34038.2070, ppl: 4.3618, duration: 47.8512s\n", "2020-01-18 10:10:42,577 Epoch 34 Step: 78100 Batch Loss: 1.170212 Tokens per Sec: 10751, Lr: 0.000210\n", "2020-01-18 10:11:02,585 Epoch 34 Step: 78200 Batch Loss: 1.276997 Tokens per Sec: 10723, Lr: 0.000210\n", "2020-01-18 10:11:22,538 Epoch 34 Step: 78300 Batch Loss: 1.213838 Tokens per Sec: 10870, Lr: 0.000210\n", "2020-01-18 10:11:42,498 Epoch 34 Step: 78400 Batch Loss: 1.259237 Tokens per Sec: 10594, Lr: 0.000210\n", "2020-01-18 10:12:02,282 Epoch 34 Step: 78500 Batch Loss: 1.307184 Tokens per Sec: 10580, Lr: 0.000210\n", "2020-01-18 10:12:22,183 Epoch 34 Step: 78600 Batch Loss: 0.870289 Tokens per Sec: 10821, Lr: 0.000210\n", "2020-01-18 10:12:42,013 Epoch 34 Step: 78700 Batch Loss: 1.179706 Tokens per Sec: 10944, Lr: 0.000210\n", "2020-01-18 10:13:02,035 Epoch 34 Step: 78800 Batch Loss: 1.269652 Tokens per Sec: 10771, Lr: 0.000210\n", "2020-01-18 10:13:21,867 Epoch 34 Step: 78900 Batch Loss: 1.080516 Tokens per Sec: 10774, Lr: 0.000210\n", "2020-01-18 10:13:41,574 Epoch 34 Step: 79000 Batch Loss: 1.167199 Tokens per Sec: 10824, Lr: 0.000210\n", "2020-01-18 10:14:29,393 Example #0\n", "2020-01-18 10:14:29,394 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 10:14:29,394 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 10:14:29,394 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 10:14:29,395 Example #1\n", "2020-01-18 10:14:29,395 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 10:14:29,395 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 10:14:29,395 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo\n", "2020-01-18 10:14:29,395 Example #2\n", "2020-01-18 10:14:29,396 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 10:14:29,396 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 10:14:29,396 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai re ma ku abọjọ erru nana họ jẹ so ole oghọghọ : “ Jọ odẹ riẹ [ Jesu Kristi ] o jọ bẹdẹ ; re ọre o te ti vihọ , re o jiri ei , re erẹwho kpobi e ghale ae .\n", "2020-01-18 10:14:29,396 Example #3\n", "2020-01-18 10:14:29,397 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 10:14:29,397 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 10:14:29,397 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 10:14:29,397 Validation result (greedy) at epoch 34, step 79000: bleu: 30.70, loss: 34038.1133, ppl: 4.3618, duration: 47.8229s\n", "2020-01-18 10:14:49,266 Epoch 34 Step: 79100 Batch Loss: 1.184874 Tokens per Sec: 10568, Lr: 0.000210\n", "2020-01-18 10:15:09,058 Epoch 34 Step: 79200 Batch Loss: 0.982592 Tokens per Sec: 10673, Lr: 0.000210\n", "2020-01-18 10:15:29,184 Epoch 34 Step: 79300 Batch Loss: 1.255719 Tokens per Sec: 10872, Lr: 0.000210\n", "2020-01-18 10:15:49,226 Epoch 34 Step: 79400 Batch Loss: 0.981908 Tokens per Sec: 11113, Lr: 0.000210\n", "2020-01-18 10:16:09,106 Epoch 34 Step: 79500 Batch Loss: 1.190517 Tokens per Sec: 10702, Lr: 0.000210\n", "2020-01-18 10:16:29,065 Epoch 34 Step: 79600 Batch Loss: 1.190925 Tokens per Sec: 10717, Lr: 0.000210\n", "2020-01-18 10:16:48,957 Epoch 34 Step: 79700 Batch Loss: 1.330955 Tokens per Sec: 10666, Lr: 0.000210\n", "2020-01-18 10:17:07,993 Epoch 34: total training loss 2709.52\n", "2020-01-18 10:17:07,994 EPOCH 35\n", "2020-01-18 10:17:09,259 Epoch 35 Step: 79800 Batch Loss: 1.114634 Tokens per Sec: 8924, Lr: 0.000210\n", "2020-01-18 10:17:28,991 Epoch 35 Step: 79900 Batch Loss: 1.021611 Tokens per Sec: 10701, Lr: 0.000210\n", "2020-01-18 10:17:48,715 Epoch 35 Step: 80000 Batch Loss: 1.207211 Tokens per Sec: 10728, Lr: 0.000210\n", "2020-01-18 10:18:36,573 Example #0\n", "2020-01-18 10:18:36,574 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 10:18:36,574 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 10:18:36,574 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 10:18:36,574 Example #1\n", "2020-01-18 10:18:36,575 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 10:18:36,575 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 10:18:36,575 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 10:18:36,575 Example #2\n", "2020-01-18 10:18:36,576 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 10:18:36,576 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 10:18:36,576 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ ku irru mai kugbe abọ urere nana nọ o vọ avọ erru na , jẹ so ole omosasọ : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre na o te lo , re odẹ riẹ u vihọ , re o jiri ai kpobi ; re erẹwho na kpobi e ruẹse ghọghọ , re a ruẹse jiri ei .\n", "2020-01-18 10:18:36,576 Example #3\n", "2020-01-18 10:18:36,577 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 10:18:36,577 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 10:18:36,577 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ọgaga nọ ma re ro ru udhedhẹ .\n", "2020-01-18 10:18:36,577 Validation result (greedy) at epoch 35, step 80000: bleu: 31.00, loss: 34040.4805, ppl: 4.3622, duration: 47.8618s\n", "2020-01-18 10:18:56,673 Epoch 35 Step: 80100 Batch Loss: 0.970686 Tokens per Sec: 10799, Lr: 0.000210\n", "2020-01-18 10:19:16,661 Epoch 35 Step: 80200 Batch Loss: 0.954440 Tokens per Sec: 11028, Lr: 0.000210\n", "2020-01-18 10:19:36,556 Epoch 35 Step: 80300 Batch Loss: 1.234049 Tokens per Sec: 10738, Lr: 0.000210\n", "2020-01-18 10:19:56,365 Epoch 35 Step: 80400 Batch Loss: 1.271463 Tokens per Sec: 10477, Lr: 0.000210\n", "2020-01-18 10:20:16,307 Epoch 35 Step: 80500 Batch Loss: 1.240447 Tokens per Sec: 10750, Lr: 0.000210\n", "2020-01-18 10:20:36,173 Epoch 35 Step: 80600 Batch Loss: 1.088145 Tokens per Sec: 10598, Lr: 0.000210\n", "2020-01-18 10:20:56,247 Epoch 35 Step: 80700 Batch Loss: 1.239861 Tokens per Sec: 10910, Lr: 0.000210\n", "2020-01-18 10:21:16,181 Epoch 35 Step: 80800 Batch Loss: 1.300050 Tokens per Sec: 10841, Lr: 0.000210\n", "2020-01-18 10:21:36,037 Epoch 35 Step: 80900 Batch Loss: 1.204152 Tokens per Sec: 10756, Lr: 0.000210\n", "2020-01-18 10:21:56,033 Epoch 35 Step: 81000 Batch Loss: 1.262449 Tokens per Sec: 10589, Lr: 0.000210\n", "2020-01-18 10:22:43,910 Example #0\n", "2020-01-18 10:22:43,911 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 10:22:43,911 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 10:22:43,911 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 10:22:43,911 Example #1\n", "2020-01-18 10:22:43,912 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 10:22:43,912 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 10:22:43,912 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 10:22:43,912 Example #2\n", "2020-01-18 10:22:43,912 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 10:22:43,913 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 10:22:43,913 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana , jẹ be so ole owoma nana : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre o te ti wo odẹ riẹ , re o jiri odẹ riẹ , re o jiri ai kpobi ; re erẹwho na kpobi e ghale ae .\n", "2020-01-18 10:22:43,913 Example #3\n", "2020-01-18 10:22:43,913 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 10:22:43,913 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 10:22:43,914 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga nọ ma re ro ru udhedhẹ .\n", "2020-01-18 10:22:43,914 Validation result (greedy) at epoch 35, step 81000: bleu: 30.97, loss: 34073.1250, ppl: 4.3684, duration: 47.8803s\n", "2020-01-18 10:23:03,843 Epoch 35 Step: 81100 Batch Loss: 1.156942 Tokens per Sec: 10659, Lr: 0.000147\n", "2020-01-18 10:23:23,747 Epoch 35 Step: 81200 Batch Loss: 1.242105 Tokens per Sec: 10766, Lr: 0.000147\n", "2020-01-18 10:23:43,797 Epoch 35 Step: 81300 Batch Loss: 1.043100 Tokens per Sec: 10861, Lr: 0.000147\n", "2020-01-18 10:24:03,829 Epoch 35 Step: 81400 Batch Loss: 1.067302 Tokens per Sec: 10671, Lr: 0.000147\n", "2020-01-18 10:24:23,627 Epoch 35 Step: 81500 Batch Loss: 1.084359 Tokens per Sec: 10801, Lr: 0.000147\n", "2020-01-18 10:24:43,783 Epoch 35 Step: 81600 Batch Loss: 1.318705 Tokens per Sec: 10806, Lr: 0.000147\n", "2020-01-18 10:25:03,744 Epoch 35 Step: 81700 Batch Loss: 1.010242 Tokens per Sec: 10627, Lr: 0.000147\n", "2020-01-18 10:25:23,686 Epoch 35 Step: 81800 Batch Loss: 0.885379 Tokens per Sec: 10717, Lr: 0.000147\n", "2020-01-18 10:25:43,758 Epoch 35 Step: 81900 Batch Loss: 1.151966 Tokens per Sec: 10814, Lr: 0.000147\n", "2020-01-18 10:26:03,673 Epoch 35 Step: 82000 Batch Loss: 1.216513 Tokens per Sec: 10725, Lr: 0.000147\n", "2020-01-18 10:26:51,502 Example #0\n", "2020-01-18 10:26:51,503 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 10:26:51,503 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 10:26:51,503 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 10:26:51,504 Example #1\n", "2020-01-18 10:26:51,504 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 10:26:51,504 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 10:26:51,504 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 10:26:51,504 Example #2\n", "2020-01-18 10:26:51,505 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 10:26:51,505 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 10:26:51,505 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba urru mai nọ ma te roro kpahe abọ urere ọrọ ole owoma nana nọ o vọ avọ omosasọ na : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jọ oghale kẹe erẹwho kpobi ; re o se ai erẹwho kpobi ba ẹghale .\n", "2020-01-18 10:26:51,505 Example #3\n", "2020-01-18 10:26:51,506 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 10:26:51,506 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 10:26:51,506 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ọgaga nọ ma re ro ru udhedhẹ .\n", "2020-01-18 10:26:51,506 Validation result (greedy) at epoch 35, step 82000: bleu: 30.99, loss: 33799.9570, ppl: 4.3170, duration: 47.8324s\n", "2020-01-18 10:27:11,414 Epoch 35 Step: 82100 Batch Loss: 1.062895 Tokens per Sec: 10865, Lr: 0.000147\n", "2020-01-18 10:27:20,703 Epoch 35: total training loss 2682.00\n", "2020-01-18 10:27:20,703 EPOCH 36\n", "2020-01-18 10:27:31,430 Epoch 36 Step: 82200 Batch Loss: 0.894028 Tokens per Sec: 10517, Lr: 0.000147\n", "2020-01-18 10:27:51,608 Epoch 36 Step: 82300 Batch Loss: 1.268088 Tokens per Sec: 10573, Lr: 0.000147\n", "2020-01-18 10:28:11,556 Epoch 36 Step: 82400 Batch Loss: 0.871013 Tokens per Sec: 10743, Lr: 0.000147\n", "2020-01-18 10:28:31,743 Epoch 36 Step: 82500 Batch Loss: 1.077880 Tokens per Sec: 10809, Lr: 0.000147\n", "2020-01-18 10:28:51,573 Epoch 36 Step: 82600 Batch Loss: 1.160564 Tokens per Sec: 11014, Lr: 0.000147\n", "2020-01-18 10:29:11,401 Epoch 36 Step: 82700 Batch Loss: 0.742632 Tokens per Sec: 10687, Lr: 0.000147\n", "2020-01-18 10:29:31,313 Epoch 36 Step: 82800 Batch Loss: 1.301755 Tokens per Sec: 10582, Lr: 0.000147\n", "2020-01-18 10:29:51,293 Epoch 36 Step: 82900 Batch Loss: 1.263757 Tokens per Sec: 10708, Lr: 0.000147\n", "2020-01-18 10:30:11,142 Epoch 36 Step: 83000 Batch Loss: 0.785907 Tokens per Sec: 10794, Lr: 0.000147\n", "2020-01-18 10:30:58,967 Example #0\n", "2020-01-18 10:30:58,968 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 10:30:58,968 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 10:30:58,969 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 10:30:58,969 Example #1\n", "2020-01-18 10:30:58,969 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 10:30:58,969 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 10:30:58,970 \tHypothesis: A rọ omobe - ovẹvẹ Usi Uvie na Wuhrẹ No ( F .\n", "2020-01-18 10:30:58,970 Example #2\n", "2020-01-18 10:30:58,970 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 10:30:58,970 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 10:30:58,970 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba urru mai re ma so ole owoma nana jẹ sasa oma : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] ọ jọ bẹdẹ ; re ọre o te ti wo odẹ riẹ , re o vihọ , re ọ ghale ae ; re erẹwho kpobi e se odẹ riẹ re o jiri ai .\n", "2020-01-18 10:30:58,971 Example #3\n", "2020-01-18 10:30:58,971 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 10:30:58,971 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 10:30:58,971 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 10:30:58,971 Validation result (greedy) at epoch 36, step 83000: bleu: 31.57, loss: 33814.2070, ppl: 4.3197, duration: 47.8288s\n", "2020-01-18 10:31:18,914 Epoch 36 Step: 83100 Batch Loss: 1.125628 Tokens per Sec: 10942, Lr: 0.000147\n", "2020-01-18 10:31:38,892 Epoch 36 Step: 83200 Batch Loss: 1.142366 Tokens per Sec: 10759, Lr: 0.000147\n", "2020-01-18 10:31:58,929 Epoch 36 Step: 83300 Batch Loss: 1.244475 Tokens per Sec: 10874, Lr: 0.000147\n", "2020-01-18 10:32:18,856 Epoch 36 Step: 83400 Batch Loss: 1.080104 Tokens per Sec: 10624, Lr: 0.000147\n", "2020-01-18 10:32:38,685 Epoch 36 Step: 83500 Batch Loss: 1.119559 Tokens per Sec: 10283, Lr: 0.000147\n", "2020-01-18 10:32:58,747 Epoch 36 Step: 83600 Batch Loss: 1.089220 Tokens per Sec: 10827, Lr: 0.000147\n", "2020-01-18 10:33:18,758 Epoch 36 Step: 83700 Batch Loss: 1.191466 Tokens per Sec: 10689, Lr: 0.000147\n", "2020-01-18 10:33:38,791 Epoch 36 Step: 83800 Batch Loss: 1.195046 Tokens per Sec: 10987, Lr: 0.000147\n", "2020-01-18 10:33:58,614 Epoch 36 Step: 83900 Batch Loss: 1.198875 Tokens per Sec: 10739, Lr: 0.000147\n", "2020-01-18 10:34:18,592 Epoch 36 Step: 84000 Batch Loss: 1.232071 Tokens per Sec: 10889, Lr: 0.000147\n", "2020-01-18 10:35:06,459 Example #0\n", "2020-01-18 10:35:06,460 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 10:35:06,460 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 10:35:06,460 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 10:35:06,460 Example #1\n", "2020-01-18 10:35:06,461 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 10:35:06,461 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 10:35:06,461 \tHypothesis: A rọ omobe - ovẹvẹ Uvie na Ru onana , Ọrọ Avọ 2\n", "2020-01-18 10:35:06,461 Example #2\n", "2020-01-18 10:35:06,462 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 10:35:06,462 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 10:35:06,462 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana , jẹ so ole oghọghọ : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] ọ jọ bẹdẹ ; re ọre na o te lo , re o ru re o wo oghale , re o se erẹwho kpobi ba ẹghale kẹ ae .\n", "2020-01-18 10:35:06,462 Example #3\n", "2020-01-18 10:35:06,463 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 10:35:06,463 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 10:35:06,463 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 10:35:06,463 Validation result (greedy) at epoch 36, step 84000: bleu: 31.47, loss: 33762.5703, ppl: 4.3101, duration: 47.8702s\n", "2020-01-18 10:35:26,487 Epoch 36 Step: 84100 Batch Loss: 1.101880 Tokens per Sec: 10824, Lr: 0.000147\n", "2020-01-18 10:35:46,376 Epoch 36 Step: 84200 Batch Loss: 1.184088 Tokens per Sec: 10742, Lr: 0.000147\n", "2020-01-18 10:36:06,235 Epoch 36 Step: 84300 Batch Loss: 1.211696 Tokens per Sec: 10870, Lr: 0.000147\n", "2020-01-18 10:36:26,101 Epoch 36 Step: 84400 Batch Loss: 1.139570 Tokens per Sec: 10734, Lr: 0.000147\n", "2020-01-18 10:36:44,876 Epoch 36: total training loss 2623.39\n", "2020-01-18 10:36:44,877 EPOCH 37\n", "2020-01-18 10:36:46,327 Epoch 37 Step: 84500 Batch Loss: 1.127096 Tokens per Sec: 9144, Lr: 0.000147\n", "2020-01-18 10:37:06,306 Epoch 37 Step: 84600 Batch Loss: 1.045894 Tokens per Sec: 10848, Lr: 0.000147\n", "2020-01-18 10:37:26,364 Epoch 37 Step: 84700 Batch Loss: 1.098091 Tokens per Sec: 10688, Lr: 0.000147\n", "2020-01-18 10:37:46,405 Epoch 37 Step: 84800 Batch Loss: 1.105741 Tokens per Sec: 10900, Lr: 0.000147\n", "2020-01-18 10:38:06,442 Epoch 37 Step: 84900 Batch Loss: 1.165680 Tokens per Sec: 10539, Lr: 0.000147\n", "2020-01-18 10:38:26,435 Epoch 37 Step: 85000 Batch Loss: 1.172506 Tokens per Sec: 10830, Lr: 0.000147\n", "2020-01-18 10:39:14,279 Example #0\n", "2020-01-18 10:39:14,280 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 10:39:14,281 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 10:39:14,281 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 10:39:14,281 Example #1\n", "2020-01-18 10:39:14,282 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 10:39:14,282 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 10:39:14,282 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 10:39:14,282 Example #2\n", "2020-01-18 10:39:14,282 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 10:39:14,283 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 10:39:14,283 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba urru mai nọ u ti kuhọ evaọ abọ urere ọrọ erru nana jẹ so ole oghọghọ : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te ti wo odẹ riẹ , re o vihọ , re o jiri ai kpobi ; re o se erẹwho akpọ na kpobi eghale riẹ .\n", "2020-01-18 10:39:14,283 Example #3\n", "2020-01-18 10:39:14,283 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 10:39:14,283 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 10:39:14,284 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 10:39:14,284 Validation result (greedy) at epoch 37, step 85000: bleu: 30.98, loss: 33862.4062, ppl: 4.3287, duration: 47.8480s\n", "2020-01-18 10:39:34,296 Epoch 37 Step: 85100 Batch Loss: 1.175452 Tokens per Sec: 10875, Lr: 0.000147\n", "2020-01-18 10:39:54,429 Epoch 37 Step: 85200 Batch Loss: 1.164854 Tokens per Sec: 10360, Lr: 0.000147\n", "2020-01-18 10:40:14,324 Epoch 37 Step: 85300 Batch Loss: 1.224499 Tokens per Sec: 10805, Lr: 0.000147\n", "2020-01-18 10:40:34,448 Epoch 37 Step: 85400 Batch Loss: 1.127030 Tokens per Sec: 10716, Lr: 0.000147\n", "2020-01-18 10:40:54,486 Epoch 37 Step: 85500 Batch Loss: 0.997400 Tokens per Sec: 10717, Lr: 0.000147\n", "2020-01-18 10:41:14,328 Epoch 37 Step: 85600 Batch Loss: 1.134476 Tokens per Sec: 10887, Lr: 0.000147\n", "2020-01-18 10:41:34,437 Epoch 37 Step: 85700 Batch Loss: 1.075725 Tokens per Sec: 10728, Lr: 0.000147\n", "2020-01-18 10:41:54,378 Epoch 37 Step: 85800 Batch Loss: 1.175222 Tokens per Sec: 10508, Lr: 0.000147\n", "2020-01-18 10:42:14,264 Epoch 37 Step: 85900 Batch Loss: 0.872903 Tokens per Sec: 10937, Lr: 0.000147\n", "2020-01-18 10:42:34,401 Epoch 37 Step: 86000 Batch Loss: 1.280555 Tokens per Sec: 10802, Lr: 0.000147\n", "2020-01-18 10:43:22,277 Example #0\n", "2020-01-18 10:43:22,278 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 10:43:22,278 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 10:43:22,278 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 10:43:22,279 Example #1\n", "2020-01-18 10:43:22,279 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 10:43:22,279 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 10:43:22,279 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 10:43:22,279 Example #2\n", "2020-01-18 10:43:22,280 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 10:43:22,280 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 10:43:22,280 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ fiba urru mai nọ ma te ku abọ urere ọrọ ile iwoma nana họ : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] ọ jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ o jọ ẹvi , re o je ru re ọ ghale ae kpobi ; re ahwo kpobi a se odẹ riẹ ba ese kẹ e .\n", "2020-01-18 10:43:22,280 Example #3\n", "2020-01-18 10:43:22,281 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 10:43:22,281 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 10:43:22,281 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 10:43:22,281 Validation result (greedy) at epoch 37, step 86000: bleu: 31.15, loss: 33835.0039, ppl: 4.3236, duration: 47.8797s\n", "2020-01-18 10:43:42,375 Epoch 37 Step: 86100 Batch Loss: 1.206297 Tokens per Sec: 10771, Lr: 0.000147\n", "2020-01-18 10:44:02,419 Epoch 37 Step: 86200 Batch Loss: 1.222412 Tokens per Sec: 10677, Lr: 0.000147\n", "2020-01-18 10:44:22,261 Epoch 37 Step: 86300 Batch Loss: 1.199919 Tokens per Sec: 10745, Lr: 0.000147\n", "2020-01-18 10:44:42,328 Epoch 37 Step: 86400 Batch Loss: 0.735584 Tokens per Sec: 10921, Lr: 0.000147\n", "2020-01-18 10:45:02,252 Epoch 37 Step: 86500 Batch Loss: 1.153063 Tokens per Sec: 10858, Lr: 0.000147\n", "2020-01-18 10:45:22,197 Epoch 37 Step: 86600 Batch Loss: 1.201856 Tokens per Sec: 10604, Lr: 0.000147\n", "2020-01-18 10:45:42,056 Epoch 37 Step: 86700 Batch Loss: 1.160276 Tokens per Sec: 10552, Lr: 0.000147\n", "2020-01-18 10:46:02,013 Epoch 37 Step: 86800 Batch Loss: 1.173567 Tokens per Sec: 10861, Lr: 0.000147\n", "2020-01-18 10:46:09,819 Epoch 37: total training loss 2603.74\n", "2020-01-18 10:46:09,820 EPOCH 38\n", "2020-01-18 10:46:22,257 Epoch 38 Step: 86900 Batch Loss: 1.043179 Tokens per Sec: 10704, Lr: 0.000147\n", "2020-01-18 10:46:42,371 Epoch 38 Step: 87000 Batch Loss: 1.213065 Tokens per Sec: 10867, Lr: 0.000147\n", "2020-01-18 10:47:30,211 Example #0\n", "2020-01-18 10:47:30,212 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 10:47:30,212 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 10:47:30,212 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 10:47:30,212 Example #1\n", "2020-01-18 10:47:30,213 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 10:47:30,213 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 10:47:30,213 \tHypothesis: A rọ omobe - ovẹvẹ Uvie na Ru onana , Ọrọ Avọ 4\n", "2020-01-18 10:47:30,213 Example #2\n", "2020-01-18 10:47:30,214 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 10:47:30,214 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 10:47:30,214 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ ku irru mai họ so ole owoma nana nọ o vọ avọ oghọghọ na , inọ : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi e se odẹ riẹ ba ẹghale .\n", "2020-01-18 10:47:30,214 Example #3\n", "2020-01-18 10:47:30,215 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 10:47:30,215 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 10:47:30,215 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 10:47:30,215 Validation result (greedy) at epoch 38, step 87000: bleu: 31.45, loss: 33759.9297, ppl: 4.3096, duration: 47.8437s\n", "2020-01-18 10:47:50,305 Epoch 38 Step: 87100 Batch Loss: 1.097727 Tokens per Sec: 11107, Lr: 0.000103\n", "2020-01-18 10:48:10,268 Epoch 38 Step: 87200 Batch Loss: 1.018635 Tokens per Sec: 10597, Lr: 0.000103\n", "2020-01-18 10:48:29,963 Epoch 38 Step: 87300 Batch Loss: 1.047218 Tokens per Sec: 10648, Lr: 0.000103\n", "2020-01-18 10:48:50,093 Epoch 38 Step: 87400 Batch Loss: 1.058774 Tokens per Sec: 10682, Lr: 0.000103\n", "2020-01-18 10:49:10,000 Epoch 38 Step: 87500 Batch Loss: 1.270287 Tokens per Sec: 10821, Lr: 0.000103\n", "2020-01-18 10:49:29,945 Epoch 38 Step: 87600 Batch Loss: 1.172687 Tokens per Sec: 10703, Lr: 0.000103\n", "2020-01-18 10:49:49,826 Epoch 38 Step: 87700 Batch Loss: 1.066241 Tokens per Sec: 10840, Lr: 0.000103\n", "2020-01-18 10:50:09,819 Epoch 38 Step: 87800 Batch Loss: 1.037892 Tokens per Sec: 10757, Lr: 0.000103\n", "2020-01-18 10:50:30,102 Epoch 38 Step: 87900 Batch Loss: 0.987609 Tokens per Sec: 10991, Lr: 0.000103\n", "2020-01-18 10:50:50,097 Epoch 38 Step: 88000 Batch Loss: 1.140367 Tokens per Sec: 10618, Lr: 0.000103\n", "2020-01-18 10:51:37,921 Example #0\n", "2020-01-18 10:51:37,922 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 10:51:37,922 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 10:51:37,923 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 10:51:37,923 Example #1\n", "2020-01-18 10:51:37,923 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 10:51:37,923 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 10:51:37,923 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 10:51:37,923 Example #2\n", "2020-01-18 10:51:37,924 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 10:51:37,924 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 10:51:37,924 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ ku irru mai jọ nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana nọ e rẹ sasa oma na : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre o te ti wo odẹ riẹ , re o ru re o wo oghale , re erẹwho kpobi e se odẹ riẹ ba ẹghale ; re o se ai erẹwho kpobi .\n", "2020-01-18 10:51:37,924 Example #3\n", "2020-01-18 10:51:37,925 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 10:51:37,925 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 10:51:37,925 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re a ru udhedhẹ .\n", "2020-01-18 10:51:37,925 Validation result (greedy) at epoch 38, step 88000: bleu: 31.43, loss: 33761.5195, ppl: 4.3099, duration: 47.8274s\n", "2020-01-18 10:51:58,067 Epoch 38 Step: 88100 Batch Loss: 1.013112 Tokens per Sec: 10915, Lr: 0.000103\n", "2020-01-18 10:52:17,675 Epoch 38 Step: 88200 Batch Loss: 1.135365 Tokens per Sec: 10465, Lr: 0.000103\n", "2020-01-18 10:52:37,676 Epoch 38 Step: 88300 Batch Loss: 1.097527 Tokens per Sec: 10534, Lr: 0.000103\n", "2020-01-18 10:52:57,653 Epoch 38 Step: 88400 Batch Loss: 1.196953 Tokens per Sec: 10825, Lr: 0.000103\n", "2020-01-18 10:53:17,478 Epoch 38 Step: 88500 Batch Loss: 0.964436 Tokens per Sec: 10507, Lr: 0.000103\n", "2020-01-18 10:53:37,459 Epoch 38 Step: 88600 Batch Loss: 1.038342 Tokens per Sec: 10744, Lr: 0.000103\n", "2020-01-18 10:53:57,505 Epoch 38 Step: 88700 Batch Loss: 0.948905 Tokens per Sec: 10822, Lr: 0.000103\n", "2020-01-18 10:54:17,526 Epoch 38 Step: 88800 Batch Loss: 1.051849 Tokens per Sec: 10781, Lr: 0.000103\n", "2020-01-18 10:54:37,619 Epoch 38 Step: 88900 Batch Loss: 1.141380 Tokens per Sec: 10762, Lr: 0.000103\n", "2020-01-18 10:54:57,538 Epoch 38 Step: 89000 Batch Loss: 1.189598 Tokens per Sec: 10733, Lr: 0.000103\n", "2020-01-18 10:55:45,400 Hooray! New best validation result [ppl]!\n", "2020-01-18 10:55:45,401 Saving new checkpoint.\n", "2020-01-18 10:55:47,414 Example #0\n", "2020-01-18 10:55:47,414 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 10:55:47,414 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 10:55:47,414 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 10:55:47,415 Example #1\n", "2020-01-18 10:55:47,415 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 10:55:47,415 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 10:55:47,415 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 10:55:47,415 Example #2\n", "2020-01-18 10:55:47,416 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 10:55:47,416 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 10:55:47,416 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ fiba urru mai nọ u ti kuhọ evaọ abọ urere ọrọ ile iwoma nana nọ e rẹ sasa oma na : “ Jọ odẹ riẹ [ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te lo , re o jiri odẹ riẹ , re o jọ erẹwho kpobi oro ; re o se ai erẹwho na kpobi ba odẹ riẹ .\n", "2020-01-18 10:55:47,416 Example #3\n", "2020-01-18 10:55:47,416 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 10:55:47,416 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 10:55:47,416 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 10:55:47,416 Validation result (greedy) at epoch 38, step 89000: bleu: 31.64, loss: 33701.6055, ppl: 4.2987, duration: 49.8778s\n", "2020-01-18 10:56:07,802 Epoch 38 Step: 89100 Batch Loss: 1.148277 Tokens per Sec: 10436, Lr: 0.000103\n", "2020-01-18 10:56:24,940 Epoch 38: total training loss 2568.05\n", "2020-01-18 10:56:24,940 EPOCH 39\n", "2020-01-18 10:56:27,705 Epoch 39 Step: 89200 Batch Loss: 0.880706 Tokens per Sec: 9293, Lr: 0.000103\n", "2020-01-18 10:56:47,683 Epoch 39 Step: 89300 Batch Loss: 1.083194 Tokens per Sec: 10819, Lr: 0.000103\n", "2020-01-18 10:57:07,629 Epoch 39 Step: 89400 Batch Loss: 1.104497 Tokens per Sec: 10678, Lr: 0.000103\n", "2020-01-18 10:57:27,594 Epoch 39 Step: 89500 Batch Loss: 1.154970 Tokens per Sec: 10812, Lr: 0.000103\n", "2020-01-18 10:57:47,617 Epoch 39 Step: 89600 Batch Loss: 0.816295 Tokens per Sec: 10975, Lr: 0.000103\n", "2020-01-18 10:58:07,512 Epoch 39 Step: 89700 Batch Loss: 0.962043 Tokens per Sec: 10713, Lr: 0.000103\n", "2020-01-18 10:58:27,644 Epoch 39 Step: 89800 Batch Loss: 1.057186 Tokens per Sec: 11067, Lr: 0.000103\n", "2020-01-18 10:58:47,650 Epoch 39 Step: 89900 Batch Loss: 0.991708 Tokens per Sec: 10742, Lr: 0.000103\n", "2020-01-18 10:59:07,657 Epoch 39 Step: 90000 Batch Loss: 0.885432 Tokens per Sec: 10487, Lr: 0.000103\n", "2020-01-18 10:59:55,538 Hooray! New best validation result [ppl]!\n", "2020-01-18 10:59:55,539 Saving new checkpoint.\n", "2020-01-18 10:59:57,423 Example #0\n", "2020-01-18 10:59:57,424 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 10:59:57,424 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 10:59:57,424 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 10:59:57,424 Example #1\n", "2020-01-18 10:59:57,424 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 10:59:57,425 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 10:59:57,425 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 10:59:57,425 Example #2\n", "2020-01-18 10:59:57,426 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 10:59:57,426 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 10:59:57,426 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana nọ e vọ avọ omosasọ na : “ Jọ odẹ riẹ [ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre na o te ti wo odẹ riẹ , re o ru re o jiri ai , re erẹwho akpọ na kpobi e jiri ei .\n", "2020-01-18 10:59:57,426 Example #3\n", "2020-01-18 10:59:57,427 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 10:59:57,427 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 10:59:57,427 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 10:59:57,427 Validation result (greedy) at epoch 39, step 90000: bleu: 31.41, loss: 33686.8633, ppl: 4.2960, duration: 49.7694s\n", "2020-01-18 11:00:17,931 Epoch 39 Step: 90100 Batch Loss: 1.146012 Tokens per Sec: 10747, Lr: 0.000103\n", "2020-01-18 11:00:37,763 Epoch 39 Step: 90200 Batch Loss: 1.184832 Tokens per Sec: 10732, Lr: 0.000103\n", "2020-01-18 11:00:57,762 Epoch 39 Step: 90300 Batch Loss: 1.053533 Tokens per Sec: 10804, Lr: 0.000103\n", "2020-01-18 11:01:17,882 Epoch 39 Step: 90400 Batch Loss: 0.923105 Tokens per Sec: 10599, Lr: 0.000103\n", "2020-01-18 11:01:37,935 Epoch 39 Step: 90500 Batch Loss: 1.198161 Tokens per Sec: 10546, Lr: 0.000103\n", "2020-01-18 11:01:58,099 Epoch 39 Step: 90600 Batch Loss: 1.006126 Tokens per Sec: 10917, Lr: 0.000103\n", "2020-01-18 11:02:17,974 Epoch 39 Step: 90700 Batch Loss: 1.141853 Tokens per Sec: 10762, Lr: 0.000103\n", "2020-01-18 11:02:37,988 Epoch 39 Step: 90800 Batch Loss: 1.148700 Tokens per Sec: 10482, Lr: 0.000103\n", "2020-01-18 11:02:57,934 Epoch 39 Step: 90900 Batch Loss: 1.174060 Tokens per Sec: 10970, Lr: 0.000103\n", "2020-01-18 11:03:17,751 Epoch 39 Step: 91000 Batch Loss: 1.057316 Tokens per Sec: 10748, Lr: 0.000103\n", "2020-01-18 11:04:05,649 Hooray! New best validation result [ppl]!\n", "2020-01-18 11:04:05,649 Saving new checkpoint.\n", "2020-01-18 11:04:07,797 Example #0\n", "2020-01-18 11:04:07,797 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 11:04:07,798 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 11:04:07,798 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 11:04:07,798 Example #1\n", "2020-01-18 11:04:07,800 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 11:04:07,800 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 11:04:07,801 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 11:04:07,801 Example #2\n", "2020-01-18 11:04:07,801 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 11:04:07,801 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 11:04:07,801 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana nọ e rẹ sasa oma na : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] ọ jọ bẹdẹ ; re ọre o te ru odẹ riẹ vihọ , re o jiri ai , re o jiri ai kpobi ; re erẹwho kpobi e se odẹ riẹ ba ẹghale .\n", "2020-01-18 11:04:07,801 Example #3\n", "2020-01-18 11:04:07,802 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 11:04:07,802 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 11:04:07,802 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re a ru udhedhẹ .\n", "2020-01-18 11:04:07,802 Validation result (greedy) at epoch 39, step 91000: bleu: 31.84, loss: 33661.7227, ppl: 4.2913, duration: 50.0506s\n", "2020-01-18 11:04:28,227 Epoch 39 Step: 91100 Batch Loss: 1.223218 Tokens per Sec: 10441, Lr: 0.000103\n", "2020-01-18 11:04:48,221 Epoch 39 Step: 91200 Batch Loss: 1.111552 Tokens per Sec: 10702, Lr: 0.000103\n", "2020-01-18 11:05:08,137 Epoch 39 Step: 91300 Batch Loss: 1.036965 Tokens per Sec: 10529, Lr: 0.000103\n", "2020-01-18 11:05:28,236 Epoch 39 Step: 91400 Batch Loss: 1.123574 Tokens per Sec: 10848, Lr: 0.000103\n", "2020-01-18 11:05:48,130 Epoch 39 Step: 91500 Batch Loss: 1.050183 Tokens per Sec: 10603, Lr: 0.000103\n", "2020-01-18 11:05:54,688 Epoch 39: total training loss 2548.09\n", "2020-01-18 11:05:54,688 EPOCH 40\n", "2020-01-18 11:06:08,448 Epoch 40 Step: 91600 Batch Loss: 1.061849 Tokens per Sec: 10496, Lr: 0.000103\n", "2020-01-18 11:06:28,463 Epoch 40 Step: 91700 Batch Loss: 1.025203 Tokens per Sec: 10856, Lr: 0.000103\n", "2020-01-18 11:06:48,481 Epoch 40 Step: 91800 Batch Loss: 1.079697 Tokens per Sec: 10654, Lr: 0.000103\n", "2020-01-18 11:07:08,580 Epoch 40 Step: 91900 Batch Loss: 0.767640 Tokens per Sec: 10788, Lr: 0.000103\n", "2020-01-18 11:07:28,717 Epoch 40 Step: 92000 Batch Loss: 1.046134 Tokens per Sec: 10974, Lr: 0.000103\n", "2020-01-18 11:08:16,581 Example #0\n", "2020-01-18 11:08:16,582 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 11:08:16,583 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 11:08:16,583 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 11:08:16,583 Example #1\n", "2020-01-18 11:08:16,584 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 11:08:16,584 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 11:08:16,584 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 11:08:16,584 Example #2\n", "2020-01-18 11:08:16,585 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 11:08:16,586 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 11:08:16,586 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai kpobi ; re o se ai erẹwho kpobi oro .\n", "2020-01-18 11:08:16,586 Example #3\n", "2020-01-18 11:08:16,586 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 11:08:16,587 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 11:08:16,587 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re a ru udhedhẹ .\n", "2020-01-18 11:08:16,587 Validation result (greedy) at epoch 40, step 92000: bleu: 31.32, loss: 33806.4648, ppl: 4.3182, duration: 47.8693s\n", "2020-01-18 11:08:36,605 Epoch 40 Step: 92100 Batch Loss: 1.101015 Tokens per Sec: 10441, Lr: 0.000103\n", "2020-01-18 11:08:56,493 Epoch 40 Step: 92200 Batch Loss: 0.958561 Tokens per Sec: 10930, Lr: 0.000103\n", "2020-01-18 11:09:16,434 Epoch 40 Step: 92300 Batch Loss: 1.063045 Tokens per Sec: 10561, Lr: 0.000103\n", "2020-01-18 11:09:36,483 Epoch 40 Step: 92400 Batch Loss: 1.175164 Tokens per Sec: 10705, Lr: 0.000103\n", "2020-01-18 11:09:56,547 Epoch 40 Step: 92500 Batch Loss: 1.107987 Tokens per Sec: 10504, Lr: 0.000103\n", "2020-01-18 11:10:16,535 Epoch 40 Step: 92600 Batch Loss: 1.034057 Tokens per Sec: 11154, Lr: 0.000103\n", "2020-01-18 11:10:36,549 Epoch 40 Step: 92700 Batch Loss: 1.215201 Tokens per Sec: 10848, Lr: 0.000103\n", "2020-01-18 11:10:56,550 Epoch 40 Step: 92800 Batch Loss: 1.194867 Tokens per Sec: 10618, Lr: 0.000103\n", "2020-01-18 11:11:16,508 Epoch 40 Step: 92900 Batch Loss: 1.223999 Tokens per Sec: 10755, Lr: 0.000103\n", "2020-01-18 11:11:36,638 Epoch 40 Step: 93000 Batch Loss: 1.152045 Tokens per Sec: 10723, Lr: 0.000103\n", "2020-01-18 11:12:24,530 Example #0\n", "2020-01-18 11:12:24,531 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 11:12:24,531 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 11:12:24,531 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 11:12:24,531 Example #1\n", "2020-01-18 11:12:24,532 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 11:12:24,532 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 11:12:24,532 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 11:12:24,532 Example #2\n", "2020-01-18 11:12:24,532 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 11:12:24,533 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 11:12:24,533 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere nana nọ o vọ avọ erru na : “ Jọ odẹ riẹ [ koyehọ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre na o te lo , re odẹ riẹ u vihọ , re o jiri ai kpobi ; re o jiri erẹwho akpọ na kpobi .\n", "2020-01-18 11:12:24,533 Example #3\n", "2020-01-18 11:12:24,533 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 11:12:24,533 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 11:12:24,534 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 11:12:24,534 Validation result (greedy) at epoch 40, step 93000: bleu: 31.49, loss: 33756.8984, ppl: 4.3090, duration: 47.8957s\n", "2020-01-18 11:12:44,378 Epoch 40 Step: 93100 Batch Loss: 1.155426 Tokens per Sec: 10616, Lr: 0.000103\n", "2020-01-18 11:13:04,474 Epoch 40 Step: 93200 Batch Loss: 1.095357 Tokens per Sec: 10547, Lr: 0.000103\n", "2020-01-18 11:13:24,537 Epoch 40 Step: 93300 Batch Loss: 1.088427 Tokens per Sec: 10486, Lr: 0.000103\n", "2020-01-18 11:13:44,277 Epoch 40 Step: 93400 Batch Loss: 1.125347 Tokens per Sec: 10777, Lr: 0.000103\n", "2020-01-18 11:14:04,179 Epoch 40 Step: 93500 Batch Loss: 1.056146 Tokens per Sec: 10770, Lr: 0.000103\n", "2020-01-18 11:14:24,225 Epoch 40 Step: 93600 Batch Loss: 1.128406 Tokens per Sec: 10815, Lr: 0.000103\n", "2020-01-18 11:14:44,285 Epoch 40 Step: 93700 Batch Loss: 1.217770 Tokens per Sec: 11046, Lr: 0.000103\n", "2020-01-18 11:15:04,383 Epoch 40 Step: 93800 Batch Loss: 0.940365 Tokens per Sec: 11015, Lr: 0.000103\n", "2020-01-18 11:15:19,329 Epoch 40: total training loss 2529.46\n", "2020-01-18 11:15:19,330 EPOCH 41\n", "2020-01-18 11:15:24,631 Epoch 41 Step: 93900 Batch Loss: 0.980635 Tokens per Sec: 10432, Lr: 0.000103\n", "2020-01-18 11:15:44,312 Epoch 41 Step: 94000 Batch Loss: 1.054721 Tokens per Sec: 10505, Lr: 0.000103\n", "2020-01-18 11:16:32,188 Example #0\n", "2020-01-18 11:16:32,189 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 11:16:32,190 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 11:16:32,190 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 11:16:32,190 Example #1\n", "2020-01-18 11:16:32,190 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 11:16:32,191 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 11:16:32,191 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 11:16:32,191 Example #2\n", "2020-01-18 11:16:32,191 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 11:16:32,191 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 11:16:32,192 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ ku irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana nọ e vọ avọ omosasọ na : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te lo , re o jiri odẹ riẹ , re o jiri ai kpobi ; re erẹwho akpọ na kpobi a se odẹ riẹ .\n", "2020-01-18 11:16:32,192 Example #3\n", "2020-01-18 11:16:32,192 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 11:16:32,192 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 11:16:32,192 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 11:16:32,192 Validation result (greedy) at epoch 41, step 94000: bleu: 31.55, loss: 33767.6055, ppl: 4.3110, duration: 47.8805s\n", "2020-01-18 11:16:52,087 Epoch 41 Step: 94100 Batch Loss: 1.214900 Tokens per Sec: 11056, Lr: 0.000103\n", "2020-01-18 11:17:12,312 Epoch 41 Step: 94200 Batch Loss: 1.090872 Tokens per Sec: 10564, Lr: 0.000103\n", "2020-01-18 11:17:32,438 Epoch 41 Step: 94300 Batch Loss: 1.137823 Tokens per Sec: 10746, Lr: 0.000103\n", "2020-01-18 11:17:52,309 Epoch 41 Step: 94400 Batch Loss: 0.853047 Tokens per Sec: 10307, Lr: 0.000103\n", "2020-01-18 11:18:12,182 Epoch 41 Step: 94500 Batch Loss: 1.149742 Tokens per Sec: 10808, Lr: 0.000103\n", "2020-01-18 11:18:32,216 Epoch 41 Step: 94600 Batch Loss: 1.051662 Tokens per Sec: 10782, Lr: 0.000103\n", "2020-01-18 11:18:52,317 Epoch 41 Step: 94700 Batch Loss: 1.096603 Tokens per Sec: 10717, Lr: 0.000103\n", "2020-01-18 11:19:12,172 Epoch 41 Step: 94800 Batch Loss: 0.962877 Tokens per Sec: 10666, Lr: 0.000103\n", "2020-01-18 11:19:32,128 Epoch 41 Step: 94900 Batch Loss: 1.147129 Tokens per Sec: 10953, Lr: 0.000103\n", "2020-01-18 11:19:52,232 Epoch 41 Step: 95000 Batch Loss: 1.064504 Tokens per Sec: 10923, Lr: 0.000103\n", "2020-01-18 11:20:40,102 Example #0\n", "2020-01-18 11:20:40,103 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 11:20:40,103 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 11:20:40,103 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 11:20:40,104 Example #1\n", "2020-01-18 11:20:40,104 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 11:20:40,104 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 11:20:40,104 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 11:20:40,104 Example #2\n", "2020-01-18 11:20:40,105 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 11:20:40,105 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 11:20:40,105 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere nana nọ o vọ avọ erru na : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te lo , re o jiri odẹ riẹ , re o jiri ai kpobi ; re erẹwho kpobi e ghale ae .\n", "2020-01-18 11:20:40,105 Example #3\n", "2020-01-18 11:20:40,105 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 11:20:40,106 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 11:20:40,106 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re a ru udhedhẹ .\n", "2020-01-18 11:20:40,106 Validation result (greedy) at epoch 41, step 95000: bleu: 31.76, loss: 33717.9922, ppl: 4.3017, duration: 47.8734s\n", "2020-01-18 11:21:00,149 Epoch 41 Step: 95100 Batch Loss: 0.971028 Tokens per Sec: 10728, Lr: 0.000103\n", "2020-01-18 11:21:20,105 Epoch 41 Step: 95200 Batch Loss: 0.992464 Tokens per Sec: 10829, Lr: 0.000103\n", "2020-01-18 11:21:40,088 Epoch 41 Step: 95300 Batch Loss: 1.048295 Tokens per Sec: 10962, Lr: 0.000103\n", "2020-01-18 11:22:00,029 Epoch 41 Step: 95400 Batch Loss: 1.137511 Tokens per Sec: 10991, Lr: 0.000103\n", "2020-01-18 11:22:20,141 Epoch 41 Step: 95500 Batch Loss: 1.211958 Tokens per Sec: 10692, Lr: 0.000103\n", "2020-01-18 11:22:40,129 Epoch 41 Step: 95600 Batch Loss: 1.109330 Tokens per Sec: 10883, Lr: 0.000103\n", "2020-01-18 11:22:59,841 Epoch 41 Step: 95700 Batch Loss: 1.096895 Tokens per Sec: 10493, Lr: 0.000103\n", "2020-01-18 11:23:19,931 Epoch 41 Step: 95800 Batch Loss: 1.138766 Tokens per Sec: 10828, Lr: 0.000103\n", "2020-01-18 11:23:39,958 Epoch 41 Step: 95900 Batch Loss: 1.135626 Tokens per Sec: 10842, Lr: 0.000103\n", "2020-01-18 11:23:59,877 Epoch 41 Step: 96000 Batch Loss: 1.057435 Tokens per Sec: 10722, Lr: 0.000103\n", "2020-01-18 11:24:47,665 Hooray! New best validation result [ppl]!\n", "2020-01-18 11:24:47,665 Saving new checkpoint.\n", "2020-01-18 11:24:49,733 Example #0\n", "2020-01-18 11:24:49,733 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 11:24:49,734 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 11:24:49,734 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 11:24:49,734 Example #1\n", "2020-01-18 11:24:49,734 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 11:24:49,734 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 11:24:49,735 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 11:24:49,735 Example #2\n", "2020-01-18 11:24:49,735 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 11:24:49,735 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 11:24:49,735 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana nọ e rẹ sasa oma na : “ Jọ odẹ riẹ [ koyehọ Jesu Kristi Ovie na ] o jọ bẹdẹ ; re ọre na o te lo , re odẹ riẹ u vihọ , re o jiri ai , re o jiri ai erẹwho kpobi ; re a se odẹ riẹ .\n", "2020-01-18 11:24:49,736 Example #3\n", "2020-01-18 11:24:49,736 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 11:24:49,736 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 11:24:49,736 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba ologbo kẹ udhedhẹ .\n", "2020-01-18 11:24:49,737 Validation result (greedy) at epoch 41, step 96000: bleu: 31.60, loss: 33647.0586, ppl: 4.2886, duration: 49.8595s\n", "2020-01-18 11:25:09,923 Epoch 41 Step: 96100 Batch Loss: 1.179927 Tokens per Sec: 10442, Lr: 0.000103\n", "2020-01-18 11:25:30,100 Epoch 41 Step: 96200 Batch Loss: 1.182975 Tokens per Sec: 11082, Lr: 0.000103\n", "2020-01-18 11:25:33,280 Epoch 41: total training loss 2518.56\n", "2020-01-18 11:25:33,281 EPOCH 42\n", "2020-01-18 11:25:50,316 Epoch 42 Step: 96300 Batch Loss: 1.082746 Tokens per Sec: 10472, Lr: 0.000103\n", "2020-01-18 11:26:10,270 Epoch 42 Step: 96400 Batch Loss: 1.038519 Tokens per Sec: 10720, Lr: 0.000103\n", "2020-01-18 11:26:30,381 Epoch 42 Step: 96500 Batch Loss: 1.094494 Tokens per Sec: 10465, Lr: 0.000103\n", "2020-01-18 11:26:50,652 Epoch 42 Step: 96600 Batch Loss: 1.171365 Tokens per Sec: 10611, Lr: 0.000103\n", "2020-01-18 11:27:10,564 Epoch 42 Step: 96700 Batch Loss: 1.087719 Tokens per Sec: 10731, Lr: 0.000103\n", "2020-01-18 11:27:30,510 Epoch 42 Step: 96800 Batch Loss: 1.008707 Tokens per Sec: 10773, Lr: 0.000103\n", "2020-01-18 11:27:50,515 Epoch 42 Step: 96900 Batch Loss: 1.133197 Tokens per Sec: 10762, Lr: 0.000103\n", "2020-01-18 11:28:10,374 Epoch 42 Step: 97000 Batch Loss: 1.004674 Tokens per Sec: 10518, Lr: 0.000103\n", "2020-01-18 11:28:58,206 Example #0\n", "2020-01-18 11:28:58,207 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 11:28:58,207 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 11:28:58,207 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 11:28:58,207 Example #1\n", "2020-01-18 11:28:58,208 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 11:28:58,208 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 11:28:58,208 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 11:28:58,208 Example #2\n", "2020-01-18 11:28:58,208 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 11:28:58,209 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 11:28:58,209 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ fiba urru mai re ma ku ole owoma nana họ jẹ so ole evawere : “ Jọ odẹ riẹ [ ọrọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ o vihọ , re o jiri ai , re o jiri erẹwho kpobi ; re o jiri ei .\n", "2020-01-18 11:28:58,209 Example #3\n", "2020-01-18 11:28:58,209 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 11:28:58,209 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 11:28:58,210 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re a ru udhedhẹ .\n", "2020-01-18 11:28:58,210 Validation result (greedy) at epoch 42, step 97000: bleu: 31.58, loss: 33808.8516, ppl: 4.3187, duration: 47.8353s\n", "2020-01-18 11:29:18,266 Epoch 42 Step: 97100 Batch Loss: 1.105665 Tokens per Sec: 10757, Lr: 0.000103\n", "2020-01-18 11:29:38,061 Epoch 42 Step: 97200 Batch Loss: 0.941933 Tokens per Sec: 10617, Lr: 0.000103\n", "2020-01-18 11:29:58,170 Epoch 42 Step: 97300 Batch Loss: 0.789137 Tokens per Sec: 10693, Lr: 0.000103\n", "2020-01-18 11:30:18,161 Epoch 42 Step: 97400 Batch Loss: 1.122969 Tokens per Sec: 10782, Lr: 0.000103\n", "2020-01-18 11:30:38,218 Epoch 42 Step: 97500 Batch Loss: 1.161349 Tokens per Sec: 10880, Lr: 0.000103\n", "2020-01-18 11:30:58,324 Epoch 42 Step: 97600 Batch Loss: 1.208823 Tokens per Sec: 10938, Lr: 0.000103\n", "2020-01-18 11:31:18,324 Epoch 42 Step: 97700 Batch Loss: 0.627061 Tokens per Sec: 10793, Lr: 0.000103\n", "2020-01-18 11:31:38,154 Epoch 42 Step: 97800 Batch Loss: 1.114008 Tokens per Sec: 10777, Lr: 0.000103\n", "2020-01-18 11:31:58,337 Epoch 42 Step: 97900 Batch Loss: 0.860358 Tokens per Sec: 10872, Lr: 0.000103\n", "2020-01-18 11:32:18,076 Epoch 42 Step: 98000 Batch Loss: 1.065482 Tokens per Sec: 10694, Lr: 0.000103\n", "2020-01-18 11:33:05,943 Hooray! New best validation result [ppl]!\n", "2020-01-18 11:33:05,943 Saving new checkpoint.\n", "2020-01-18 11:33:08,500 Example #0\n", "2020-01-18 11:33:08,500 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 11:33:08,500 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 11:33:08,500 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 11:33:08,500 Example #1\n", "2020-01-18 11:33:08,501 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 11:33:08,501 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 11:33:08,501 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 11:33:08,501 Example #2\n", "2020-01-18 11:33:08,501 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 11:33:08,501 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 11:33:08,501 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ ku irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana nọ e rẹ sasa oma na : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te lo , re odẹ riẹ u vihọ , re o jiri ai kpobi ; re erẹwho na kpobi e se odẹ riẹ .\n", "2020-01-18 11:33:08,501 Example #3\n", "2020-01-18 11:33:08,502 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 11:33:08,502 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 11:33:08,502 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 11:33:08,502 Validation result (greedy) at epoch 42, step 98000: bleu: 31.43, loss: 33645.6445, ppl: 4.2883, duration: 50.4250s\n", "2020-01-18 11:33:28,901 Epoch 42 Step: 98100 Batch Loss: 1.119831 Tokens per Sec: 10734, Lr: 0.000103\n", "2020-01-18 11:33:48,860 Epoch 42 Step: 98200 Batch Loss: 1.089386 Tokens per Sec: 10912, Lr: 0.000103\n", "2020-01-18 11:34:09,071 Epoch 42 Step: 98300 Batch Loss: 1.222162 Tokens per Sec: 10752, Lr: 0.000103\n", "2020-01-18 11:34:28,945 Epoch 42 Step: 98400 Batch Loss: 1.166424 Tokens per Sec: 10694, Lr: 0.000103\n", "2020-01-18 11:34:49,058 Epoch 42 Step: 98500 Batch Loss: 1.103939 Tokens per Sec: 10922, Lr: 0.000103\n", "2020-01-18 11:35:00,812 Epoch 42: total training loss 2511.64\n", "2020-01-18 11:35:00,812 EPOCH 43\n", "2020-01-18 11:35:09,282 Epoch 43 Step: 98600 Batch Loss: 1.087347 Tokens per Sec: 10287, Lr: 0.000103\n", "2020-01-18 11:35:29,093 Epoch 43 Step: 98700 Batch Loss: 1.112465 Tokens per Sec: 10676, Lr: 0.000103\n", "2020-01-18 11:35:49,037 Epoch 43 Step: 98800 Batch Loss: 1.163426 Tokens per Sec: 10678, Lr: 0.000103\n", "2020-01-18 11:36:09,025 Epoch 43 Step: 98900 Batch Loss: 1.025666 Tokens per Sec: 10762, Lr: 0.000103\n", "2020-01-18 11:36:28,989 Epoch 43 Step: 99000 Batch Loss: 1.044136 Tokens per Sec: 10545, Lr: 0.000103\n", "2020-01-18 11:37:16,857 Example #0\n", "2020-01-18 11:37:16,858 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 11:37:16,858 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 11:37:16,858 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 11:37:16,858 Example #1\n", "2020-01-18 11:37:16,859 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 11:37:16,859 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 11:37:16,859 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 11:37:16,859 Example #2\n", "2020-01-18 11:37:16,860 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 11:37:16,860 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 11:37:16,860 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ ku irru mai họ so ole owoma nana jẹ sasa oma : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re o ru odẹ riẹ vihọ , re o jiri ai , re o jiri ai kpobi ; re erẹwho akpọ na kpobi e jiri ei .\n", "2020-01-18 11:37:16,860 Example #3\n", "2020-01-18 11:37:16,860 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 11:37:16,861 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 11:37:16,861 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re a ru udhedhẹ .\n", "2020-01-18 11:37:16,861 Validation result (greedy) at epoch 43, step 99000: bleu: 31.50, loss: 33846.6992, ppl: 4.3258, duration: 47.8713s\n", "2020-01-18 11:37:36,905 Epoch 43 Step: 99100 Batch Loss: 1.052064 Tokens per Sec: 10767, Lr: 0.000103\n", "2020-01-18 11:37:56,849 Epoch 43 Step: 99200 Batch Loss: 0.904982 Tokens per Sec: 10773, Lr: 0.000103\n", "2020-01-18 11:38:16,936 Epoch 43 Step: 99300 Batch Loss: 1.126922 Tokens per Sec: 10882, Lr: 0.000103\n", "2020-01-18 11:38:36,823 Epoch 43 Step: 99400 Batch Loss: 0.822226 Tokens per Sec: 10811, Lr: 0.000103\n", "2020-01-18 11:38:56,986 Epoch 43 Step: 99500 Batch Loss: 1.156065 Tokens per Sec: 10774, Lr: 0.000103\n", "2020-01-18 11:39:17,058 Epoch 43 Step: 99600 Batch Loss: 1.056188 Tokens per Sec: 10860, Lr: 0.000103\n", "2020-01-18 11:39:36,990 Epoch 43 Step: 99700 Batch Loss: 1.152803 Tokens per Sec: 10897, Lr: 0.000103\n", "2020-01-18 11:39:57,114 Epoch 43 Step: 99800 Batch Loss: 1.115694 Tokens per Sec: 10688, Lr: 0.000103\n", "2020-01-18 11:40:17,085 Epoch 43 Step: 99900 Batch Loss: 1.220730 Tokens per Sec: 10607, Lr: 0.000103\n", "2020-01-18 11:40:37,058 Epoch 43 Step: 100000 Batch Loss: 1.127916 Tokens per Sec: 10857, Lr: 0.000103\n", "2020-01-18 11:41:24,897 Example #0\n", "2020-01-18 11:41:24,898 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 11:41:24,898 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 11:41:24,898 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 11:41:24,899 Example #1\n", "2020-01-18 11:41:24,899 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 11:41:24,899 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 11:41:24,899 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 11:41:24,899 Example #2\n", "2020-01-18 11:41:24,900 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 11:41:24,900 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 11:41:24,900 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba irru mai nọ i bi kuhọ evaọ abọ urere nana nọ o vọ avọ erru na : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] ọ jọ bẹdẹ ; re ọre na o te lo , re o jiri odẹ riẹ , re o jiri ai erẹwho akpọ na kpobi ; re o jiri ei .\n", "2020-01-18 11:41:24,900 Example #3\n", "2020-01-18 11:41:24,901 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 11:41:24,901 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 11:41:24,901 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 11:41:24,901 Validation result (greedy) at epoch 43, step 100000: bleu: 31.84, loss: 33655.1758, ppl: 4.2901, duration: 47.8429s\n", "2020-01-18 11:41:44,897 Epoch 43 Step: 100100 Batch Loss: 1.149603 Tokens per Sec: 10911, Lr: 0.000103\n", "2020-01-18 11:42:04,885 Epoch 43 Step: 100200 Batch Loss: 0.716487 Tokens per Sec: 10690, Lr: 0.000103\n", "2020-01-18 11:42:24,700 Epoch 43 Step: 100300 Batch Loss: 1.105246 Tokens per Sec: 10963, Lr: 0.000103\n", "2020-01-18 11:42:44,610 Epoch 43 Step: 100400 Batch Loss: 1.059125 Tokens per Sec: 10625, Lr: 0.000103\n", "2020-01-18 11:43:04,574 Epoch 43 Step: 100500 Batch Loss: 1.234136 Tokens per Sec: 10847, Lr: 0.000103\n", "2020-01-18 11:43:24,689 Epoch 43 Step: 100600 Batch Loss: 1.173198 Tokens per Sec: 10903, Lr: 0.000103\n", "2020-01-18 11:43:44,805 Epoch 43 Step: 100700 Batch Loss: 0.952419 Tokens per Sec: 10793, Lr: 0.000103\n", "2020-01-18 11:44:04,906 Epoch 43 Step: 100800 Batch Loss: 0.729787 Tokens per Sec: 10833, Lr: 0.000103\n", "2020-01-18 11:44:24,453 Epoch 43: total training loss 2498.27\n", "2020-01-18 11:44:24,453 EPOCH 44\n", "2020-01-18 11:44:24,921 Epoch 44 Step: 100900 Batch Loss: 1.133126 Tokens per Sec: 5499, Lr: 0.000103\n", "2020-01-18 11:44:45,035 Epoch 44 Step: 101000 Batch Loss: 1.081898 Tokens per Sec: 10725, Lr: 0.000103\n", "2020-01-18 11:45:32,857 Example #0\n", "2020-01-18 11:45:32,858 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 11:45:32,858 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 11:45:32,859 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 11:45:32,859 Example #1\n", "2020-01-18 11:45:32,859 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 11:45:32,859 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 11:45:32,859 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 11:45:32,860 Example #2\n", "2020-01-18 11:45:32,860 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 11:45:32,860 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 11:45:32,860 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana nọ e rẹ sasa oma na : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] ọ jọ bẹdẹ ; re ọre na o te ru odẹ riẹ vihọ , re o jiri ai , re erẹwho kpobi e se odẹ riẹ ba ese .\n", "2020-01-18 11:45:32,860 Example #3\n", "2020-01-18 11:45:32,861 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 11:45:32,861 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 11:45:32,861 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 11:45:32,861 Validation result (greedy) at epoch 44, step 101000: bleu: 31.50, loss: 33830.5234, ppl: 4.3227, duration: 47.8258s\n", "2020-01-18 11:45:52,728 Epoch 44 Step: 101100 Batch Loss: 1.037739 Tokens per Sec: 10788, Lr: 0.000103\n", "2020-01-18 11:46:12,801 Epoch 44 Step: 101200 Batch Loss: 0.634840 Tokens per Sec: 10651, Lr: 0.000103\n", "2020-01-18 11:46:32,778 Epoch 44 Step: 101300 Batch Loss: 1.081751 Tokens per Sec: 10876, Lr: 0.000103\n", "2020-01-18 11:46:52,812 Epoch 44 Step: 101400 Batch Loss: 1.157617 Tokens per Sec: 10808, Lr: 0.000103\n", "2020-01-18 11:47:12,719 Epoch 44 Step: 101500 Batch Loss: 1.141384 Tokens per Sec: 10614, Lr: 0.000103\n", "2020-01-18 11:47:32,384 Epoch 44 Step: 101600 Batch Loss: 1.073669 Tokens per Sec: 10443, Lr: 0.000103\n", "2020-01-18 11:47:52,258 Epoch 44 Step: 101700 Batch Loss: 1.098019 Tokens per Sec: 10822, Lr: 0.000103\n", "2020-01-18 11:48:12,272 Epoch 44 Step: 101800 Batch Loss: 0.894957 Tokens per Sec: 11100, Lr: 0.000103\n", "2020-01-18 11:48:32,310 Epoch 44 Step: 101900 Batch Loss: 1.101905 Tokens per Sec: 10977, Lr: 0.000103\n", "2020-01-18 11:48:52,514 Epoch 44 Step: 102000 Batch Loss: 1.142413 Tokens per Sec: 11120, Lr: 0.000103\n", "2020-01-18 11:49:40,363 Example #0\n", "2020-01-18 11:49:40,364 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 11:49:40,364 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 11:49:40,364 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 11:49:40,365 Example #1\n", "2020-01-18 11:49:40,365 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 11:49:40,365 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 11:49:40,365 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 11:49:40,365 Example #2\n", "2020-01-18 11:49:40,366 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 11:49:40,366 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 11:49:40,366 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ fiba urru mai nọ u ti kuhọ evaọ abọ urere ọrọ ile iwoma nana , jẹ so ole oghọghọ : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] ọ jọ bẹdẹ ; re ọre na o te lo , re o jiri odẹ riẹ , re o jiri ai erẹwho akpọ na kpobi ; re o jiri ei .\n", "2020-01-18 11:49:40,366 Example #3\n", "2020-01-18 11:49:40,366 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 11:49:40,367 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 11:49:40,367 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 11:49:40,367 Validation result (greedy) at epoch 44, step 102000: bleu: 31.52, loss: 33714.8867, ppl: 4.3012, duration: 47.8520s\n", "2020-01-18 11:50:00,196 Epoch 44 Step: 102100 Batch Loss: 1.053956 Tokens per Sec: 10667, Lr: 0.000103\n", "2020-01-18 11:50:20,226 Epoch 44 Step: 102200 Batch Loss: 0.967176 Tokens per Sec: 10673, Lr: 0.000103\n", "2020-01-18 11:50:40,168 Epoch 44 Step: 102300 Batch Loss: 1.097513 Tokens per Sec: 10888, Lr: 0.000103\n", "2020-01-18 11:51:00,339 Epoch 44 Step: 102400 Batch Loss: 1.032703 Tokens per Sec: 10940, Lr: 0.000103\n", "2020-01-18 11:51:20,302 Epoch 44 Step: 102500 Batch Loss: 1.116388 Tokens per Sec: 10734, Lr: 0.000103\n", "2020-01-18 11:51:40,416 Epoch 44 Step: 102600 Batch Loss: 0.893503 Tokens per Sec: 10775, Lr: 0.000103\n", "2020-01-18 11:52:00,353 Epoch 44 Step: 102700 Batch Loss: 1.059242 Tokens per Sec: 10910, Lr: 0.000103\n", "2020-01-18 11:52:20,161 Epoch 44 Step: 102800 Batch Loss: 1.150721 Tokens per Sec: 10601, Lr: 0.000103\n", "2020-01-18 11:52:40,265 Epoch 44 Step: 102900 Batch Loss: 0.910394 Tokens per Sec: 10683, Lr: 0.000103\n", "2020-01-18 11:53:00,183 Epoch 44 Step: 103000 Batch Loss: 1.145876 Tokens per Sec: 10967, Lr: 0.000103\n", "2020-01-18 11:53:47,952 Hooray! New best validation result [ppl]!\n", "2020-01-18 11:53:47,953 Saving new checkpoint.\n", "2020-01-18 11:53:50,717 Example #0\n", "2020-01-18 11:53:50,718 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 11:53:50,718 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 11:53:50,718 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 11:53:50,719 Example #1\n", "2020-01-18 11:53:50,719 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 11:53:50,719 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 11:53:50,719 \tHypothesis: A rọ omobe - ovẹvẹ Usi Uvie na Ru onana , Ọrọ Avọ 2\n", "2020-01-18 11:53:50,719 Example #2\n", "2020-01-18 11:53:50,719 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 11:53:50,720 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 11:53:50,720 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te lo , re o jiri odẹ riẹ , re o jiri ai kpobi ; re erẹwho akpọ na kpobi e se odẹ riẹ .\n", "2020-01-18 11:53:50,720 Example #3\n", "2020-01-18 11:53:50,720 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 11:53:50,720 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 11:53:50,720 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re a ru udhedhẹ .\n", "2020-01-18 11:53:50,720 Validation result (greedy) at epoch 44, step 103000: bleu: 31.30, loss: 33634.5391, ppl: 4.2862, duration: 50.5364s\n", "2020-01-18 11:54:10,898 Epoch 44 Step: 103100 Batch Loss: 1.137791 Tokens per Sec: 10569, Lr: 0.000103\n", "2020-01-18 11:54:30,770 Epoch 44 Step: 103200 Batch Loss: 0.835921 Tokens per Sec: 10584, Lr: 0.000103\n", "2020-01-18 11:54:38,497 Epoch 44: total training loss 2490.25\n", "2020-01-18 11:54:38,497 EPOCH 45\n", "2020-01-18 11:54:50,973 Epoch 45 Step: 103300 Batch Loss: 1.084792 Tokens per Sec: 10856, Lr: 0.000103\n", "2020-01-18 11:55:11,063 Epoch 45 Step: 103400 Batch Loss: 1.132009 Tokens per Sec: 10850, Lr: 0.000103\n", "2020-01-18 11:55:31,063 Epoch 45 Step: 103500 Batch Loss: 1.184525 Tokens per Sec: 10780, Lr: 0.000103\n", "2020-01-18 11:55:50,646 Epoch 45 Step: 103600 Batch Loss: 1.235305 Tokens per Sec: 10580, Lr: 0.000103\n", "2020-01-18 11:56:10,598 Epoch 45 Step: 103700 Batch Loss: 1.070016 Tokens per Sec: 10695, Lr: 0.000103\n", "2020-01-18 11:56:30,607 Epoch 45 Step: 103800 Batch Loss: 1.130185 Tokens per Sec: 10907, Lr: 0.000103\n", "2020-01-18 11:56:50,653 Epoch 45 Step: 103900 Batch Loss: 1.091395 Tokens per Sec: 10734, Lr: 0.000103\n", "2020-01-18 11:57:10,658 Epoch 45 Step: 104000 Batch Loss: 1.117800 Tokens per Sec: 10687, Lr: 0.000103\n", "2020-01-18 11:57:58,537 Example #0\n", "2020-01-18 11:57:58,538 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 11:57:58,538 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 11:57:58,538 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 11:57:58,539 Example #1\n", "2020-01-18 11:57:58,539 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 11:57:58,539 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 11:57:58,539 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 11:57:58,539 Example #2\n", "2020-01-18 11:57:58,540 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 11:57:58,540 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 11:57:58,540 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere nana nọ o vọ avọ erru na : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te ru odẹ riẹ vihọ , re o jiri ai , re erẹwho kpobi e se odẹ riẹ ba ese .\n", "2020-01-18 11:57:58,540 Example #3\n", "2020-01-18 11:57:58,541 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 11:57:58,541 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 11:57:58,541 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 11:57:58,541 Validation result (greedy) at epoch 45, step 104000: bleu: 31.48, loss: 33786.3594, ppl: 4.3145, duration: 47.8830s\n", "2020-01-18 11:58:18,321 Epoch 45 Step: 104100 Batch Loss: 0.962955 Tokens per Sec: 10633, Lr: 0.000103\n", "2020-01-18 11:58:38,319 Epoch 45 Step: 104200 Batch Loss: 1.134138 Tokens per Sec: 10778, Lr: 0.000103\n", "2020-01-18 11:58:58,338 Epoch 45 Step: 104300 Batch Loss: 0.943199 Tokens per Sec: 10809, Lr: 0.000103\n", "2020-01-18 11:59:18,249 Epoch 45 Step: 104400 Batch Loss: 1.116186 Tokens per Sec: 10599, Lr: 0.000103\n", "2020-01-18 11:59:38,387 Epoch 45 Step: 104500 Batch Loss: 1.114061 Tokens per Sec: 10868, Lr: 0.000103\n", "2020-01-18 11:59:58,456 Epoch 45 Step: 104600 Batch Loss: 1.161676 Tokens per Sec: 11015, Lr: 0.000103\n", "2020-01-18 12:00:18,476 Epoch 45 Step: 104700 Batch Loss: 1.077554 Tokens per Sec: 10899, Lr: 0.000103\n", "2020-01-18 12:00:38,251 Epoch 45 Step: 104800 Batch Loss: 1.198071 Tokens per Sec: 10394, Lr: 0.000103\n", "2020-01-18 12:00:58,232 Epoch 45 Step: 104900 Batch Loss: 1.069010 Tokens per Sec: 10920, Lr: 0.000103\n", "2020-01-18 12:01:18,378 Epoch 45 Step: 105000 Batch Loss: 1.224239 Tokens per Sec: 10635, Lr: 0.000103\n", "2020-01-18 12:02:06,171 Example #0\n", "2020-01-18 12:02:06,172 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 12:02:06,173 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 12:02:06,173 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 12:02:06,173 Example #1\n", "2020-01-18 12:02:06,173 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 12:02:06,173 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 12:02:06,174 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 12:02:06,174 Example #2\n", "2020-01-18 12:02:06,174 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 12:02:06,174 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 12:02:06,174 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ ku irru mai nọ i ti kuhọ evaọ abọ urere nana nọ o vọ avọ oghọghọ na : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi e jiri ei .\n", "2020-01-18 12:02:06,174 Example #3\n", "2020-01-18 12:02:06,175 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 12:02:06,175 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 12:02:06,175 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 12:02:06,175 Validation result (greedy) at epoch 45, step 105000: bleu: 31.31, loss: 33814.8242, ppl: 4.3198, duration: 47.7969s\n", "2020-01-18 12:02:26,262 Epoch 45 Step: 105100 Batch Loss: 1.067153 Tokens per Sec: 10772, Lr: 0.000103\n", "2020-01-18 12:02:46,190 Epoch 45 Step: 105200 Batch Loss: 1.009154 Tokens per Sec: 10716, Lr: 0.000103\n", "2020-01-18 12:03:06,066 Epoch 45 Step: 105300 Batch Loss: 1.158455 Tokens per Sec: 10886, Lr: 0.000103\n", "2020-01-18 12:03:25,885 Epoch 45 Step: 105400 Batch Loss: 0.778364 Tokens per Sec: 10769, Lr: 0.000103\n", "2020-01-18 12:03:45,919 Epoch 45 Step: 105500 Batch Loss: 1.005289 Tokens per Sec: 10844, Lr: 0.000103\n", "2020-01-18 12:04:02,334 Epoch 45: total training loss 2485.78\n", "2020-01-18 12:04:02,334 EPOCH 46\n", "2020-01-18 12:04:06,005 Epoch 46 Step: 105600 Batch Loss: 1.023279 Tokens per Sec: 10221, Lr: 0.000103\n", "2020-01-18 12:04:26,111 Epoch 46 Step: 105700 Batch Loss: 1.173248 Tokens per Sec: 10916, Lr: 0.000103\n", "2020-01-18 12:04:45,891 Epoch 46 Step: 105800 Batch Loss: 1.105584 Tokens per Sec: 10580, Lr: 0.000103\n", "2020-01-18 12:05:05,702 Epoch 46 Step: 105900 Batch Loss: 0.987628 Tokens per Sec: 10722, Lr: 0.000103\n", "2020-01-18 12:05:25,540 Epoch 46 Step: 106000 Batch Loss: 1.164427 Tokens per Sec: 10685, Lr: 0.000103\n", "2020-01-18 12:06:13,340 Example #0\n", "2020-01-18 12:06:13,342 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 12:06:13,342 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 12:06:13,342 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 12:06:13,342 Example #1\n", "2020-01-18 12:06:13,342 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 12:06:13,342 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 12:06:13,343 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 12:06:13,343 Example #2\n", "2020-01-18 12:06:13,343 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 12:06:13,343 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 12:06:13,343 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ ku irru mai họ so ole owoma nana jẹ be kẹ uyere : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi i jiri ei .\n", "2020-01-18 12:06:13,344 Example #3\n", "2020-01-18 12:06:13,344 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 12:06:13,344 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 12:06:13,344 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re a ru udhedhẹ .\n", "2020-01-18 12:06:13,344 Validation result (greedy) at epoch 46, step 106000: bleu: 31.45, loss: 33877.2305, ppl: 4.3315, duration: 47.8039s\n", "2020-01-18 12:06:33,072 Epoch 46 Step: 106100 Batch Loss: 0.991506 Tokens per Sec: 10894, Lr: 0.000103\n", "2020-01-18 12:06:53,237 Epoch 46 Step: 106200 Batch Loss: 1.119098 Tokens per Sec: 10659, Lr: 0.000103\n", "2020-01-18 12:07:13,066 Epoch 46 Step: 106300 Batch Loss: 1.050335 Tokens per Sec: 10611, Lr: 0.000103\n", "2020-01-18 12:07:32,954 Epoch 46 Step: 106400 Batch Loss: 1.096332 Tokens per Sec: 10772, Lr: 0.000103\n", "2020-01-18 12:07:53,027 Epoch 46 Step: 106500 Batch Loss: 1.120354 Tokens per Sec: 10628, Lr: 0.000103\n", "2020-01-18 12:08:12,987 Epoch 46 Step: 106600 Batch Loss: 0.603409 Tokens per Sec: 10548, Lr: 0.000103\n", "2020-01-18 12:08:32,971 Epoch 46 Step: 106700 Batch Loss: 1.068686 Tokens per Sec: 10863, Lr: 0.000103\n", "2020-01-18 12:08:52,920 Epoch 46 Step: 106800 Batch Loss: 0.998678 Tokens per Sec: 10734, Lr: 0.000103\n", "2020-01-18 12:09:12,912 Epoch 46 Step: 106900 Batch Loss: 0.785680 Tokens per Sec: 10717, Lr: 0.000103\n", "2020-01-18 12:09:32,880 Epoch 46 Step: 107000 Batch Loss: 0.980047 Tokens per Sec: 10767, Lr: 0.000103\n", "2020-01-18 12:10:20,708 Example #0\n", "2020-01-18 12:10:20,709 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 12:10:20,710 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 12:10:20,710 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 12:10:20,710 Example #1\n", "2020-01-18 12:10:20,710 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 12:10:20,710 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 12:10:20,711 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 12:10:20,711 Example #2\n", "2020-01-18 12:10:20,711 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 12:10:20,711 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 12:10:20,711 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai re ma so ole owoma nana : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; re ọre na o te lo , re o jiri odẹ riẹ , re o jiri ai kpobi ; jọ erẹwho na kpobi i jiri ei .\n", "2020-01-18 12:10:20,712 Example #3\n", "2020-01-18 12:10:20,712 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 12:10:20,712 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 12:10:20,712 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 12:10:20,712 Validation result (greedy) at epoch 46, step 107000: bleu: 31.86, loss: 33786.7891, ppl: 4.3146, duration: 47.8322s\n", "2020-01-18 12:10:40,793 Epoch 46 Step: 107100 Batch Loss: 1.126961 Tokens per Sec: 10832, Lr: 0.000103\n", "2020-01-18 12:11:00,600 Epoch 46 Step: 107200 Batch Loss: 0.995256 Tokens per Sec: 10713, Lr: 0.000103\n", "2020-01-18 12:11:20,480 Epoch 46 Step: 107300 Batch Loss: 1.056509 Tokens per Sec: 10497, Lr: 0.000103\n", "2020-01-18 12:11:40,378 Epoch 46 Step: 107400 Batch Loss: 1.043885 Tokens per Sec: 10720, Lr: 0.000103\n", "2020-01-18 12:12:00,384 Epoch 46 Step: 107500 Batch Loss: 1.104076 Tokens per Sec: 10650, Lr: 0.000103\n", "2020-01-18 12:12:20,361 Epoch 46 Step: 107600 Batch Loss: 1.014481 Tokens per Sec: 10824, Lr: 0.000103\n", "2020-01-18 12:12:40,306 Epoch 46 Step: 107700 Batch Loss: 1.055832 Tokens per Sec: 10877, Lr: 0.000103\n", "2020-01-18 12:13:00,249 Epoch 46 Step: 107800 Batch Loss: 1.081220 Tokens per Sec: 10848, Lr: 0.000103\n", "2020-01-18 12:13:20,117 Epoch 46 Step: 107900 Batch Loss: 0.673109 Tokens per Sec: 10719, Lr: 0.000103\n", "2020-01-18 12:13:27,615 Epoch 46: total training loss 2489.80\n", "2020-01-18 12:13:27,615 EPOCH 47\n", "2020-01-18 12:13:40,119 Epoch 47 Step: 108000 Batch Loss: 0.929107 Tokens per Sec: 10277, Lr: 0.000103\n", "2020-01-18 12:14:27,964 Example #0\n", "2020-01-18 12:14:27,972 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 12:14:27,972 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 12:14:27,972 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 12:14:27,972 Example #1\n", "2020-01-18 12:14:27,972 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 12:14:27,972 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 12:14:27,972 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 12:14:27,973 Example #2\n", "2020-01-18 12:14:27,973 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 12:14:27,973 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 12:14:27,973 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana nọ e rẹ sasa oma na : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te lo , re odẹ riẹ o vihọ , re o jiri ai kpobi ; jọ erẹwho akpọ na kpobi a jiri ei .\n", "2020-01-18 12:14:27,973 Example #3\n", "2020-01-18 12:14:27,973 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 12:14:27,973 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 12:14:27,974 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 12:14:27,974 Validation result (greedy) at epoch 47, step 108000: bleu: 31.45, loss: 33649.1641, ppl: 4.2890, duration: 47.8545s\n", "2020-01-18 12:14:47,932 Epoch 47 Step: 108100 Batch Loss: 0.890810 Tokens per Sec: 10869, Lr: 0.000103\n", "2020-01-18 12:15:08,006 Epoch 47 Step: 108200 Batch Loss: 1.019992 Tokens per Sec: 10916, Lr: 0.000103\n", "2020-01-18 12:15:27,933 Epoch 47 Step: 108300 Batch Loss: 1.139732 Tokens per Sec: 10630, Lr: 0.000103\n", "2020-01-18 12:15:47,796 Epoch 47 Step: 108400 Batch Loss: 0.984350 Tokens per Sec: 10726, Lr: 0.000103\n", "2020-01-18 12:16:07,838 Epoch 47 Step: 108500 Batch Loss: 1.161309 Tokens per Sec: 10856, Lr: 0.000103\n", "2020-01-18 12:16:27,727 Epoch 47 Step: 108600 Batch Loss: 1.086685 Tokens per Sec: 10711, Lr: 0.000103\n", "2020-01-18 12:16:47,826 Epoch 47 Step: 108700 Batch Loss: 0.963864 Tokens per Sec: 10931, Lr: 0.000103\n", "2020-01-18 12:17:07,913 Epoch 47 Step: 108800 Batch Loss: 0.945920 Tokens per Sec: 10698, Lr: 0.000103\n", "2020-01-18 12:17:27,921 Epoch 47 Step: 108900 Batch Loss: 1.109606 Tokens per Sec: 10720, Lr: 0.000103\n", "2020-01-18 12:17:47,764 Epoch 47 Step: 109000 Batch Loss: 1.063504 Tokens per Sec: 10766, Lr: 0.000103\n", "2020-01-18 12:18:35,688 Example #0\n", "2020-01-18 12:18:35,689 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 12:18:35,689 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 12:18:35,689 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 12:18:35,689 Example #1\n", "2020-01-18 12:18:35,689 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 12:18:35,690 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 12:18:35,690 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 12:18:35,690 Example #2\n", "2020-01-18 12:18:35,690 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 12:18:35,690 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 12:18:35,690 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba urru mai nọ ma te ku ole owoma nana họ jẹ so ole omosasọ nana : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; re ọre na o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi e jiri ei .\n", "2020-01-18 12:18:35,691 Example #3\n", "2020-01-18 12:18:35,691 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 12:18:35,691 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 12:18:35,691 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 12:18:35,691 Validation result (greedy) at epoch 47, step 109000: bleu: 31.95, loss: 33897.3672, ppl: 4.3353, duration: 47.9265s\n", "2020-01-18 12:18:55,820 Epoch 47 Step: 109100 Batch Loss: 1.060317 Tokens per Sec: 10794, Lr: 0.000072\n", "2020-01-18 12:19:15,849 Epoch 47 Step: 109200 Batch Loss: 1.091775 Tokens per Sec: 10957, Lr: 0.000072\n", "2020-01-18 12:19:35,851 Epoch 47 Step: 109300 Batch Loss: 1.183132 Tokens per Sec: 10771, Lr: 0.000072\n", "2020-01-18 12:19:55,609 Epoch 47 Step: 109400 Batch Loss: 1.127645 Tokens per Sec: 10406, Lr: 0.000072\n", "2020-01-18 12:20:15,539 Epoch 47 Step: 109500 Batch Loss: 1.157509 Tokens per Sec: 10692, Lr: 0.000072\n", "2020-01-18 12:20:35,610 Epoch 47 Step: 109600 Batch Loss: 1.120718 Tokens per Sec: 10767, Lr: 0.000072\n", "2020-01-18 12:20:55,325 Epoch 47 Step: 109700 Batch Loss: 0.744496 Tokens per Sec: 10356, Lr: 0.000072\n", "2020-01-18 12:21:15,476 Epoch 47 Step: 109800 Batch Loss: 1.070052 Tokens per Sec: 10397, Lr: 0.000072\n", "2020-01-18 12:21:35,562 Epoch 47 Step: 109900 Batch Loss: 1.199589 Tokens per Sec: 11001, Lr: 0.000072\n", "2020-01-18 12:21:55,727 Epoch 47 Step: 110000 Batch Loss: 1.152292 Tokens per Sec: 10976, Lr: 0.000072\n", "2020-01-18 12:22:43,544 Example #0\n", "2020-01-18 12:22:43,545 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 12:22:43,546 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 12:22:43,546 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 12:22:43,546 Example #1\n", "2020-01-18 12:22:43,546 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 12:22:43,546 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 12:22:43,547 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 12:22:43,547 Example #2\n", "2020-01-18 12:22:43,547 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 12:22:43,547 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 12:22:43,547 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ fiba irru mai nọ i bi kuhọ evaọ abọ urere ọrọ ile iwoma nana jẹ be kẹ omosasọ : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te lo , re odẹ riẹ u vihọ , re o jiri ai ; jọ erẹwho kpobi e jiri ei .\n", "2020-01-18 12:22:43,548 Example #3\n", "2020-01-18 12:22:43,548 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 12:22:43,548 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 12:22:43,548 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 12:22:43,549 Validation result (greedy) at epoch 47, step 110000: bleu: 31.70, loss: 33739.9609, ppl: 4.3058, duration: 47.8216s\n", "2020-01-18 12:23:03,618 Epoch 47 Step: 110100 Batch Loss: 1.194717 Tokens per Sec: 10561, Lr: 0.000072\n", "2020-01-18 12:23:23,572 Epoch 47 Step: 110200 Batch Loss: 1.163796 Tokens per Sec: 10476, Lr: 0.000072\n", "2020-01-18 12:23:41,130 Epoch 47: total training loss 2469.24\n", "2020-01-18 12:23:41,130 EPOCH 48\n", "2020-01-18 12:23:43,842 Epoch 48 Step: 110300 Batch Loss: 0.928956 Tokens per Sec: 10468, Lr: 0.000072\n", "2020-01-18 12:24:03,796 Epoch 48 Step: 110400 Batch Loss: 1.045024 Tokens per Sec: 10874, Lr: 0.000072\n", "2020-01-18 12:24:23,644 Epoch 48 Step: 110500 Batch Loss: 0.826039 Tokens per Sec: 10579, Lr: 0.000072\n", "2020-01-18 12:24:43,556 Epoch 48 Step: 110600 Batch Loss: 1.118353 Tokens per Sec: 10630, Lr: 0.000072\n", "2020-01-18 12:25:03,553 Epoch 48 Step: 110700 Batch Loss: 1.112943 Tokens per Sec: 10733, Lr: 0.000072\n", "2020-01-18 12:25:23,652 Epoch 48 Step: 110800 Batch Loss: 1.061205 Tokens per Sec: 10880, Lr: 0.000072\n", "2020-01-18 12:25:43,709 Epoch 48 Step: 110900 Batch Loss: 0.967654 Tokens per Sec: 10727, Lr: 0.000072\n", "2020-01-18 12:26:03,746 Epoch 48 Step: 111000 Batch Loss: 1.108371 Tokens per Sec: 10849, Lr: 0.000072\n", "2020-01-18 12:26:51,605 Example #0\n", "2020-01-18 12:26:51,606 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 12:26:51,606 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 12:26:51,607 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 12:26:51,607 Example #1\n", "2020-01-18 12:26:51,607 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 12:26:51,607 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 12:26:51,607 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 12:26:51,608 Example #2\n", "2020-01-18 12:26:51,608 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 12:26:51,608 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 12:26:51,608 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai re ma ku ole owoma nana họ : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te lo , re odẹ riẹ o vihọ , re o jiri ai , re erẹwho kpobi e jiri ei .\n", "2020-01-18 12:26:51,608 Example #3\n", "2020-01-18 12:26:51,609 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 12:26:51,609 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 12:26:51,609 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re a ru udhedhẹ .\n", "2020-01-18 12:26:51,609 Validation result (greedy) at epoch 48, step 111000: bleu: 31.78, loss: 33821.2188, ppl: 4.3210, duration: 47.8630s\n", "2020-01-18 12:27:11,564 Epoch 48 Step: 111100 Batch Loss: 1.086829 Tokens per Sec: 10527, Lr: 0.000072\n", "2020-01-18 12:27:31,721 Epoch 48 Step: 111200 Batch Loss: 0.770000 Tokens per Sec: 10763, Lr: 0.000072\n", "2020-01-18 12:27:51,672 Epoch 48 Step: 111300 Batch Loss: 1.016832 Tokens per Sec: 10912, Lr: 0.000072\n", "2020-01-18 12:28:11,585 Epoch 48 Step: 111400 Batch Loss: 0.918907 Tokens per Sec: 10733, Lr: 0.000072\n", "2020-01-18 12:28:31,603 Epoch 48 Step: 111500 Batch Loss: 1.024668 Tokens per Sec: 10626, Lr: 0.000072\n", "2020-01-18 12:28:51,687 Epoch 48 Step: 111600 Batch Loss: 0.880533 Tokens per Sec: 10986, Lr: 0.000072\n", "2020-01-18 12:29:11,698 Epoch 48 Step: 111700 Batch Loss: 1.092942 Tokens per Sec: 10863, Lr: 0.000072\n", "2020-01-18 12:29:31,770 Epoch 48 Step: 111800 Batch Loss: 1.138252 Tokens per Sec: 10782, Lr: 0.000072\n", "2020-01-18 12:29:51,558 Epoch 48 Step: 111900 Batch Loss: 1.115647 Tokens per Sec: 10722, Lr: 0.000072\n", "2020-01-18 12:30:11,535 Epoch 48 Step: 112000 Batch Loss: 1.101999 Tokens per Sec: 10663, Lr: 0.000072\n", "2020-01-18 12:30:59,344 Example #0\n", "2020-01-18 12:30:59,345 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 12:30:59,346 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 12:30:59,346 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 12:30:59,346 Example #1\n", "2020-01-18 12:30:59,346 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 12:30:59,346 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 12:30:59,347 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 12:30:59,347 Example #2\n", "2020-01-18 12:30:59,347 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 12:30:59,347 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 12:30:59,347 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; re ọre na o te ru odẹ riẹ vihọ , re o jiri ai , re erẹwho kpobi i jiri ei .\n", "2020-01-18 12:30:59,347 Example #3\n", "2020-01-18 12:30:59,348 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 12:30:59,348 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 12:30:59,348 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 12:30:59,348 Validation result (greedy) at epoch 48, step 112000: bleu: 31.45, loss: 33771.8008, ppl: 4.3118, duration: 47.8120s\n", "2020-01-18 12:31:19,321 Epoch 48 Step: 112100 Batch Loss: 1.106712 Tokens per Sec: 10798, Lr: 0.000072\n", "2020-01-18 12:31:39,068 Epoch 48 Step: 112200 Batch Loss: 1.092489 Tokens per Sec: 10678, Lr: 0.000072\n", "2020-01-18 12:31:59,003 Epoch 48 Step: 112300 Batch Loss: 1.048662 Tokens per Sec: 10650, Lr: 0.000072\n", "2020-01-18 12:32:19,029 Epoch 48 Step: 112400 Batch Loss: 0.857899 Tokens per Sec: 10837, Lr: 0.000072\n", "2020-01-18 12:32:38,861 Epoch 48 Step: 112500 Batch Loss: 1.080371 Tokens per Sec: 10673, Lr: 0.000072\n", "2020-01-18 12:32:58,734 Epoch 48 Step: 112600 Batch Loss: 1.014937 Tokens per Sec: 10758, Lr: 0.000072\n", "2020-01-18 12:33:05,856 Epoch 48: total training loss 2445.27\n", "2020-01-18 12:33:05,857 EPOCH 49\n", "2020-01-18 12:33:18,835 Epoch 49 Step: 112700 Batch Loss: 0.831030 Tokens per Sec: 10332, Lr: 0.000072\n", "2020-01-18 12:33:38,875 Epoch 49 Step: 112800 Batch Loss: 1.034329 Tokens per Sec: 10699, Lr: 0.000072\n", "2020-01-18 12:33:58,810 Epoch 49 Step: 112900 Batch Loss: 1.107123 Tokens per Sec: 10937, Lr: 0.000072\n", "2020-01-18 12:34:18,800 Epoch 49 Step: 113000 Batch Loss: 1.172109 Tokens per Sec: 10764, Lr: 0.000072\n", "2020-01-18 12:35:06,665 Example #0\n", "2020-01-18 12:35:06,667 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 12:35:06,667 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 12:35:06,667 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 12:35:06,668 Example #1\n", "2020-01-18 12:35:06,669 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 12:35:06,669 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 12:35:06,669 \tHypothesis: A rọ omobe - ovẹvẹ Usi Uvie na avọ Ọrọ Avọ 4\n", "2020-01-18 12:35:06,670 Example #2\n", "2020-01-18 12:35:06,670 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 12:35:06,670 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 12:35:06,670 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana : “ Jọ odẹ riẹ [ koyehọ Jesu Kristi Ovie na ] o jọ bẹdẹ bẹdẹ ; re ọre na o te lo , re odẹ riẹ o vihọ , re o jiri ai ; re erẹwho kpobi e jiri ei .\n", "2020-01-18 12:35:06,671 Example #3\n", "2020-01-18 12:35:06,671 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 12:35:06,671 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 12:35:06,672 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 12:35:06,672 Validation result (greedy) at epoch 49, step 113000: bleu: 31.51, loss: 33816.5508, ppl: 4.3201, duration: 47.8710s\n", "2020-01-18 12:35:26,735 Epoch 49 Step: 113100 Batch Loss: 0.957927 Tokens per Sec: 10955, Lr: 0.000072\n", "2020-01-18 12:35:46,622 Epoch 49 Step: 113200 Batch Loss: 0.940091 Tokens per Sec: 10817, Lr: 0.000072\n", "2020-01-18 12:36:06,415 Epoch 49 Step: 113300 Batch Loss: 1.207324 Tokens per Sec: 10889, Lr: 0.000072\n", "2020-01-18 12:36:26,368 Epoch 49 Step: 113400 Batch Loss: 1.036475 Tokens per Sec: 10693, Lr: 0.000072\n", "2020-01-18 12:36:46,393 Epoch 49 Step: 113500 Batch Loss: 1.226426 Tokens per Sec: 10693, Lr: 0.000072\n", "2020-01-18 12:37:06,210 Epoch 49 Step: 113600 Batch Loss: 0.902892 Tokens per Sec: 10666, Lr: 0.000072\n", "2020-01-18 12:37:26,128 Epoch 49 Step: 113700 Batch Loss: 1.003294 Tokens per Sec: 11004, Lr: 0.000072\n", "2020-01-18 12:37:46,095 Epoch 49 Step: 113800 Batch Loss: 0.920018 Tokens per Sec: 10713, Lr: 0.000072\n", "2020-01-18 12:38:06,026 Epoch 49 Step: 113900 Batch Loss: 1.117861 Tokens per Sec: 10915, Lr: 0.000072\n", "2020-01-18 12:38:25,776 Epoch 49 Step: 114000 Batch Loss: 1.037018 Tokens per Sec: 10567, Lr: 0.000072\n", "2020-01-18 12:39:13,611 Example #0\n", "2020-01-18 12:39:13,612 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 12:39:13,613 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 12:39:13,613 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 12:39:13,613 Example #1\n", "2020-01-18 12:39:13,613 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 12:39:13,613 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 12:39:13,613 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 12:39:13,614 Example #2\n", "2020-01-18 12:39:13,614 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 12:39:13,614 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 12:39:13,614 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o lo , re odẹ riẹ o vihọ , re o jiri ai kpobi ; jọ erẹwho kpobi e jiri ei .\n", "2020-01-18 12:39:13,614 Example #3\n", "2020-01-18 12:39:13,615 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 12:39:13,615 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 12:39:13,615 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 12:39:13,615 Validation result (greedy) at epoch 49, step 114000: bleu: 31.77, loss: 33820.0625, ppl: 4.3208, duration: 47.8383s\n", "2020-01-18 12:39:33,458 Epoch 49 Step: 114100 Batch Loss: 1.135133 Tokens per Sec: 10649, Lr: 0.000072\n", "2020-01-18 12:39:53,253 Epoch 49 Step: 114200 Batch Loss: 1.146271 Tokens per Sec: 10590, Lr: 0.000072\n", "2020-01-18 12:40:13,276 Epoch 49 Step: 114300 Batch Loss: 0.909317 Tokens per Sec: 10636, Lr: 0.000072\n", "2020-01-18 12:40:33,302 Epoch 49 Step: 114400 Batch Loss: 1.005698 Tokens per Sec: 10918, Lr: 0.000072\n", "2020-01-18 12:40:53,319 Epoch 49 Step: 114500 Batch Loss: 1.099415 Tokens per Sec: 10696, Lr: 0.000072\n", "2020-01-18 12:41:13,391 Epoch 49 Step: 114600 Batch Loss: 0.806298 Tokens per Sec: 10917, Lr: 0.000072\n", "2020-01-18 12:41:33,361 Epoch 49 Step: 114700 Batch Loss: 0.937560 Tokens per Sec: 10663, Lr: 0.000072\n", "2020-01-18 12:41:53,338 Epoch 49 Step: 114800 Batch Loss: 1.176744 Tokens per Sec: 10851, Lr: 0.000072\n", "2020-01-18 12:42:13,463 Epoch 49 Step: 114900 Batch Loss: 1.077931 Tokens per Sec: 10843, Lr: 0.000072\n", "2020-01-18 12:42:30,029 Epoch 49: total training loss 2439.31\n", "2020-01-18 12:42:30,030 EPOCH 50\n", "2020-01-18 12:42:33,592 Epoch 50 Step: 115000 Batch Loss: 1.026464 Tokens per Sec: 10414, Lr: 0.000072\n", "2020-01-18 12:43:21,562 Example #0\n", "2020-01-18 12:43:21,563 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 12:43:21,563 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 12:43:21,564 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 12:43:21,564 Example #1\n", "2020-01-18 12:43:21,564 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 12:43:21,564 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 12:43:21,564 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 12:43:21,565 Example #2\n", "2020-01-18 12:43:21,565 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 12:43:21,565 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 12:43:21,565 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba irru mai ro ku ole owoma nana họ : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; re ọre na o te ru odẹ riẹ vihọ , re o jiri ai , re o jiri ai kpobi ; re erẹwho akpọ na kpobi e jiri ei .\n", "2020-01-18 12:43:21,565 Example #3\n", "2020-01-18 12:43:21,566 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 12:43:21,566 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 12:43:21,566 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 12:43:21,566 Validation result (greedy) at epoch 50, step 115000: bleu: 31.78, loss: 33676.3359, ppl: 4.2940, duration: 47.9736s\n", "2020-01-18 12:43:41,484 Epoch 50 Step: 115100 Batch Loss: 1.047871 Tokens per Sec: 10656, Lr: 0.000050\n", "2020-01-18 12:44:01,557 Epoch 50 Step: 115200 Batch Loss: 0.883588 Tokens per Sec: 10570, Lr: 0.000050\n", "2020-01-18 12:44:21,389 Epoch 50 Step: 115300 Batch Loss: 1.121404 Tokens per Sec: 11055, Lr: 0.000050\n", "2020-01-18 12:44:41,257 Epoch 50 Step: 115400 Batch Loss: 1.097440 Tokens per Sec: 10871, Lr: 0.000050\n", "2020-01-18 12:45:01,248 Epoch 50 Step: 115500 Batch Loss: 1.029406 Tokens per Sec: 10794, Lr: 0.000050\n", "2020-01-18 12:45:21,426 Epoch 50 Step: 115600 Batch Loss: 1.117416 Tokens per Sec: 11053, Lr: 0.000050\n", "2020-01-18 12:45:41,423 Epoch 50 Step: 115700 Batch Loss: 1.112529 Tokens per Sec: 10639, Lr: 0.000050\n", "2020-01-18 12:46:01,267 Epoch 50 Step: 115800 Batch Loss: 1.024478 Tokens per Sec: 10680, Lr: 0.000050\n", "2020-01-18 12:46:21,352 Epoch 50 Step: 115900 Batch Loss: 1.207092 Tokens per Sec: 10742, Lr: 0.000050\n", "2020-01-18 12:46:41,478 Epoch 50 Step: 116000 Batch Loss: 0.763581 Tokens per Sec: 10874, Lr: 0.000050\n", "2020-01-18 12:47:29,327 Example #0\n", "2020-01-18 12:47:29,328 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 12:47:29,328 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 12:47:29,329 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 12:47:29,329 Example #1\n", "2020-01-18 12:47:29,329 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 12:47:29,329 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 12:47:29,329 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 12:47:29,329 Example #2\n", "2020-01-18 12:47:29,330 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 12:47:29,330 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 12:47:29,330 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi i jiri ei .\n", "2020-01-18 12:47:29,330 Example #3\n", "2020-01-18 12:47:29,331 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 12:47:29,331 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 12:47:29,331 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 12:47:29,331 Validation result (greedy) at epoch 50, step 116000: bleu: 31.85, loss: 33737.4844, ppl: 4.3054, duration: 47.8524s\n", "2020-01-18 12:47:49,098 Epoch 50 Step: 116100 Batch Loss: 1.154511 Tokens per Sec: 10571, Lr: 0.000050\n", "2020-01-18 12:48:09,149 Epoch 50 Step: 116200 Batch Loss: 0.950174 Tokens per Sec: 10858, Lr: 0.000050\n", "2020-01-18 12:48:29,105 Epoch 50 Step: 116300 Batch Loss: 1.152626 Tokens per Sec: 10625, Lr: 0.000050\n", "2020-01-18 12:48:49,168 Epoch 50 Step: 116400 Batch Loss: 1.167003 Tokens per Sec: 10817, Lr: 0.000050\n", "2020-01-18 12:49:09,252 Epoch 50 Step: 116500 Batch Loss: 1.035944 Tokens per Sec: 10506, Lr: 0.000050\n", "2020-01-18 12:49:29,343 Epoch 50 Step: 116600 Batch Loss: 1.022356 Tokens per Sec: 10814, Lr: 0.000050\n", "2020-01-18 12:49:49,268 Epoch 50 Step: 116700 Batch Loss: 1.096117 Tokens per Sec: 10703, Lr: 0.000050\n", "2020-01-18 12:50:09,303 Epoch 50 Step: 116800 Batch Loss: 0.852470 Tokens per Sec: 10770, Lr: 0.000050\n", "2020-01-18 12:50:29,194 Epoch 50 Step: 116900 Batch Loss: 1.061097 Tokens per Sec: 10757, Lr: 0.000050\n", "2020-01-18 12:50:49,272 Epoch 50 Step: 117000 Batch Loss: 0.985816 Tokens per Sec: 10708, Lr: 0.000050\n", "2020-01-18 12:51:37,203 Example #0\n", "2020-01-18 12:51:37,203 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 12:51:37,203 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 12:51:37,203 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 12:51:37,203 Example #1\n", "2020-01-18 12:51:37,203 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 12:51:37,203 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 12:51:37,204 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 12:51:37,204 Example #2\n", "2020-01-18 12:51:37,204 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 12:51:37,204 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 12:51:37,204 \tHypothesis: Koyehọ , mai kpobi ma te rehọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana : “ Jọ odẹ riẹ [ ọrọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai ; re erẹwho kpobi e jiri ei .\n", "2020-01-18 12:51:37,204 Example #3\n", "2020-01-18 12:51:37,204 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 12:51:37,204 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 12:51:37,204 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 12:51:37,204 Validation result (greedy) at epoch 50, step 117000: bleu: 31.83, loss: 33689.5820, ppl: 4.2965, duration: 47.9317s\n", "2020-01-18 12:51:57,146 Epoch 50 Step: 117100 Batch Loss: 1.022352 Tokens per Sec: 10617, Lr: 0.000050\n", "2020-01-18 12:52:17,068 Epoch 50 Step: 117200 Batch Loss: 0.508203 Tokens per Sec: 10892, Lr: 0.000050\n", "2020-01-18 12:52:37,026 Epoch 50 Step: 117300 Batch Loss: 1.163040 Tokens per Sec: 10753, Lr: 0.000050\n", "2020-01-18 12:52:42,244 Epoch 50: total training loss 2413.13\n", "2020-01-18 12:52:42,244 EPOCH 51\n", "2020-01-18 12:52:57,324 Epoch 51 Step: 117400 Batch Loss: 0.946308 Tokens per Sec: 10839, Lr: 0.000050\n", "2020-01-18 12:53:17,339 Epoch 51 Step: 117500 Batch Loss: 0.980967 Tokens per Sec: 10751, Lr: 0.000050\n", "2020-01-18 12:53:37,224 Epoch 51 Step: 117600 Batch Loss: 1.153355 Tokens per Sec: 10799, Lr: 0.000050\n", "2020-01-18 12:53:57,130 Epoch 51 Step: 117700 Batch Loss: 0.999733 Tokens per Sec: 10623, Lr: 0.000050\n", "2020-01-18 12:54:17,224 Epoch 51 Step: 117800 Batch Loss: 1.020384 Tokens per Sec: 10837, Lr: 0.000050\n", "2020-01-18 12:54:37,004 Epoch 51 Step: 117900 Batch Loss: 1.028489 Tokens per Sec: 10598, Lr: 0.000050\n", "2020-01-18 12:54:56,801 Epoch 51 Step: 118000 Batch Loss: 0.915432 Tokens per Sec: 10762, Lr: 0.000050\n", "2020-01-18 12:55:44,693 Example #0\n", "2020-01-18 12:55:44,694 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 12:55:44,694 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 12:55:44,694 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 12:55:44,694 Example #1\n", "2020-01-18 12:55:44,695 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 12:55:44,695 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 12:55:44,695 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 12:55:44,695 Example #2\n", "2020-01-18 12:55:44,695 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 12:55:44,696 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 12:55:44,696 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana nọ e rẹ sasa oma na : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ bẹdẹ ; re ọre na o te ru odẹ riẹ vihọ , re o jiri ai , re erẹwho akpọ na kpobi e jiri ei .\n", "2020-01-18 12:55:44,696 Example #3\n", "2020-01-18 12:55:44,696 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 12:55:44,696 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 12:55:44,696 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 12:55:44,697 Validation result (greedy) at epoch 51, step 118000: bleu: 32.06, loss: 33797.6484, ppl: 4.3166, duration: 47.8948s\n", "2020-01-18 12:56:04,659 Epoch 51 Step: 118100 Batch Loss: 1.019521 Tokens per Sec: 10781, Lr: 0.000050\n", "2020-01-18 12:56:24,749 Epoch 51 Step: 118200 Batch Loss: 1.037848 Tokens per Sec: 10658, Lr: 0.000050\n", "2020-01-18 12:56:44,770 Epoch 51 Step: 118300 Batch Loss: 0.683478 Tokens per Sec: 10765, Lr: 0.000050\n", "2020-01-18 12:57:04,814 Epoch 51 Step: 118400 Batch Loss: 1.129284 Tokens per Sec: 10814, Lr: 0.000050\n", "2020-01-18 12:57:25,004 Epoch 51 Step: 118500 Batch Loss: 1.011527 Tokens per Sec: 10949, Lr: 0.000050\n", "2020-01-18 12:57:45,138 Epoch 51 Step: 118600 Batch Loss: 1.129378 Tokens per Sec: 10781, Lr: 0.000050\n", "2020-01-18 12:58:05,183 Epoch 51 Step: 118700 Batch Loss: 1.036710 Tokens per Sec: 10915, Lr: 0.000050\n", "2020-01-18 12:58:25,115 Epoch 51 Step: 118800 Batch Loss: 1.031255 Tokens per Sec: 10727, Lr: 0.000050\n", "2020-01-18 12:58:45,098 Epoch 51 Step: 118900 Batch Loss: 0.970760 Tokens per Sec: 10730, Lr: 0.000050\n", "2020-01-18 12:59:04,955 Epoch 51 Step: 119000 Batch Loss: 0.994324 Tokens per Sec: 10590, Lr: 0.000050\n", "2020-01-18 12:59:52,761 Example #0\n", "2020-01-18 12:59:52,761 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 12:59:52,762 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 12:59:52,762 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 12:59:52,762 Example #1\n", "2020-01-18 12:59:52,762 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 12:59:52,763 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 12:59:52,763 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 12:59:52,763 Example #2\n", "2020-01-18 12:59:52,763 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 12:59:52,763 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 12:59:52,764 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ ole owoma nana jẹ sasa oma : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi e jiri ei .\n", "2020-01-18 12:59:52,764 Example #3\n", "2020-01-18 12:59:52,764 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 12:59:52,764 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 12:59:52,764 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 12:59:52,765 Validation result (greedy) at epoch 51, step 119000: bleu: 31.92, loss: 33727.8203, ppl: 4.3036, duration: 47.8094s\n", "2020-01-18 13:00:12,911 Epoch 51 Step: 119100 Batch Loss: 1.005861 Tokens per Sec: 10844, Lr: 0.000050\n", "2020-01-18 13:00:33,143 Epoch 51 Step: 119200 Batch Loss: 1.125041 Tokens per Sec: 10961, Lr: 0.000050\n", "2020-01-18 13:00:53,154 Epoch 51 Step: 119300 Batch Loss: 1.130092 Tokens per Sec: 10996, Lr: 0.000050\n", "2020-01-18 13:01:13,110 Epoch 51 Step: 119400 Batch Loss: 1.037860 Tokens per Sec: 10730, Lr: 0.000050\n", "2020-01-18 13:01:32,835 Epoch 51 Step: 119500 Batch Loss: 1.123797 Tokens per Sec: 10654, Lr: 0.000050\n", "2020-01-18 13:01:52,758 Epoch 51 Step: 119600 Batch Loss: 1.068598 Tokens per Sec: 10584, Lr: 0.000050\n", "2020-01-18 13:02:06,126 Epoch 51: total training loss 2406.18\n", "2020-01-18 13:02:06,126 EPOCH 52\n", "2020-01-18 13:02:12,841 Epoch 52 Step: 119700 Batch Loss: 0.943376 Tokens per Sec: 10374, Lr: 0.000050\n", "2020-01-18 13:02:32,736 Epoch 52 Step: 119800 Batch Loss: 0.941657 Tokens per Sec: 10796, Lr: 0.000050\n", "2020-01-18 13:02:52,539 Epoch 52 Step: 119900 Batch Loss: 1.119332 Tokens per Sec: 10731, Lr: 0.000050\n", "2020-01-18 13:03:12,423 Epoch 52 Step: 120000 Batch Loss: 1.127501 Tokens per Sec: 10861, Lr: 0.000050\n", "2020-01-18 13:04:00,225 Example #0\n", "2020-01-18 13:04:00,226 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 13:04:00,227 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 13:04:00,227 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 13:04:00,227 Example #1\n", "2020-01-18 13:04:00,227 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 13:04:00,228 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 13:04:00,228 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 13:04:00,228 Example #2\n", "2020-01-18 13:04:00,228 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 13:04:00,228 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 13:04:00,228 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ ole owoma nana nọ o vọ avọ omosasọ na : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi e jiri ei ; re erẹwho akpọ na kpobi a jiri ei .\n", "2020-01-18 13:04:00,229 Example #3\n", "2020-01-18 13:04:00,230 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 13:04:00,230 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 13:04:00,230 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 13:04:00,230 Validation result (greedy) at epoch 52, step 120000: bleu: 32.29, loss: 33856.6172, ppl: 4.3276, duration: 47.8071s\n", "2020-01-18 13:04:20,274 Epoch 52 Step: 120100 Batch Loss: 1.148715 Tokens per Sec: 10980, Lr: 0.000050\n", "2020-01-18 13:04:40,330 Epoch 52 Step: 120200 Batch Loss: 1.143870 Tokens per Sec: 10868, Lr: 0.000050\n", "2020-01-18 13:05:00,268 Epoch 52 Step: 120300 Batch Loss: 1.137427 Tokens per Sec: 10907, Lr: 0.000050\n", "2020-01-18 13:05:20,063 Epoch 52 Step: 120400 Batch Loss: 0.952074 Tokens per Sec: 10622, Lr: 0.000050\n", "2020-01-18 13:05:39,856 Epoch 52 Step: 120500 Batch Loss: 1.017830 Tokens per Sec: 10684, Lr: 0.000050\n", "2020-01-18 13:05:59,893 Epoch 52 Step: 120600 Batch Loss: 1.198987 Tokens per Sec: 10776, Lr: 0.000050\n", "2020-01-18 13:06:19,848 Epoch 52 Step: 120700 Batch Loss: 1.027207 Tokens per Sec: 10789, Lr: 0.000050\n", "2020-01-18 13:06:39,723 Epoch 52 Step: 120800 Batch Loss: 1.117880 Tokens per Sec: 10766, Lr: 0.000050\n", "2020-01-18 13:06:59,776 Epoch 52 Step: 120900 Batch Loss: 1.099773 Tokens per Sec: 10541, Lr: 0.000050\n", "2020-01-18 13:07:19,657 Epoch 52 Step: 121000 Batch Loss: 1.156224 Tokens per Sec: 10728, Lr: 0.000050\n", "2020-01-18 13:08:07,604 Example #0\n", "2020-01-18 13:08:07,605 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 13:08:07,605 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 13:08:07,605 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 13:08:07,605 Example #1\n", "2020-01-18 13:08:07,606 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 13:08:07,606 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 13:08:07,606 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 13:08:07,606 Example #2\n", "2020-01-18 13:08:07,607 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 13:08:07,607 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 13:08:07,607 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai kpobi ; jọ erẹwho kpobi e jiri ei .\n", "2020-01-18 13:08:07,607 Example #3\n", "2020-01-18 13:08:07,608 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 13:08:07,608 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 13:08:07,608 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 13:08:07,608 Validation result (greedy) at epoch 52, step 121000: bleu: 31.93, loss: 33806.5703, ppl: 4.3183, duration: 47.9503s\n", "2020-01-18 13:08:27,734 Epoch 52 Step: 121100 Batch Loss: 1.037853 Tokens per Sec: 10478, Lr: 0.000035\n", "2020-01-18 13:08:47,785 Epoch 52 Step: 121200 Batch Loss: 1.076915 Tokens per Sec: 10592, Lr: 0.000035\n", "2020-01-18 13:09:07,887 Epoch 52 Step: 121300 Batch Loss: 1.134359 Tokens per Sec: 10926, Lr: 0.000035\n", "2020-01-18 13:09:27,746 Epoch 52 Step: 121400 Batch Loss: 1.065781 Tokens per Sec: 10348, Lr: 0.000035\n", "2020-01-18 13:09:47,855 Epoch 52 Step: 121500 Batch Loss: 1.066459 Tokens per Sec: 10937, Lr: 0.000035\n", "2020-01-18 13:10:07,607 Epoch 52 Step: 121600 Batch Loss: 0.750340 Tokens per Sec: 10398, Lr: 0.000035\n", "2020-01-18 13:10:27,673 Epoch 52 Step: 121700 Batch Loss: 1.022619 Tokens per Sec: 11090, Lr: 0.000035\n", "2020-01-18 13:10:47,609 Epoch 52 Step: 121800 Batch Loss: 1.130430 Tokens per Sec: 10820, Lr: 0.000035\n", "2020-01-18 13:11:07,505 Epoch 52 Step: 121900 Batch Loss: 1.101720 Tokens per Sec: 10751, Lr: 0.000035\n", "2020-01-18 13:11:27,557 Epoch 52 Step: 122000 Batch Loss: 1.065013 Tokens per Sec: 10713, Lr: 0.000035\n", "2020-01-18 13:12:15,373 Example #0\n", "2020-01-18 13:12:15,374 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 13:12:15,374 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 13:12:15,375 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 13:12:15,375 Example #1\n", "2020-01-18 13:12:15,375 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 13:12:15,375 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 13:12:15,375 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 13:12:15,375 Example #2\n", "2020-01-18 13:12:15,376 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 13:12:15,376 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 13:12:15,376 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai kpobi ; re erẹwho na kpobi e jiri ei .\n", "2020-01-18 13:12:15,376 Example #3\n", "2020-01-18 13:12:15,377 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 13:12:15,377 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 13:12:15,377 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 13:12:15,377 Validation result (greedy) at epoch 52, step 122000: bleu: 31.93, loss: 33701.9883, ppl: 4.2988, duration: 47.8192s\n", "2020-01-18 13:12:18,839 Epoch 52: total training loss 2405.32\n", "2020-01-18 13:12:18,839 EPOCH 53\n", "2020-01-18 13:12:35,705 Epoch 53 Step: 122100 Batch Loss: 1.127375 Tokens per Sec: 10814, Lr: 0.000035\n", "2020-01-18 13:12:55,953 Epoch 53 Step: 122200 Batch Loss: 0.671074 Tokens per Sec: 10587, Lr: 0.000035\n", "2020-01-18 13:13:15,935 Epoch 53 Step: 122300 Batch Loss: 1.042472 Tokens per Sec: 10958, Lr: 0.000035\n", "2020-01-18 13:13:35,989 Epoch 53 Step: 122400 Batch Loss: 1.038147 Tokens per Sec: 10772, Lr: 0.000035\n", "2020-01-18 13:13:56,068 Epoch 53 Step: 122500 Batch Loss: 1.106058 Tokens per Sec: 10765, Lr: 0.000035\n", "2020-01-18 13:14:16,102 Epoch 53 Step: 122600 Batch Loss: 1.058475 Tokens per Sec: 10872, Lr: 0.000035\n", "2020-01-18 13:14:36,138 Epoch 53 Step: 122700 Batch Loss: 1.071701 Tokens per Sec: 10771, Lr: 0.000035\n", "2020-01-18 13:14:56,029 Epoch 53 Step: 122800 Batch Loss: 1.147174 Tokens per Sec: 10672, Lr: 0.000035\n", "2020-01-18 13:15:16,043 Epoch 53 Step: 122900 Batch Loss: 1.033704 Tokens per Sec: 10678, Lr: 0.000035\n", "2020-01-18 13:15:36,017 Epoch 53 Step: 123000 Batch Loss: 0.916210 Tokens per Sec: 10833, Lr: 0.000035\n", "2020-01-18 13:16:23,861 Example #0\n", "2020-01-18 13:16:23,863 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 13:16:23,863 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 13:16:23,863 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 13:16:23,863 Example #1\n", "2020-01-18 13:16:23,864 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 13:16:23,864 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 13:16:23,864 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 13:16:23,864 Example #2\n", "2020-01-18 13:16:23,864 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 13:16:23,864 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 13:16:23,865 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi e jiri ei .\n", "2020-01-18 13:16:23,865 Example #3\n", "2020-01-18 13:16:23,865 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 13:16:23,865 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 13:16:23,865 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 13:16:23,866 Validation result (greedy) at epoch 53, step 123000: bleu: 31.68, loss: 33720.0547, ppl: 4.3021, duration: 47.8480s\n", "2020-01-18 13:16:43,729 Epoch 53 Step: 123100 Batch Loss: 1.120732 Tokens per Sec: 10905, Lr: 0.000035\n", "2020-01-18 13:17:03,633 Epoch 53 Step: 123200 Batch Loss: 1.068395 Tokens per Sec: 10816, Lr: 0.000035\n", "2020-01-18 13:17:23,607 Epoch 53 Step: 123300 Batch Loss: 1.166407 Tokens per Sec: 10907, Lr: 0.000035\n", "2020-01-18 13:17:43,553 Epoch 53 Step: 123400 Batch Loss: 0.907691 Tokens per Sec: 10767, Lr: 0.000035\n", "2020-01-18 13:18:03,536 Epoch 53 Step: 123500 Batch Loss: 1.019282 Tokens per Sec: 10772, Lr: 0.000035\n", "2020-01-18 13:18:23,469 Epoch 53 Step: 123600 Batch Loss: 1.024559 Tokens per Sec: 10821, Lr: 0.000035\n", "2020-01-18 13:18:43,526 Epoch 53 Step: 123700 Batch Loss: 1.074167 Tokens per Sec: 10595, Lr: 0.000035\n", "2020-01-18 13:19:03,527 Epoch 53 Step: 123800 Batch Loss: 0.985432 Tokens per Sec: 10916, Lr: 0.000035\n", "2020-01-18 13:19:23,288 Epoch 53 Step: 123900 Batch Loss: 1.011435 Tokens per Sec: 10560, Lr: 0.000035\n", "2020-01-18 13:19:43,240 Epoch 53 Step: 124000 Batch Loss: 1.150743 Tokens per Sec: 10895, Lr: 0.000035\n", "2020-01-18 13:20:31,240 Example #0\n", "2020-01-18 13:20:31,240 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 13:20:31,241 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 13:20:31,241 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 13:20:31,241 Example #1\n", "2020-01-18 13:20:31,242 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 13:20:31,242 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 13:20:31,242 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 13:20:31,242 Example #2\n", "2020-01-18 13:20:31,243 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 13:20:31,243 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 13:20:31,243 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai kpobi ; jọ erẹwho kpobi e jiri ei .\n", "2020-01-18 13:20:31,243 Example #3\n", "2020-01-18 13:20:31,243 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 13:20:31,244 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 13:20:31,244 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 13:20:31,244 Validation result (greedy) at epoch 53, step 124000: bleu: 32.21, loss: 33731.6875, ppl: 4.3043, duration: 48.0036s\n", "2020-01-18 13:20:51,206 Epoch 53 Step: 124100 Batch Loss: 1.084646 Tokens per Sec: 10560, Lr: 0.000035\n", "2020-01-18 13:21:11,147 Epoch 53 Step: 124200 Batch Loss: 1.031246 Tokens per Sec: 10403, Lr: 0.000035\n", "2020-01-18 13:21:31,113 Epoch 53 Step: 124300 Batch Loss: 1.095572 Tokens per Sec: 10585, Lr: 0.000035\n", "2020-01-18 13:21:43,466 Epoch 53: total training loss 2388.67\n", "2020-01-18 13:21:43,466 EPOCH 54\n", "2020-01-18 13:21:51,226 Epoch 54 Step: 124400 Batch Loss: 1.115223 Tokens per Sec: 10392, Lr: 0.000035\n", "2020-01-18 13:22:11,200 Epoch 54 Step: 124500 Batch Loss: 1.087186 Tokens per Sec: 10729, Lr: 0.000035\n", "2020-01-18 13:22:31,238 Epoch 54 Step: 124600 Batch Loss: 0.967198 Tokens per Sec: 10998, Lr: 0.000035\n", "2020-01-18 13:22:51,248 Epoch 54 Step: 124700 Batch Loss: 1.066665 Tokens per Sec: 10772, Lr: 0.000035\n", "2020-01-18 13:23:11,187 Epoch 54 Step: 124800 Batch Loss: 1.159952 Tokens per Sec: 10687, Lr: 0.000035\n", "2020-01-18 13:23:31,173 Epoch 54 Step: 124900 Batch Loss: 1.065972 Tokens per Sec: 10465, Lr: 0.000035\n", "2020-01-18 13:23:51,134 Epoch 54 Step: 125000 Batch Loss: 1.024156 Tokens per Sec: 10842, Lr: 0.000035\n", "2020-01-18 13:24:39,106 Example #0\n", "2020-01-18 13:24:39,107 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 13:24:39,107 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 13:24:39,107 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai evaọ eva efuafo . ’\n", "2020-01-18 13:24:39,107 Example #1\n", "2020-01-18 13:24:39,108 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 13:24:39,108 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 13:24:39,108 \tHypothesis: A rọ omobe - ovẹvẹ Usi Uvie na No Ze , Ọrọ Avọ 4\n", "2020-01-18 13:24:39,108 Example #2\n", "2020-01-18 13:24:39,108 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 13:24:39,109 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 13:24:39,109 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ole owoma nana : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai kpobi ; re erẹwho na kpobi i jiri ei .\n", "2020-01-18 13:24:39,109 Example #3\n", "2020-01-18 13:24:39,109 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 13:24:39,109 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 13:24:39,110 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 13:24:39,110 Validation result (greedy) at epoch 54, step 125000: bleu: 32.01, loss: 33825.4805, ppl: 4.3218, duration: 47.9750s\n", "2020-01-18 13:24:59,246 Epoch 54 Step: 125100 Batch Loss: 1.179296 Tokens per Sec: 10713, Lr: 0.000035\n", "2020-01-18 13:25:19,409 Epoch 54 Step: 125200 Batch Loss: 1.136678 Tokens per Sec: 10454, Lr: 0.000035\n", "2020-01-18 13:25:39,360 Epoch 54 Step: 125300 Batch Loss: 1.117879 Tokens per Sec: 10818, Lr: 0.000035\n", "2020-01-18 13:25:59,352 Epoch 54 Step: 125400 Batch Loss: 1.063702 Tokens per Sec: 10634, Lr: 0.000035\n", "2020-01-18 13:26:19,682 Epoch 54 Step: 125500 Batch Loss: 1.092260 Tokens per Sec: 10686, Lr: 0.000035\n", "2020-01-18 13:26:39,571 Epoch 54 Step: 125600 Batch Loss: 0.940924 Tokens per Sec: 10511, Lr: 0.000035\n", "2020-01-18 13:26:59,667 Epoch 54 Step: 125700 Batch Loss: 1.070950 Tokens per Sec: 10763, Lr: 0.000035\n", "2020-01-18 13:27:19,690 Epoch 54 Step: 125800 Batch Loss: 1.076379 Tokens per Sec: 10633, Lr: 0.000035\n", "2020-01-18 13:27:39,612 Epoch 54 Step: 125900 Batch Loss: 1.083228 Tokens per Sec: 10574, Lr: 0.000035\n", "2020-01-18 13:27:59,583 Epoch 54 Step: 126000 Batch Loss: 1.144640 Tokens per Sec: 10809, Lr: 0.000035\n", "2020-01-18 13:28:47,484 Example #0\n", "2020-01-18 13:28:47,485 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 13:28:47,486 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 13:28:47,486 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 13:28:47,486 Example #1\n", "2020-01-18 13:28:47,486 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 13:28:47,487 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 13:28:47,487 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 13:28:47,487 Example #2\n", "2020-01-18 13:28:47,487 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 13:28:47,488 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 13:28:47,488 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre na o te lo , re odẹ riẹ u vihọ , re o jiri ai kpobi ; re o jiri ai kpobi ; re erẹwho akpọ na kpobi a jiri ei .\n", "2020-01-18 13:28:47,488 Example #3\n", "2020-01-18 13:28:47,488 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 13:28:47,489 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 13:28:47,489 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 13:28:47,489 Validation result (greedy) at epoch 54, step 126000: bleu: 31.91, loss: 33718.5312, ppl: 4.3018, duration: 47.9054s\n", "2020-01-18 13:29:07,413 Epoch 54 Step: 126100 Batch Loss: 1.076132 Tokens per Sec: 10774, Lr: 0.000035\n", "2020-01-18 13:29:27,529 Epoch 54 Step: 126200 Batch Loss: 1.058699 Tokens per Sec: 10784, Lr: 0.000035\n", "2020-01-18 13:29:47,449 Epoch 54 Step: 126300 Batch Loss: 1.139972 Tokens per Sec: 10695, Lr: 0.000035\n", "2020-01-18 13:30:07,407 Epoch 54 Step: 126400 Batch Loss: 1.134521 Tokens per Sec: 10652, Lr: 0.000035\n", "2020-01-18 13:30:27,565 Epoch 54 Step: 126500 Batch Loss: 1.033553 Tokens per Sec: 10722, Lr: 0.000035\n", "2020-01-18 13:30:47,521 Epoch 54 Step: 126600 Batch Loss: 1.065466 Tokens per Sec: 10800, Lr: 0.000035\n", "2020-01-18 13:31:07,371 Epoch 54 Step: 126700 Batch Loss: 1.109326 Tokens per Sec: 10908, Lr: 0.000035\n", "2020-01-18 13:31:09,975 Epoch 54: total training loss 2390.46\n", "2020-01-18 13:31:09,975 EPOCH 55\n", "2020-01-18 13:31:27,610 Epoch 55 Step: 126800 Batch Loss: 1.095135 Tokens per Sec: 10509, Lr: 0.000035\n", "2020-01-18 13:31:47,543 Epoch 55 Step: 126900 Batch Loss: 0.870635 Tokens per Sec: 10640, Lr: 0.000035\n", "2020-01-18 13:32:07,495 Epoch 55 Step: 127000 Batch Loss: 1.101987 Tokens per Sec: 10839, Lr: 0.000035\n", "2020-01-18 13:32:55,306 Example #0\n", "2020-01-18 13:32:55,307 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 13:32:55,307 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 13:32:55,307 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 13:32:55,308 Example #1\n", "2020-01-18 13:32:55,308 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 13:32:55,308 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 13:32:55,308 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 13:32:55,308 Example #2\n", "2020-01-18 13:32:55,309 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 13:32:55,309 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 13:32:55,309 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ fiba irru mai ro ku ole owoma nana họ : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi e jiri ei .\n", "2020-01-18 13:32:55,309 Example #3\n", "2020-01-18 13:32:55,309 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 13:32:55,310 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 13:32:55,310 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 13:32:55,310 Validation result (greedy) at epoch 55, step 127000: bleu: 31.76, loss: 33780.0039, ppl: 4.3133, duration: 47.8144s\n", "2020-01-18 13:33:15,321 Epoch 55 Step: 127100 Batch Loss: 0.970936 Tokens per Sec: 10764, Lr: 0.000025\n", "2020-01-18 13:33:35,343 Epoch 55 Step: 127200 Batch Loss: 1.146036 Tokens per Sec: 11039, Lr: 0.000025\n", "2020-01-18 13:33:55,247 Epoch 55 Step: 127300 Batch Loss: 1.153464 Tokens per Sec: 10498, Lr: 0.000025\n", "2020-01-18 13:34:15,331 Epoch 55 Step: 127400 Batch Loss: 0.865794 Tokens per Sec: 10506, Lr: 0.000025\n", "2020-01-18 13:34:35,219 Epoch 55 Step: 127500 Batch Loss: 1.057726 Tokens per Sec: 10884, Lr: 0.000025\n", "2020-01-18 13:34:55,316 Epoch 55 Step: 127600 Batch Loss: 0.530492 Tokens per Sec: 10742, Lr: 0.000025\n", "2020-01-18 13:35:15,270 Epoch 55 Step: 127700 Batch Loss: 0.920709 Tokens per Sec: 10627, Lr: 0.000025\n", "2020-01-18 13:35:35,280 Epoch 55 Step: 127800 Batch Loss: 0.965292 Tokens per Sec: 10925, Lr: 0.000025\n", "2020-01-18 13:35:55,078 Epoch 55 Step: 127900 Batch Loss: 1.075269 Tokens per Sec: 10943, Lr: 0.000025\n", "2020-01-18 13:36:15,089 Epoch 55 Step: 128000 Batch Loss: 1.090358 Tokens per Sec: 10783, Lr: 0.000025\n", "2020-01-18 13:37:02,935 Example #0\n", "2020-01-18 13:37:02,936 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 13:37:02,936 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 13:37:02,936 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 13:37:02,936 Example #1\n", "2020-01-18 13:37:02,937 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 13:37:02,937 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 13:37:02,937 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 13:37:02,937 Example #2\n", "2020-01-18 13:37:02,938 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 13:37:02,938 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 13:37:02,938 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai ro ku ole owoma nana họ : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi e jiri ei .\n", "2020-01-18 13:37:02,938 Example #3\n", "2020-01-18 13:37:02,938 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 13:37:02,939 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 13:37:02,939 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 13:37:02,939 Validation result (greedy) at epoch 55, step 128000: bleu: 31.87, loss: 33754.7344, ppl: 4.3086, duration: 47.8493s\n", "2020-01-18 13:37:23,025 Epoch 55 Step: 128100 Batch Loss: 0.742640 Tokens per Sec: 10714, Lr: 0.000025\n", "2020-01-18 13:37:42,834 Epoch 55 Step: 128200 Batch Loss: 0.799196 Tokens per Sec: 10596, Lr: 0.000025\n", "2020-01-18 13:38:02,819 Epoch 55 Step: 128300 Batch Loss: 0.994458 Tokens per Sec: 10914, Lr: 0.000025\n", "2020-01-18 13:38:22,826 Epoch 55 Step: 128400 Batch Loss: 0.997119 Tokens per Sec: 10870, Lr: 0.000025\n", "2020-01-18 13:38:42,716 Epoch 55 Step: 128500 Batch Loss: 1.182154 Tokens per Sec: 10876, Lr: 0.000025\n", "2020-01-18 13:39:02,663 Epoch 55 Step: 128600 Batch Loss: 1.002381 Tokens per Sec: 10595, Lr: 0.000025\n", "2020-01-18 13:39:22,588 Epoch 55 Step: 128700 Batch Loss: 1.008999 Tokens per Sec: 10996, Lr: 0.000025\n", "2020-01-18 13:39:42,462 Epoch 55 Step: 128800 Batch Loss: 0.967380 Tokens per Sec: 10761, Lr: 0.000025\n", "2020-01-18 13:40:02,424 Epoch 55 Step: 128900 Batch Loss: 1.001907 Tokens per Sec: 10654, Lr: 0.000025\n", "2020-01-18 13:40:22,434 Epoch 55 Step: 129000 Batch Loss: 1.098099 Tokens per Sec: 10855, Lr: 0.000025\n", "2020-01-18 13:41:10,311 Example #0\n", "2020-01-18 13:41:10,312 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 13:41:10,313 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 13:41:10,313 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 13:41:10,313 Example #1\n", "2020-01-18 13:41:10,313 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 13:41:10,313 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 13:41:10,313 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 13:41:10,314 Example #2\n", "2020-01-18 13:41:10,314 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 13:41:10,314 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 13:41:10,314 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ile iwoma nana : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai kpobi ; re erẹwho akpọ na kpobi e jiri ei .\n", "2020-01-18 13:41:10,314 Example #3\n", "2020-01-18 13:41:10,315 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 13:41:10,315 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 13:41:10,315 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 13:41:10,315 Validation result (greedy) at epoch 55, step 129000: bleu: 32.02, loss: 33687.9492, ppl: 4.2962, duration: 47.8807s\n", "2020-01-18 13:41:21,861 Epoch 55: total training loss 2374.13\n", "2020-01-18 13:41:21,861 EPOCH 56\n", "2020-01-18 13:41:30,422 Epoch 56 Step: 129100 Batch Loss: 1.079590 Tokens per Sec: 10419, Lr: 0.000025\n", "2020-01-18 13:41:50,326 Epoch 56 Step: 129200 Batch Loss: 1.085833 Tokens per Sec: 10586, Lr: 0.000025\n", "2020-01-18 13:42:10,424 Epoch 56 Step: 129300 Batch Loss: 1.024421 Tokens per Sec: 10960, Lr: 0.000025\n", "2020-01-18 13:42:30,374 Epoch 56 Step: 129400 Batch Loss: 0.936661 Tokens per Sec: 10468, Lr: 0.000025\n", "2020-01-18 13:42:50,328 Epoch 56 Step: 129500 Batch Loss: 1.093209 Tokens per Sec: 10607, Lr: 0.000025\n", "2020-01-18 13:43:10,246 Epoch 56 Step: 129600 Batch Loss: 0.588222 Tokens per Sec: 10666, Lr: 0.000025\n", "2020-01-18 13:43:30,186 Epoch 56 Step: 129700 Batch Loss: 1.100948 Tokens per Sec: 10873, Lr: 0.000025\n", "2020-01-18 13:43:50,252 Epoch 56 Step: 129800 Batch Loss: 1.097893 Tokens per Sec: 10542, Lr: 0.000025\n", "2020-01-18 13:44:10,133 Epoch 56 Step: 129900 Batch Loss: 1.049523 Tokens per Sec: 10786, Lr: 0.000025\n", "2020-01-18 13:44:30,203 Epoch 56 Step: 130000 Batch Loss: 1.068199 Tokens per Sec: 10866, Lr: 0.000025\n", "2020-01-18 13:45:18,165 Example #0\n", "2020-01-18 13:45:18,166 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 13:45:18,166 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 13:45:18,166 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 13:45:18,167 Example #1\n", "2020-01-18 13:45:18,167 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 13:45:18,167 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 13:45:18,167 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 13:45:18,167 Example #2\n", "2020-01-18 13:45:18,168 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 13:45:18,168 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 13:45:18,168 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai kpobi ; re erẹwho akpọ na kpobi e jiri ei .\n", "2020-01-18 13:45:18,168 Example #3\n", "2020-01-18 13:45:18,169 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 13:45:18,169 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 13:45:18,169 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 13:45:18,169 Validation result (greedy) at epoch 56, step 130000: bleu: 31.98, loss: 33733.6992, ppl: 4.3047, duration: 47.9660s\n", "2020-01-18 13:45:38,095 Epoch 56 Step: 130100 Batch Loss: 1.003631 Tokens per Sec: 10737, Lr: 0.000025\n", "2020-01-18 13:45:58,273 Epoch 56 Step: 130200 Batch Loss: 0.559933 Tokens per Sec: 10665, Lr: 0.000025\n", "2020-01-18 13:46:18,242 Epoch 56 Step: 130300 Batch Loss: 0.977367 Tokens per Sec: 11006, Lr: 0.000025\n", "2020-01-18 13:46:38,185 Epoch 56 Step: 130400 Batch Loss: 1.204854 Tokens per Sec: 10568, Lr: 0.000025\n", "2020-01-18 13:46:58,189 Epoch 56 Step: 130500 Batch Loss: 0.942557 Tokens per Sec: 10781, Lr: 0.000025\n", "2020-01-18 13:47:18,356 Epoch 56 Step: 130600 Batch Loss: 1.115254 Tokens per Sec: 10926, Lr: 0.000025\n", "2020-01-18 13:47:38,697 Epoch 56 Step: 130700 Batch Loss: 1.096646 Tokens per Sec: 10822, Lr: 0.000025\n", "2020-01-18 13:47:58,890 Epoch 56 Step: 130800 Batch Loss: 1.132872 Tokens per Sec: 11114, Lr: 0.000025\n", "2020-01-18 13:48:18,629 Epoch 56 Step: 130900 Batch Loss: 1.048747 Tokens per Sec: 10619, Lr: 0.000025\n", "2020-01-18 13:48:38,651 Epoch 56 Step: 131000 Batch Loss: 1.042944 Tokens per Sec: 10805, Lr: 0.000025\n", "2020-01-18 13:49:26,542 Example #0\n", "2020-01-18 13:49:26,543 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 13:49:26,544 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 13:49:26,544 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 13:49:26,544 Example #1\n", "2020-01-18 13:49:26,545 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 13:49:26,545 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 13:49:26,545 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 13:49:26,545 Example #2\n", "2020-01-18 13:49:26,546 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 13:49:26,547 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 13:49:26,547 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ fiba urru mai orọ edo ole owoma nana nọ o vọ avọ omosasọ na : “ Jọ odẹ riẹ [ ọrọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi i jiri ei .\n", "2020-01-18 13:49:26,547 Example #3\n", "2020-01-18 13:49:26,548 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 13:49:26,548 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 13:49:26,548 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 13:49:26,548 Validation result (greedy) at epoch 56, step 131000: bleu: 32.02, loss: 33758.1055, ppl: 4.3092, duration: 47.8963s\n", "2020-01-18 13:49:46,476 Epoch 56 Step: 131100 Batch Loss: 1.081844 Tokens per Sec: 10594, Lr: 0.000025\n", "2020-01-18 13:50:06,260 Epoch 56 Step: 131200 Batch Loss: 1.098068 Tokens per Sec: 10612, Lr: 0.000025\n", "2020-01-18 13:50:26,377 Epoch 56 Step: 131300 Batch Loss: 1.144976 Tokens per Sec: 10958, Lr: 0.000025\n", "2020-01-18 13:50:46,082 Epoch 56 Step: 131400 Batch Loss: 0.822708 Tokens per Sec: 10667, Lr: 0.000025\n", "2020-01-18 13:50:46,683 Epoch 56: total training loss 2370.41\n", "2020-01-18 13:50:46,683 EPOCH 57\n", "2020-01-18 13:51:06,345 Epoch 57 Step: 131500 Batch Loss: 0.790396 Tokens per Sec: 10446, Lr: 0.000025\n", "2020-01-18 13:51:26,473 Epoch 57 Step: 131600 Batch Loss: 1.021436 Tokens per Sec: 10682, Lr: 0.000025\n", "2020-01-18 13:51:46,461 Epoch 57 Step: 131700 Batch Loss: 1.005265 Tokens per Sec: 10730, Lr: 0.000025\n", "2020-01-18 13:52:06,300 Epoch 57 Step: 131800 Batch Loss: 1.135032 Tokens per Sec: 10579, Lr: 0.000025\n", "2020-01-18 13:52:26,353 Epoch 57 Step: 131900 Batch Loss: 1.056152 Tokens per Sec: 10892, Lr: 0.000025\n", "2020-01-18 13:52:46,410 Epoch 57 Step: 132000 Batch Loss: 1.162233 Tokens per Sec: 10676, Lr: 0.000025\n", "2020-01-18 13:53:34,269 Example #0\n", "2020-01-18 13:53:34,270 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 13:53:34,270 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 13:53:34,270 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 13:53:34,270 Example #1\n", "2020-01-18 13:53:34,271 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 13:53:34,271 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 13:53:34,271 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 13:53:34,271 Example #2\n", "2020-01-18 13:53:34,271 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 13:53:34,272 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 13:53:34,272 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi i jiri ei .\n", "2020-01-18 13:53:34,272 Example #3\n", "2020-01-18 13:53:34,272 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 13:53:34,272 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 13:53:34,273 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 13:53:34,273 Validation result (greedy) at epoch 57, step 132000: bleu: 31.86, loss: 33710.2891, ppl: 4.3003, duration: 47.8620s\n", "2020-01-18 13:53:54,009 Epoch 57 Step: 132100 Batch Loss: 0.997096 Tokens per Sec: 10566, Lr: 0.000025\n", "2020-01-18 13:54:13,993 Epoch 57 Step: 132200 Batch Loss: 1.021839 Tokens per Sec: 10834, Lr: 0.000025\n", "2020-01-18 13:54:33,986 Epoch 57 Step: 132300 Batch Loss: 1.148039 Tokens per Sec: 10628, Lr: 0.000025\n", "2020-01-18 13:54:53,942 Epoch 57 Step: 132400 Batch Loss: 0.840279 Tokens per Sec: 10705, Lr: 0.000025\n", "2020-01-18 13:55:13,842 Epoch 57 Step: 132500 Batch Loss: 1.033802 Tokens per Sec: 10901, Lr: 0.000025\n", "2020-01-18 13:55:33,958 Epoch 57 Step: 132600 Batch Loss: 1.132417 Tokens per Sec: 10934, Lr: 0.000025\n", "2020-01-18 13:55:53,938 Epoch 57 Step: 132700 Batch Loss: 1.052670 Tokens per Sec: 10962, Lr: 0.000025\n", "2020-01-18 13:56:13,962 Epoch 57 Step: 132800 Batch Loss: 1.096475 Tokens per Sec: 10950, Lr: 0.000025\n", "2020-01-18 13:56:33,863 Epoch 57 Step: 132900 Batch Loss: 1.065241 Tokens per Sec: 10624, Lr: 0.000025\n", "2020-01-18 13:56:53,822 Epoch 57 Step: 133000 Batch Loss: 0.985068 Tokens per Sec: 10712, Lr: 0.000025\n", "2020-01-18 13:57:41,667 Example #0\n", "2020-01-18 13:57:41,668 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 13:57:41,668 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 13:57:41,669 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 13:57:41,669 Example #1\n", "2020-01-18 13:57:41,669 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 13:57:41,669 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 13:57:41,669 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 13:57:41,669 Example #2\n", "2020-01-18 13:57:41,670 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 13:57:41,670 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 13:57:41,670 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai , re o jiri ai kpobi ; re erẹwho akpọ na kpobi e jiri ei .\n", "2020-01-18 13:57:41,670 Example #3\n", "2020-01-18 13:57:41,671 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 13:57:41,671 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 13:57:41,671 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 13:57:41,671 Validation result (greedy) at epoch 57, step 133000: bleu: 31.96, loss: 33732.8398, ppl: 4.3045, duration: 47.8484s\n", "2020-01-18 13:58:01,615 Epoch 57 Step: 133100 Batch Loss: 1.048200 Tokens per Sec: 10959, Lr: 0.000017\n", "2020-01-18 13:58:21,525 Epoch 57 Step: 133200 Batch Loss: 0.862149 Tokens per Sec: 10782, Lr: 0.000017\n", "2020-01-18 13:58:41,374 Epoch 57 Step: 133300 Batch Loss: 1.027574 Tokens per Sec: 10541, Lr: 0.000017\n", "2020-01-18 13:59:01,424 Epoch 57 Step: 133400 Batch Loss: 1.064163 Tokens per Sec: 10806, Lr: 0.000017\n", "2020-01-18 13:59:21,438 Epoch 57 Step: 133500 Batch Loss: 1.134541 Tokens per Sec: 10774, Lr: 0.000017\n", "2020-01-18 13:59:41,330 Epoch 57 Step: 133600 Batch Loss: 1.081561 Tokens per Sec: 10668, Lr: 0.000017\n", "2020-01-18 14:00:01,287 Epoch 57 Step: 133700 Batch Loss: 1.046991 Tokens per Sec: 10647, Lr: 0.000017\n", "2020-01-18 14:00:11,550 Epoch 57: total training loss 2368.21\n", "2020-01-18 14:00:11,551 EPOCH 58\n", "2020-01-18 14:00:21,560 Epoch 58 Step: 133800 Batch Loss: 1.005674 Tokens per Sec: 10688, Lr: 0.000017\n", "2020-01-18 14:00:41,393 Epoch 58 Step: 133900 Batch Loss: 1.111063 Tokens per Sec: 10639, Lr: 0.000017\n", "2020-01-18 14:01:01,642 Epoch 58 Step: 134000 Batch Loss: 1.090346 Tokens per Sec: 10670, Lr: 0.000017\n", "2020-01-18 14:01:49,488 Example #0\n", "2020-01-18 14:01:49,489 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 14:01:49,489 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 14:01:49,489 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 14:01:49,489 Example #1\n", "2020-01-18 14:01:49,490 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 14:01:49,490 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 14:01:49,490 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 14:01:49,490 Example #2\n", "2020-01-18 14:01:49,490 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 14:01:49,491 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 14:01:49,491 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ ole owoma nana nọ o vọ avọ omosasọ na : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te ti wo odẹ riẹ , re o jiri ei , re o ru re erẹwho kpobi i wo oghale ; re erẹwho akpọ na kpobi e jiri ei .\n", "2020-01-18 14:01:49,491 Example #3\n", "2020-01-18 14:01:49,491 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 14:01:49,491 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 14:01:49,491 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 14:01:49,492 Validation result (greedy) at epoch 58, step 134000: bleu: 31.86, loss: 33695.5742, ppl: 4.2976, duration: 47.8491s\n", "2020-01-18 14:02:09,592 Epoch 58 Step: 134100 Batch Loss: 0.860851 Tokens per Sec: 10881, Lr: 0.000017\n", "2020-01-18 14:02:29,514 Epoch 58 Step: 134200 Batch Loss: 0.939751 Tokens per Sec: 10756, Lr: 0.000017\n", "2020-01-18 14:02:49,429 Epoch 58 Step: 134300 Batch Loss: 1.025378 Tokens per Sec: 10677, Lr: 0.000017\n", "2020-01-18 14:03:09,380 Epoch 58 Step: 134400 Batch Loss: 1.188592 Tokens per Sec: 10950, Lr: 0.000017\n", "2020-01-18 14:03:29,289 Epoch 58 Step: 134500 Batch Loss: 0.816233 Tokens per Sec: 10665, Lr: 0.000017\n", "2020-01-18 14:03:49,416 Epoch 58 Step: 134600 Batch Loss: 1.041965 Tokens per Sec: 10733, Lr: 0.000017\n", "2020-01-18 14:04:09,460 Epoch 58 Step: 134700 Batch Loss: 1.132889 Tokens per Sec: 10982, Lr: 0.000017\n", "2020-01-18 14:04:29,522 Epoch 58 Step: 134800 Batch Loss: 1.025375 Tokens per Sec: 10643, Lr: 0.000017\n", "2020-01-18 14:04:49,609 Epoch 58 Step: 134900 Batch Loss: 1.130826 Tokens per Sec: 10788, Lr: 0.000017\n", "2020-01-18 14:05:09,582 Epoch 58 Step: 135000 Batch Loss: 0.808261 Tokens per Sec: 10760, Lr: 0.000017\n", "2020-01-18 14:05:57,383 Example #0\n", "2020-01-18 14:05:57,384 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 14:05:57,385 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 14:05:57,385 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 14:05:57,385 Example #1\n", "2020-01-18 14:05:57,386 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 14:05:57,386 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 14:05:57,386 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 14:05:57,386 Example #2\n", "2020-01-18 14:05:57,387 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 14:05:57,387 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 14:05:57,387 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi i jiri ei .\n", "2020-01-18 14:05:57,387 Example #3\n", "2020-01-18 14:05:57,388 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 14:05:57,388 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 14:05:57,388 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 14:05:57,388 Validation result (greedy) at epoch 58, step 135000: bleu: 32.23, loss: 33734.1562, ppl: 4.3048, duration: 47.8053s\n", "2020-01-18 14:06:17,405 Epoch 58 Step: 135100 Batch Loss: 1.020606 Tokens per Sec: 10560, Lr: 0.000017\n", "2020-01-18 14:06:37,351 Epoch 58 Step: 135200 Batch Loss: 0.622688 Tokens per Sec: 10582, Lr: 0.000017\n", "2020-01-18 14:06:57,468 Epoch 58 Step: 135300 Batch Loss: 1.070454 Tokens per Sec: 10764, Lr: 0.000017\n", "2020-01-18 14:07:17,618 Epoch 58 Step: 135400 Batch Loss: 1.009040 Tokens per Sec: 10739, Lr: 0.000017\n", "2020-01-18 14:07:37,555 Epoch 58 Step: 135500 Batch Loss: 0.829738 Tokens per Sec: 10646, Lr: 0.000017\n", "2020-01-18 14:07:57,590 Epoch 58 Step: 135600 Batch Loss: 1.004565 Tokens per Sec: 11031, Lr: 0.000017\n", "2020-01-18 14:08:17,580 Epoch 58 Step: 135700 Batch Loss: 1.054353 Tokens per Sec: 10650, Lr: 0.000017\n", "2020-01-18 14:08:37,685 Epoch 58 Step: 135800 Batch Loss: 1.010503 Tokens per Sec: 10782, Lr: 0.000017\n", "2020-01-18 14:08:57,639 Epoch 58 Step: 135900 Batch Loss: 1.060344 Tokens per Sec: 10863, Lr: 0.000017\n", "2020-01-18 14:09:17,742 Epoch 58 Step: 136000 Batch Loss: 1.035413 Tokens per Sec: 10881, Lr: 0.000017\n", "2020-01-18 14:10:05,571 Example #0\n", "2020-01-18 14:10:05,572 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 14:10:05,572 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 14:10:05,573 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 14:10:05,573 Example #1\n", "2020-01-18 14:10:05,573 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 14:10:05,573 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 14:10:05,573 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 14:10:05,573 Example #2\n", "2020-01-18 14:10:05,574 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 14:10:05,574 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 14:10:05,574 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ fiba urru mai orọ edo ole owoma nana nọ o vọ avọ omosasọ na : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi i jiri ei .\n", "2020-01-18 14:10:05,574 Example #3\n", "2020-01-18 14:10:05,575 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 14:10:05,575 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 14:10:05,575 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 14:10:05,575 Validation result (greedy) at epoch 58, step 136000: bleu: 31.95, loss: 33736.7383, ppl: 4.3052, duration: 47.8332s\n", "2020-01-18 14:10:23,385 Epoch 58: total training loss 2352.70\n", "2020-01-18 14:10:23,385 EPOCH 59\n", "2020-01-18 14:10:25,838 Epoch 59 Step: 136100 Batch Loss: 1.097861 Tokens per Sec: 9645, Lr: 0.000017\n", "2020-01-18 14:10:45,821 Epoch 59 Step: 136200 Batch Loss: 0.795954 Tokens per Sec: 10574, Lr: 0.000017\n", "2020-01-18 14:11:05,918 Epoch 59 Step: 136300 Batch Loss: 1.113349 Tokens per Sec: 10923, Lr: 0.000017\n", "2020-01-18 14:11:26,003 Epoch 59 Step: 136400 Batch Loss: 0.850799 Tokens per Sec: 10782, Lr: 0.000017\n", "2020-01-18 14:11:45,995 Epoch 59 Step: 136500 Batch Loss: 1.066987 Tokens per Sec: 10534, Lr: 0.000017\n", "2020-01-18 14:12:05,924 Epoch 59 Step: 136600 Batch Loss: 1.071769 Tokens per Sec: 10482, Lr: 0.000017\n", "2020-01-18 14:12:25,823 Epoch 59 Step: 136700 Batch Loss: 0.985496 Tokens per Sec: 10742, Lr: 0.000017\n", "2020-01-18 14:12:45,779 Epoch 59 Step: 136800 Batch Loss: 1.023449 Tokens per Sec: 10880, Lr: 0.000017\n", "2020-01-18 14:13:05,736 Epoch 59 Step: 136900 Batch Loss: 1.168202 Tokens per Sec: 10794, Lr: 0.000017\n", "2020-01-18 14:13:25,701 Epoch 59 Step: 137000 Batch Loss: 1.041582 Tokens per Sec: 10586, Lr: 0.000017\n", "2020-01-18 14:14:13,536 Example #0\n", "2020-01-18 14:14:13,538 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 14:14:13,538 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 14:14:13,538 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 14:14:13,539 Example #1\n", "2020-01-18 14:14:13,539 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 14:14:13,539 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 14:14:13,540 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ 4\n", "2020-01-18 14:14:13,540 Example #2\n", "2020-01-18 14:14:13,540 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 14:14:13,540 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 14:14:13,541 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai kpobi ; re o jiri ai erẹwho akpọ na kpobi .\n", "2020-01-18 14:14:13,541 Example #3\n", "2020-01-18 14:14:13,541 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 14:14:13,541 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 14:14:13,542 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 14:14:13,542 Validation result (greedy) at epoch 59, step 137000: bleu: 32.03, loss: 33723.2148, ppl: 4.3027, duration: 47.8398s\n", "2020-01-18 14:14:33,318 Epoch 59 Step: 137100 Batch Loss: 1.033795 Tokens per Sec: 10690, Lr: 0.000017\n", "2020-01-18 14:14:53,469 Epoch 59 Step: 137200 Batch Loss: 0.779332 Tokens per Sec: 11006, Lr: 0.000017\n", "2020-01-18 14:15:13,648 Epoch 59 Step: 137300 Batch Loss: 1.062398 Tokens per Sec: 10723, Lr: 0.000017\n", "2020-01-18 14:15:33,785 Epoch 59 Step: 137400 Batch Loss: 1.096039 Tokens per Sec: 10883, Lr: 0.000017\n", "2020-01-18 14:15:53,836 Epoch 59 Step: 137500 Batch Loss: 1.013650 Tokens per Sec: 11025, Lr: 0.000017\n", "2020-01-18 14:16:13,767 Epoch 59 Step: 137600 Batch Loss: 1.113077 Tokens per Sec: 10665, Lr: 0.000017\n", "2020-01-18 14:16:33,943 Epoch 59 Step: 137700 Batch Loss: 0.978418 Tokens per Sec: 11006, Lr: 0.000017\n", "2020-01-18 14:16:53,880 Epoch 59 Step: 137800 Batch Loss: 1.080619 Tokens per Sec: 10680, Lr: 0.000017\n", "2020-01-18 14:17:14,074 Epoch 59 Step: 137900 Batch Loss: 0.967079 Tokens per Sec: 10797, Lr: 0.000017\n", "2020-01-18 14:17:33,942 Epoch 59 Step: 138000 Batch Loss: 0.901934 Tokens per Sec: 10841, Lr: 0.000017\n", "2020-01-18 14:18:21,955 Example #0\n", "2020-01-18 14:18:21,956 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 14:18:21,956 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 14:18:21,956 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 14:18:21,957 Example #1\n", "2020-01-18 14:18:21,957 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 14:18:21,958 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 14:18:21,958 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 14:18:21,958 Example #2\n", "2020-01-18 14:18:21,958 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 14:18:21,959 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 14:18:21,959 \tHypothesis: Koyehọ , mai kpobi ma te rọ oghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai kpobi ; re o jiri ai erẹwho akpọ na kpobi ; re a jiri ei .\n", "2020-01-18 14:18:21,959 Example #3\n", "2020-01-18 14:18:21,959 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 14:18:21,959 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 14:18:21,959 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 14:18:21,960 Validation result (greedy) at epoch 59, step 138000: bleu: 32.12, loss: 33708.4102, ppl: 4.3000, duration: 48.0171s\n", "2020-01-18 14:18:41,820 Epoch 59 Step: 138100 Batch Loss: 1.140202 Tokens per Sec: 10710, Lr: 0.000017\n", "2020-01-18 14:19:01,876 Epoch 59 Step: 138200 Batch Loss: 0.956775 Tokens per Sec: 10816, Lr: 0.000017\n", "2020-01-18 14:19:21,909 Epoch 59 Step: 138300 Batch Loss: 1.017414 Tokens per Sec: 10726, Lr: 0.000017\n", "2020-01-18 14:19:42,020 Epoch 59 Step: 138400 Batch Loss: 1.142116 Tokens per Sec: 10769, Lr: 0.000017\n", "2020-01-18 14:19:47,435 Epoch 59: total training loss 2353.15\n", "2020-01-18 14:19:47,435 EPOCH 60\n", "2020-01-18 14:20:01,885 Epoch 60 Step: 138500 Batch Loss: 1.019883 Tokens per Sec: 10398, Lr: 0.000017\n", "2020-01-18 14:20:21,969 Epoch 60 Step: 138600 Batch Loss: 0.856663 Tokens per Sec: 10699, Lr: 0.000017\n", "2020-01-18 14:20:42,022 Epoch 60 Step: 138700 Batch Loss: 0.909071 Tokens per Sec: 10628, Lr: 0.000017\n", "2020-01-18 14:21:02,202 Epoch 60 Step: 138800 Batch Loss: 1.060097 Tokens per Sec: 10871, Lr: 0.000017\n", "2020-01-18 14:21:22,079 Epoch 60 Step: 138900 Batch Loss: 1.024773 Tokens per Sec: 10741, Lr: 0.000017\n", "2020-01-18 14:21:42,046 Epoch 60 Step: 139000 Batch Loss: 1.058103 Tokens per Sec: 10816, Lr: 0.000017\n", "2020-01-18 14:22:29,883 Example #0\n", "2020-01-18 14:22:29,884 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 14:22:29,884 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 14:22:29,884 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 14:22:29,884 Example #1\n", "2020-01-18 14:22:29,885 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 14:22:29,885 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 14:22:29,885 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 14:22:29,885 Example #2\n", "2020-01-18 14:22:29,886 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 14:22:29,886 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 14:22:29,886 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ fiba urru mai orọ edo ole owoma nana nọ o vọ avọ omosasọ na : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi i jiri ei .\n", "2020-01-18 14:22:29,886 Example #3\n", "2020-01-18 14:22:29,886 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 14:22:29,886 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 14:22:29,887 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 14:22:29,887 Validation result (greedy) at epoch 60, step 139000: bleu: 32.06, loss: 33735.4414, ppl: 4.3050, duration: 47.8406s\n", "2020-01-18 14:22:49,693 Epoch 60 Step: 139100 Batch Loss: 1.116315 Tokens per Sec: 10336, Lr: 0.000012\n", "2020-01-18 14:23:09,728 Epoch 60 Step: 139200 Batch Loss: 1.029794 Tokens per Sec: 10815, Lr: 0.000012\n", "2020-01-18 14:23:29,471 Epoch 60 Step: 139300 Batch Loss: 1.114183 Tokens per Sec: 10774, Lr: 0.000012\n", "2020-01-18 14:23:49,624 Epoch 60 Step: 139400 Batch Loss: 0.992689 Tokens per Sec: 10481, Lr: 0.000012\n", "2020-01-18 14:24:09,620 Epoch 60 Step: 139500 Batch Loss: 1.077939 Tokens per Sec: 10966, Lr: 0.000012\n", "2020-01-18 14:24:29,526 Epoch 60 Step: 139600 Batch Loss: 0.942895 Tokens per Sec: 10906, Lr: 0.000012\n", "2020-01-18 14:24:49,597 Epoch 60 Step: 139700 Batch Loss: 0.967666 Tokens per Sec: 11079, Lr: 0.000012\n", "2020-01-18 14:25:09,771 Epoch 60 Step: 139800 Batch Loss: 0.885479 Tokens per Sec: 10633, Lr: 0.000012\n", "2020-01-18 14:25:29,541 Epoch 60 Step: 139900 Batch Loss: 0.922754 Tokens per Sec: 10730, Lr: 0.000012\n", "2020-01-18 14:25:49,583 Epoch 60 Step: 140000 Batch Loss: 0.925974 Tokens per Sec: 10889, Lr: 0.000012\n", "2020-01-18 14:26:37,447 Example #0\n", "2020-01-18 14:26:37,448 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 14:26:37,448 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 14:26:37,449 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 14:26:37,449 Example #1\n", "2020-01-18 14:26:37,449 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 14:26:37,449 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 14:26:37,449 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 14:26:37,450 Example #2\n", "2020-01-18 14:26:37,450 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 14:26:37,450 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 14:26:37,450 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ fiba irru mai nọ i ti kuhọ evaọ abọ urere ọrọ ole owoma nana : “ Jọ odẹ riẹ [ koyehọ Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai , re erẹwho kpobi e jiri ei .\n", "2020-01-18 14:26:37,450 Example #3\n", "2020-01-18 14:26:37,451 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 14:26:37,451 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 14:26:37,451 \tHypothesis: Ghele na , eme unu - uwou e rẹ jọ ẹgba gaga re ma ru udhedhẹ .\n", "2020-01-18 14:26:37,451 Validation result (greedy) at epoch 60, step 140000: bleu: 32.17, loss: 33711.1914, ppl: 4.3005, duration: 47.8680s\n", "2020-01-18 14:26:57,392 Epoch 60 Step: 140100 Batch Loss: 0.866624 Tokens per Sec: 10806, Lr: 0.000012\n", "2020-01-18 14:27:17,328 Epoch 60 Step: 140200 Batch Loss: 1.075066 Tokens per Sec: 10811, Lr: 0.000012\n", "2020-01-18 14:27:37,330 Epoch 60 Step: 140300 Batch Loss: 1.146924 Tokens per Sec: 10726, Lr: 0.000012\n", "2020-01-18 14:27:57,450 Epoch 60 Step: 140400 Batch Loss: 0.884606 Tokens per Sec: 10810, Lr: 0.000012\n", "2020-01-18 14:28:17,186 Epoch 60 Step: 140500 Batch Loss: 0.982834 Tokens per Sec: 10678, Lr: 0.000012\n", "2020-01-18 14:28:37,069 Epoch 60 Step: 140600 Batch Loss: 1.127964 Tokens per Sec: 10720, Lr: 0.000012\n", "2020-01-18 14:28:56,876 Epoch 60 Step: 140700 Batch Loss: 0.957138 Tokens per Sec: 10699, Lr: 0.000012\n", "2020-01-18 14:29:11,678 Epoch 60: total training loss 2354.19\n", "2020-01-18 14:29:11,678 EPOCH 61\n", "2020-01-18 14:29:17,052 Epoch 61 Step: 140800 Batch Loss: 1.164707 Tokens per Sec: 10522, Lr: 0.000012\n", "2020-01-18 14:29:37,016 Epoch 61 Step: 140900 Batch Loss: 1.077950 Tokens per Sec: 10815, Lr: 0.000012\n", "2020-01-18 14:29:57,086 Epoch 61 Step: 141000 Batch Loss: 0.848870 Tokens per Sec: 10821, Lr: 0.000012\n", "2020-01-18 14:30:44,881 Example #0\n", "2020-01-18 14:30:44,882 \tSource: We can even ask God to ‘ create in us a pure heart . ’\n", "2020-01-18 14:30:44,882 \tReference: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ kẹ omai eva efuafo . ’\n", "2020-01-18 14:30:44,883 \tHypothesis: Ma rẹ sae tubẹ yare Ọghẹnẹ re ọ ‘ ma omai eva efuafo . ’\n", "2020-01-18 14:30:44,883 Example #1\n", "2020-01-18 14:30:44,883 \tSource: This was followed by Kingdom News No .\n", "2020-01-18 14:30:44,883 \tReference: U no ere no , a te siobọno obe usi ofa , Kingdom News No .\n", "2020-01-18 14:30:44,883 \tHypothesis: A te lele iei Usi Uvie Na , Ọrọ Avọ Ijo .\n", "2020-01-18 14:30:44,883 Example #2\n", "2020-01-18 14:30:44,884 \tSource: In effect , all of us will then joyfully add our voices to the concluding portion of this beautiful and heartwarming song : “ Let his name [ that of the King Jesus Christ ] prove to be to time indefinite ; before the sun let his name have increase , and by means of him let them bless themselves ; let all nations pronounce him happy .\n", "2020-01-18 14:30:44,884 \tReference: Mai kpobi ma te rọ oghọghọ ku irru mai gbe so abọ urere ọrọ ole omosasọ nana : “ Jọ odẹ riẹ [ ọrọ Jesu Kristi Ovie na ] o te jọ bẹdẹ bẹdẹ , re usi riẹ u ti do bẹse nọ akpọ ọ bẹoviẹ !\n", "2020-01-18 14:30:44,884 \tHypothesis: Koyehọ , mai kpobi ma te ghọghọ fiba urru mai ro ku ole owoma nana họ : “ Jọ odẹ riẹ [ koyehọ , Ovie na Jesu Kristi ] o jọ bẹdẹ ; re ọre o te lo , re odẹ riẹ u vihọ , re o jiri ai , re o jiri ai kpobi ; re erẹwho akpọ na kpobi e jiri ei .\n", "2020-01-18 14:30:44,884 Example #3\n", "2020-01-18 14:30:44,884 \tSource: Still , words of apology are a strong force toward making peace .\n", "2020-01-18 14:30:44,885 \tReference: Ghele na , eme unu - uwou u re fi obọ họ gaga evaọ eruo udhedhẹ .\n", "2020-01-18 14:30:44,885 \tHypothesis: Ghele na , eme unu - uwou yọ ẹgba ologbo nọ ma re ro ru udhedhẹ .\n", "2020-01-18 14:30:44,885 Validation result (greedy) at epoch 61, step 141000: bleu: 31.91, loss: 33715.4922, ppl: 4.3013, duration: 47.7983s\n", "2020-01-18 14:31:04,908 Epoch 61 Step: 141100 Batch Loss: 0.824282 Tokens per Sec: 11025, Lr: 0.000012\n", "2020-01-18 14:31:24,720 Epoch 61 Step: 141200 Batch Loss: 0.586740 Tokens per Sec: 10686, Lr: 0.000012\n", "2020-01-18 14:31:44,508 Epoch 61 Step: 141300 Batch Loss: 0.611458 Tokens per Sec: 10469, Lr: 0.000012\n", "2020-01-18 14:32:04,416 Epoch 61 Step: 141400 Batch Loss: 0.972249 Tokens per Sec: 10821, Lr: 0.000012\n" ], "name": "stdout" } ] }, { "cell_type": "code", "metadata": { "colab_type": "code", "id": "MBoDS09JM807", "colab": {} }, "source": [ "# Copy the created models from the notebook storage to google drive for persistant storage \n", "# !cp -r joeynmt/models/${src}${tgt}_transformer/* \"$gdrive_path/models/${src}${tgt}_transformer/\"" ], "execution_count": 0, "outputs": [] }, { "cell_type": "code", "metadata": { "colab_type": "code", "id": "n94wlrCjVc17", "outputId": "b4a3cfdf-9c2e-4905-a793-13f7bbcd6069", "colab": { "base_uri": "https://localhost:8080/", "height": 1000 } }, "source": [ "# Output our validation accuracy epoch 1-30\n", "! cat \"$gdrive_path/models/${src}${tgt}_transformer/validations.txt\"" ], "execution_count": 4, "outputs": [ { "output_type": "stream", "text": [ "Steps: 1000\tLoss: 93509.63281\tPPL: 57.18458\tbleu: 0.79657\tLR: 0.00030000\t*\n", "Steps: 2000\tLoss: 78938.61719\tPPL: 30.44061\tbleu: 2.99896\tLR: 0.00030000\t*\n", "Steps: 3000\tLoss: 69391.88281\tPPL: 20.13939\tbleu: 4.83686\tLR: 0.00030000\t*\n", "Steps: 4000\tLoss: 64425.82422\tPPL: 16.24508\tbleu: 5.98277\tLR: 0.00030000\t*\n", "Steps: 5000\tLoss: 58171.57812\tPPL: 12.39335\tbleu: 10.55439\tLR: 0.00030000\t*\n", "Steps: 6000\tLoss: 54539.60938\tPPL: 10.59095\tbleu: 13.09660\tLR: 0.00030000\t*\n", "Steps: 7000\tLoss: 51549.60547\tPPL: 9.30562\tbleu: 15.29174\tLR: 0.00030000\t*\n", "Steps: 8000\tLoss: 48991.14453\tPPL: 8.33040\tbleu: 17.44019\tLR: 0.00030000\t*\n", "Steps: 9000\tLoss: 47067.36719\tPPL: 7.66502\tbleu: 18.43572\tLR: 0.00030000\t*\n", "Steps: 10000\tLoss: 45932.45312\tPPL: 7.29769\tbleu: 19.83832\tLR: 0.00030000\t*\n", "Steps: 11000\tLoss: 44678.69531\tPPL: 6.91232\tbleu: 20.70975\tLR: 0.00030000\t*\n", "Steps: 12000\tLoss: 43474.63281\tPPL: 6.56140\tbleu: 21.65242\tLR: 0.00030000\t*\n", "Steps: 13000\tLoss: 42439.75391\tPPL: 6.27406\tbleu: 22.06882\tLR: 0.00030000\t*\n", "Steps: 14000\tLoss: 42425.46094\tPPL: 6.27018\tbleu: 22.58400\tLR: 0.00030000\t*\n", "Steps: 15000\tLoss: 41134.49609\tPPL: 5.92952\tbleu: 23.28281\tLR: 0.00030000\t*\n", "Steps: 16000\tLoss: 40746.80078\tPPL: 5.83088\tbleu: 24.15591\tLR: 0.00030000\t*\n", "Steps: 17000\tLoss: 40108.57812\tPPL: 5.67205\tbleu: 24.69793\tLR: 0.00030000\t*\n", "Steps: 18000\tLoss: 39395.83594\tPPL: 5.49979\tbleu: 24.89785\tLR: 0.00030000\t*\n", "Steps: 19000\tLoss: 39077.63281\tPPL: 5.42458\tbleu: 25.16983\tLR: 0.00030000\t*\n", "Steps: 20000\tLoss: 38751.57422\tPPL: 5.34858\tbleu: 25.33372\tLR: 0.00030000\t*\n", "Steps: 21000\tLoss: 38392.22266\tPPL: 5.26606\tbleu: 25.50269\tLR: 0.00030000\t*\n", "Steps: 22000\tLoss: 38281.65625\tPPL: 5.24092\tbleu: 25.74633\tLR: 0.00030000\t*\n", "Steps: 23000\tLoss: 37930.99219\tPPL: 5.16200\tbleu: 25.67208\tLR: 0.00030000\t*\n", "Steps: 24000\tLoss: 37916.49609\tPPL: 5.15876\tbleu: 26.35945\tLR: 0.00030000\t*\n", "Steps: 25000\tLoss: 37368.57422\tPPL: 5.03789\tbleu: 26.56698\tLR: 0.00030000\t*\n", "Steps: 26000\tLoss: 37189.56641\tPPL: 4.99902\tbleu: 26.89408\tLR: 0.00030000\t*\n", "Steps: 27000\tLoss: 36990.91406\tPPL: 4.95623\tbleu: 27.03527\tLR: 0.00030000\t*\n", "Steps: 28000\tLoss: 36714.25391\tPPL: 4.89725\tbleu: 27.29722\tLR: 0.00030000\t*\n", "Steps: 29000\tLoss: 37003.57812\tPPL: 4.95895\tbleu: 27.49769\tLR: 0.00030000\t\n", "Steps: 30000\tLoss: 36578.57422\tPPL: 4.86858\tbleu: 27.26265\tLR: 0.00030000\t*\n", "Steps: 31000\tLoss: 36510.46094\tPPL: 4.85425\tbleu: 27.44769\tLR: 0.00030000\t*\n", "Steps: 32000\tLoss: 36220.87500\tPPL: 4.79381\tbleu: 27.88285\tLR: 0.00030000\t*\n", "Steps: 33000\tLoss: 36649.05859\tPPL: 4.88345\tbleu: 27.71923\tLR: 0.00030000\t\n", "Steps: 34000\tLoss: 36003.99609\tPPL: 4.74903\tbleu: 27.64995\tLR: 0.00030000\t*\n", "Steps: 35000\tLoss: 35898.00391\tPPL: 4.72730\tbleu: 28.24687\tLR: 0.00030000\t*\n", "Steps: 36000\tLoss: 36018.22656\tPPL: 4.75195\tbleu: 28.31105\tLR: 0.00030000\t\n", "Steps: 37000\tLoss: 35545.47266\tPPL: 4.65573\tbleu: 28.76556\tLR: 0.00030000\t*\n", "Steps: 38000\tLoss: 35780.06250\tPPL: 4.70323\tbleu: 28.58084\tLR: 0.00030000\t\n", "Steps: 39000\tLoss: 35450.56250\tPPL: 4.63665\tbleu: 28.59958\tLR: 0.00030000\t*\n", "Steps: 40000\tLoss: 35579.92188\tPPL: 4.66268\tbleu: 28.59829\tLR: 0.00030000\t\n", "Steps: 41000\tLoss: 35408.59766\tPPL: 4.62824\tbleu: 28.93728\tLR: 0.00030000\t*\n", "Steps: 42000\tLoss: 35205.01172\tPPL: 4.58765\tbleu: 28.68419\tLR: 0.00030000\t*\n", "Steps: 43000\tLoss: 35346.22656\tPPL: 4.61576\tbleu: 28.76264\tLR: 0.00030000\t\n", "Steps: 44000\tLoss: 35156.05078\tPPL: 4.57794\tbleu: 28.91433\tLR: 0.00030000\t*\n", "Steps: 45000\tLoss: 35223.78516\tPPL: 4.59137\tbleu: 29.42202\tLR: 0.00030000\t\n", "Steps: 46000\tLoss: 34995.01562\tPPL: 4.54615\tbleu: 28.95550\tLR: 0.00030000\t*\n", "Steps: 47000\tLoss: 34964.62500\tPPL: 4.54017\tbleu: 29.08930\tLR: 0.00030000\t*\n", "Steps: 48000\tLoss: 34925.32422\tPPL: 4.53246\tbleu: 28.96273\tLR: 0.00030000\t*\n", "Steps: 49000\tLoss: 34836.83203\tPPL: 4.51514\tbleu: 29.08676\tLR: 0.00030000\t*\n", "Steps: 50000\tLoss: 34988.95312\tPPL: 4.54496\tbleu: 29.51394\tLR: 0.00030000\t\n", "Steps: 51000\tLoss: 34817.03516\tPPL: 4.51127\tbleu: 29.74650\tLR: 0.00030000\t*\n", "Steps: 52000\tLoss: 34967.67578\tPPL: 4.54077\tbleu: 29.48327\tLR: 0.00030000\t\n", "Steps: 53000\tLoss: 34793.44922\tPPL: 4.50667\tbleu: 29.82630\tLR: 0.00030000\t*\n", "Steps: 54000\tLoss: 34634.90625\tPPL: 4.47586\tbleu: 29.67973\tLR: 0.00030000\t*\n", "Steps: 55000\tLoss: 34746.24219\tPPL: 4.49747\tbleu: 29.89915\tLR: 0.00030000\t\n", "Steps: 56000\tLoss: 34388.37500\tPPL: 4.42836\tbleu: 30.20815\tLR: 0.00030000\t*\n", "Steps: 57000\tLoss: 34675.38672\tPPL: 4.48370\tbleu: 29.70966\tLR: 0.00030000\t\n", "Steps: 58000\tLoss: 34435.10156\tPPL: 4.43733\tbleu: 29.58619\tLR: 0.00030000\t\n", "Steps: 59000\tLoss: 34613.44531\tPPL: 4.47170\tbleu: 29.75943\tLR: 0.00030000\t\n", "Steps: 60000\tLoss: 34748.67969\tPPL: 4.49795\tbleu: 30.00809\tLR: 0.00030000\t\n", "Steps: 61000\tLoss: 34362.52344\tPPL: 4.42341\tbleu: 29.94439\tLR: 0.00030000\t*\n", "Steps: 62000\tLoss: 34572.65234\tPPL: 4.46382\tbleu: 29.72617\tLR: 0.00030000\t\n", "Steps: 63000\tLoss: 34222.00391\tPPL: 4.39660\tbleu: 30.50540\tLR: 0.00030000\t*\n", "Steps: 64000\tLoss: 34579.42969\tPPL: 4.46513\tbleu: 29.90505\tLR: 0.00030000\t\n", "Steps: 65000\tLoss: 34338.70703\tPPL: 4.41886\tbleu: 30.55762\tLR: 0.00030000\t\n", "Steps: 66000\tLoss: 34369.10156\tPPL: 4.42467\tbleu: 30.35724\tLR: 0.00030000\t\n", "Steps: 67000\tLoss: 34455.42969\tPPL: 4.44123\tbleu: 30.09849\tLR: 0.00030000\t\n", "Steps: 68000\tLoss: 33938.24219\tPPL: 4.34294\tbleu: 30.41320\tLR: 0.00030000\t*\n", "Steps: 69000\tLoss: 34340.44141\tPPL: 4.41919\tbleu: 30.30439\tLR: 0.00030000\t\n", "Steps: 70000\tLoss: 34286.70312\tPPL: 4.40892\tbleu: 30.24083\tLR: 0.00030000\t\n", "Steps: 71000\tLoss: 34302.82812\tPPL: 4.41200\tbleu: 30.34001\tLR: 0.00030000\t\n", "Steps: 72000\tLoss: 34168.87109\tPPL: 4.38650\tbleu: 30.38804\tLR: 0.00030000\t\n", "Steps: 73000\tLoss: 34083.26953\tPPL: 4.37028\tbleu: 30.81417\tLR: 0.00030000\t\n", "Steps: 74000\tLoss: 34243.05078\tPPL: 4.40060\tbleu: 31.10069\tLR: 0.00021000\t\n", "Steps: 75000\tLoss: 33749.22266\tPPL: 4.30757\tbleu: 31.00232\tLR: 0.00021000\t*\n", "Steps: 76000\tLoss: 33998.85938\tPPL: 4.35435\tbleu: 30.68478\tLR: 0.00021000\t\n", "Steps: 77000\tLoss: 33832.44531\tPPL: 4.32311\tbleu: 31.24649\tLR: 0.00021000\t\n", "Steps: 78000\tLoss: 34038.20703\tPPL: 4.36177\tbleu: 31.19323\tLR: 0.00021000\t\n", "Steps: 79000\tLoss: 34038.11328\tPPL: 4.36175\tbleu: 30.70023\tLR: 0.00021000\t\n", "Steps: 80000\tLoss: 34040.48047\tPPL: 4.36220\tbleu: 30.99566\tLR: 0.00021000\t\n", "Steps: 81000\tLoss: 34073.12500\tPPL: 4.36836\tbleu: 30.97407\tLR: 0.00014700\t\n", "Steps: 82000\tLoss: 33799.95703\tPPL: 4.31703\tbleu: 30.98885\tLR: 0.00014700\t\n", "Steps: 83000\tLoss: 33814.20703\tPPL: 4.31970\tbleu: 31.56635\tLR: 0.00014700\t\n", "Steps: 84000\tLoss: 33762.57031\tPPL: 4.31005\tbleu: 31.47214\tLR: 0.00014700\t\n", "Steps: 85000\tLoss: 33862.40625\tPPL: 4.32871\tbleu: 30.97542\tLR: 0.00014700\t\n", "Steps: 86000\tLoss: 33835.00391\tPPL: 4.32359\tbleu: 31.14761\tLR: 0.00014700\t\n", "Steps: 87000\tLoss: 33759.92969\tPPL: 4.30956\tbleu: 31.44929\tLR: 0.00010290\t\n", "Steps: 88000\tLoss: 33761.51953\tPPL: 4.30986\tbleu: 31.42530\tLR: 0.00010290\t\n", "Steps: 89000\tLoss: 33701.60547\tPPL: 4.29870\tbleu: 31.63896\tLR: 0.00010290\t*\n", "Steps: 90000\tLoss: 33686.86328\tPPL: 4.29596\tbleu: 31.41007\tLR: 0.00010290\t*\n", "Steps: 91000\tLoss: 33661.72266\tPPL: 4.29129\tbleu: 31.83504\tLR: 0.00010290\t*\n", "Steps: 92000\tLoss: 33806.46484\tPPL: 4.31825\tbleu: 31.32163\tLR: 0.00010290\t\n", "Steps: 93000\tLoss: 33756.89844\tPPL: 4.30900\tbleu: 31.48890\tLR: 0.00010290\t\n", "Steps: 94000\tLoss: 33767.60547\tPPL: 4.31099\tbleu: 31.54743\tLR: 0.00010290\t\n", "Steps: 95000\tLoss: 33717.99219\tPPL: 4.30175\tbleu: 31.76260\tLR: 0.00010290\t\n", "Steps: 96000\tLoss: 33647.05859\tPPL: 4.28857\tbleu: 31.59981\tLR: 0.00010290\t*\n", "Steps: 97000\tLoss: 33808.85156\tPPL: 4.31870\tbleu: 31.58069\tLR: 0.00010290\t\n", "Steps: 98000\tLoss: 33645.64453\tPPL: 4.28830\tbleu: 31.43079\tLR: 0.00010290\t*\n", "Steps: 99000\tLoss: 33846.69922\tPPL: 4.32577\tbleu: 31.49558\tLR: 0.00010290\t\n", "Steps: 100000\tLoss: 33655.17578\tPPL: 4.29007\tbleu: 31.83752\tLR: 0.00010290\t\n", "Steps: 101000\tLoss: 33830.52344\tPPL: 4.32275\tbleu: 31.49787\tLR: 0.00010290\t\n", "Steps: 102000\tLoss: 33714.88672\tPPL: 4.30117\tbleu: 31.51746\tLR: 0.00010290\t\n", "Steps: 103000\tLoss: 33634.53906\tPPL: 4.28624\tbleu: 31.29985\tLR: 0.00010290\t*\n", "Steps: 104000\tLoss: 33786.35938\tPPL: 4.31449\tbleu: 31.48457\tLR: 0.00010290\t\n", "Steps: 105000\tLoss: 33814.82422\tPPL: 4.31981\tbleu: 31.30868\tLR: 0.00010290\t\n", "Steps: 106000\tLoss: 33877.23047\tPPL: 4.33149\tbleu: 31.45028\tLR: 0.00010290\t\n", "Steps: 107000\tLoss: 33786.78906\tPPL: 4.31457\tbleu: 31.85954\tLR: 0.00010290\t\n", "Steps: 108000\tLoss: 33649.16406\tPPL: 4.28896\tbleu: 31.45331\tLR: 0.00010290\t\n", "Steps: 109000\tLoss: 33897.36719\tPPL: 4.33527\tbleu: 31.95064\tLR: 0.00007203\t\n", "Steps: 110000\tLoss: 33739.96094\tPPL: 4.30584\tbleu: 31.70407\tLR: 0.00007203\t\n", "Steps: 111000\tLoss: 33821.21875\tPPL: 4.32101\tbleu: 31.77567\tLR: 0.00007203\t\n", "Steps: 112000\tLoss: 33771.80078\tPPL: 4.31178\tbleu: 31.45322\tLR: 0.00007203\t\n", "Steps: 113000\tLoss: 33816.55078\tPPL: 4.32013\tbleu: 31.50992\tLR: 0.00007203\t\n", "Steps: 114000\tLoss: 33820.06250\tPPL: 4.32079\tbleu: 31.77082\tLR: 0.00007203\t\n", "Steps: 115000\tLoss: 33676.33594\tPPL: 4.29400\tbleu: 31.78437\tLR: 0.00005042\t\n", "Steps: 116000\tLoss: 33737.48438\tPPL: 4.30538\tbleu: 31.85212\tLR: 0.00005042\t\n", "Steps: 117000\tLoss: 33689.58203\tPPL: 4.29646\tbleu: 31.83483\tLR: 0.00005042\t\n", "Steps: 118000\tLoss: 33797.64844\tPPL: 4.31660\tbleu: 32.06285\tLR: 0.00005042\t\n", "Steps: 119000\tLoss: 33727.82031\tPPL: 4.30358\tbleu: 31.91600\tLR: 0.00005042\t\n", "Steps: 120000\tLoss: 33856.61719\tPPL: 4.32763\tbleu: 32.28520\tLR: 0.00005042\t\n", "Steps: 121000\tLoss: 33806.57031\tPPL: 4.31827\tbleu: 31.93042\tLR: 0.00003529\t\n", "Steps: 122000\tLoss: 33701.98828\tPPL: 4.29877\tbleu: 31.92570\tLR: 0.00003529\t\n", "Steps: 123000\tLoss: 33720.05469\tPPL: 4.30213\tbleu: 31.67747\tLR: 0.00003529\t\n", "Steps: 124000\tLoss: 33731.68750\tPPL: 4.30430\tbleu: 32.20773\tLR: 0.00003529\t\n", "Steps: 125000\tLoss: 33825.48047\tPPL: 4.32180\tbleu: 32.00791\tLR: 0.00003529\t\n", "Steps: 126000\tLoss: 33718.53125\tPPL: 4.30185\tbleu: 31.91015\tLR: 0.00003529\t\n", "Steps: 127000\tLoss: 33780.00391\tPPL: 4.31331\tbleu: 31.76055\tLR: 0.00002471\t\n", "Steps: 128000\tLoss: 33754.73438\tPPL: 4.30859\tbleu: 31.87169\tLR: 0.00002471\t\n", "Steps: 129000\tLoss: 33687.94922\tPPL: 4.29616\tbleu: 32.02235\tLR: 0.00002471\t\n", "Steps: 130000\tLoss: 33733.69922\tPPL: 4.30467\tbleu: 31.97792\tLR: 0.00002471\t\n", "Steps: 131000\tLoss: 33758.10547\tPPL: 4.30922\tbleu: 32.02162\tLR: 0.00002471\t\n", "Steps: 132000\tLoss: 33710.28906\tPPL: 4.30032\tbleu: 31.86285\tLR: 0.00002471\t\n", "Steps: 133000\tLoss: 33732.83984\tPPL: 4.30451\tbleu: 31.95922\tLR: 0.00001729\t\n", "Steps: 134000\tLoss: 33695.57422\tPPL: 4.29758\tbleu: 31.86053\tLR: 0.00001729\t\n", "Steps: 135000\tLoss: 33734.15625\tPPL: 4.30476\tbleu: 32.22820\tLR: 0.00001729\t\n", "Steps: 136000\tLoss: 33736.73828\tPPL: 4.30524\tbleu: 31.95458\tLR: 0.00001729\t\n", "Steps: 137000\tLoss: 33723.21484\tPPL: 4.30272\tbleu: 32.03408\tLR: 0.00001729\t\n", "Steps: 138000\tLoss: 33708.41016\tPPL: 4.29997\tbleu: 32.11916\tLR: 0.00001729\t\n", "Steps: 139000\tLoss: 33735.44141\tPPL: 4.30500\tbleu: 32.05817\tLR: 0.00001211\t\n", "Steps: 140000\tLoss: 33711.19141\tPPL: 4.30048\tbleu: 32.16626\tLR: 0.00001211\t\n", "Steps: 141000\tLoss: 33715.49219\tPPL: 4.30128\tbleu: 31.90833\tLR: 0.00001211\t\n" ], "name": "stdout" } ] }, { "cell_type": "code", "metadata": { "colab_type": "code", "id": "66WhRE9lIhoD", "outputId": "ed5ebf8e-fb2a-4cd5-e783-8442b819a4aa", "colab": { "base_uri": "https://localhost:8080/", "height": 68 } }, "source": [ "# Test our model\n", "! cd joeynmt; python3 -m joeynmt test \"$gdrive_path/models/${src}${tgt}_transformer/config.yaml\"" ], "execution_count": 6, "outputs": [ { "output_type": "stream", "text": [ "2020-01-18 21:46:50,028 Hello! This is Joey-NMT.\n", "2020-01-18 21:48:06,135 dev bleu: 32.38 [Beam search decoding with beam size = 5 and alpha = 1.0]\n", "2020-01-18 21:48:52,667 test bleu: 38.91 [Beam search decoding with beam size = 5 and alpha = 1.0]\n" ], "name": "stdout" } ] } ] }