{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/tensor2tensor/issues/67","repository_url":"https://api.github.com/repos/tensorflow/tensor2tensor","labels_url":"https://api.github.com/repos/tensorflow/tensor2tensor/issues/67/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/tensor2tensor/issues/67/comments","events_url":"https://api.github.com/repos/tensorflow/tensor2tensor/issues/67/events","html_url":"https://github.com/tensorflow/tensor2tensor/issues/67","id":239253854,"number":67,"title":"Something wrong with the decoder result of Walkthrough example","user":{"login":"lovecambi","id":7774179,"avatar_url":"https://avatars0.githubusercontent.com/u/7774179?v=3","gravatar_id":"","url":"https://api.github.com/users/lovecambi","html_url":"https://github.com/lovecambi","followers_url":"https://api.github.com/users/lovecambi/followers","following_url":"https://api.github.com/users/lovecambi/following{/other_user}","gists_url":"https://api.github.com/users/lovecambi/gists{/gist_id}","starred_url":"https://api.github.com/users/lovecambi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lovecambi/subscriptions","organizations_url":"https://api.github.com/users/lovecambi/orgs","repos_url":"https://api.github.com/users/lovecambi/repos","events_url":"https://api.github.com/users/lovecambi/events{/privacy}","received_events_url":"https://api.github.com/users/lovecambi/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2017-06-28T18:27:51Z","updated_at":"2017-06-29T16:43:19Z","closed_at":"2017-06-29T16:43:19Z","body":"I trained the model on two Tesla M60s, each of which is 8G. I did not modify any hyper-parameter. The loss seems not change after 50000 steps. \r\n```\r\nINFO:tensorflow:Saving checkpoints for 54877 into /data/t2t/t2t_train/wmt_ende_tokens_32k/transformer-transformer_base/model.ckpt.\r\nINFO:tensorflow:global_step/sec: 0.858429\r\nINFO:tensorflow:loss = 1.96779, step = 54901 (116.492 sec)\r\nINFO:tensorflow:global_step/sec: 0.876813\r\nINFO:tensorflow:loss = 1.96174, step = 55001 (114.049 sec)\r\nINFO:tensorflow:global_step/sec: 0.864947\r\nINFO:tensorflow:loss = 1.98628, step = 55101 (115.614 sec)\r\nINFO:tensorflow:global_step/sec: 0.860629\r\nINFO:tensorflow:loss = 2.26156, step = 55201 (116.195 sec)\r\nINFO:tensorflow:global_step/sec: 0.864128\r\nINFO:tensorflow:loss = 1.98318, step = 55301 (115.723 sec)\r\nINFO:tensorflow:Saving checkpoints for 55396 into /data/t2t/t2t_train/wmt_ende_tokens_32k/transformer-transformer_base/model.ckpt.\r\nINFO:tensorflow:global_step/sec: 0.852946\r\nINFO:tensorflow:loss = 2.30657, step = 55401 (117.241 sec)\r\nINFO:tensorflow:global_step/sec: 0.870939\r\nINFO:tensorflow:loss = 2.11571, step = 55501 (114.819 sec)\r\nINFO:tensorflow:global_step/sec: 0.86979\r\nINFO:tensorflow:loss = 1.99461, step = 55601 (114.970 sec)\r\nINFO:tensorflow:global_step/sec: 0.86269\r\nINFO:tensorflow:loss = 2.01496, step = 55701 (115.916 sec)\r\nINFO:tensorflow:global_step/sec: 0.869183\r\nINFO:tensorflow:loss = 1.98261, step = 55801 (115.051 sec)\r\nINFO:tensorflow:global_step/sec: 0.862935\r\nINFO:tensorflow:loss = 1.88075, step = 55901 (115.883 sec)\r\nINFO:tensorflow:Saving checkpoints for 55915 into /data/t2t/t2t_train/wmt_ende_tokens_32k/transformer-transformer_base/model.ckpt.\r\nINFO:tensorflow:global_step/sec: 0.855085\r\nINFO:tensorflow:loss = 1.9415, step = 56001 (116.948 sec)\r\nINFO:tensorflow:global_step/sec: 0.86353\r\nINFO:tensorflow:loss = 2.26614, step = 56101 (115.804 sec)\r\nINFO:tensorflow:global_step/sec: 0.871136\r\nINFO:tensorflow:loss = 2.14308, step = 56201 (114.793 sec)\r\nINFO:tensorflow:global_step/sec: 0.860752\r\nINFO:tensorflow:loss = 1.96734, step = 56301 (116.178 sec)\r\nINFO:tensorflow:global_step/sec: 0.871609\r\nINFO:tensorflow:loss = 1.98928, step = 56401 (114.730 sec)\r\n```\r\n\r\nHowever, the decoder result does not make any sense. Anyone knows the reason?\r\n```\r\nINFO:tensorflow:Inference results INPUT: Goodbye world\r\nINFO:tensorflow:Inference results OUTPUT: Esconnectentareaconnectentkannconnectent\r\nINFO:tensorflow:Inference results INPUT: Hello world\r\nINFO:tensorflow:Inference results OUTPUT: Esconnectentareaconnectentkannconnectent\r\n```"},"comment":{"url":"https://api.github.com/repos/tensorflow/tensor2tensor/issues/comments/312024397","html_url":"https://github.com/tensorflow/tensor2tensor/issues/67#issuecomment-312024397","issue_url":"https://api.github.com/repos/tensorflow/tensor2tensor/issues/67","id":312024397,"user":{"login":"lukaszkaiser","id":684901,"avatar_url":"https://avatars2.githubusercontent.com/u/684901?v=3","gravatar_id":"","url":"https://api.github.com/users/lukaszkaiser","html_url":"https://github.com/lukaszkaiser","followers_url":"https://api.github.com/users/lukaszkaiser/followers","following_url":"https://api.github.com/users/lukaszkaiser/following{/other_user}","gists_url":"https://api.github.com/users/lukaszkaiser/gists{/gist_id}","starred_url":"https://api.github.com/users/lukaszkaiser/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lukaszkaiser/subscriptions","organizations_url":"https://api.github.com/users/lukaszkaiser/orgs","repos_url":"https://api.github.com/users/lukaszkaiser/repos","events_url":"https://api.github.com/users/lukaszkaiser/events{/privacy}","received_events_url":"https://api.github.com/users/lukaszkaiser/received_events","type":"User","site_admin":false},"created_at":"2017-06-29T16:43:19Z","updated_at":"2017-06-29T16:43:19Z","body":"Thanks, I'm happy that it works now!"}}
{"actor":{"display_login":"lukaszkaiser"}}