{"action":"opened","issue":{"url":"https://api.github.com/repos/SwordYork/DCNMT/issues/11","repository_url":"https://api.github.com/repos/SwordYork/DCNMT","labels_url":"https://api.github.com/repos/SwordYork/DCNMT/issues/11/labels{/name}","comments_url":"https://api.github.com/repos/SwordYork/DCNMT/issues/11/comments","events_url":"https://api.github.com/repos/SwordYork/DCNMT/issues/11/events","html_url":"https://github.com/SwordYork/DCNMT/issues/11","id":215010816,"number":11,"title":"increasing the dept of the model","user":{"login":"kadir-gunel","id":7396849,"avatar_url":"https://avatars0.githubusercontent.com/u/7396849?v=3","gravatar_id":"","url":"https://api.github.com/users/kadir-gunel","html_url":"https://github.com/kadir-gunel","followers_url":"https://api.github.com/users/kadir-gunel/followers","following_url":"https://api.github.com/users/kadir-gunel/following{/other_user}","gists_url":"https://api.github.com/users/kadir-gunel/gists{/gist_id}","starred_url":"https://api.github.com/users/kadir-gunel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kadir-gunel/subscriptions","organizations_url":"https://api.github.com/users/kadir-gunel/orgs","repos_url":"https://api.github.com/users/kadir-gunel/repos","events_url":"https://api.github.com/users/kadir-gunel/events{/privacy}","received_events_url":"https://api.github.com/users/kadir-gunel/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2017-03-17T13:57:35Z","updated_at":"2017-03-17T13:57:35Z","closed_at":null,"body":"Hello @SwordYork ,\r\n\r\nAre these parameters used for determining the depth of the model ? \r\n\r\n- config['src_dgru_depth'] = 1\r\n- config['bidir_encoder_depth'] = 2  # crucial\r\n- config['transition_depth'] = 1\r\n- config['trg_dgru_depth'] = 1\r\n- config['trg_igru_depth'] = 1\r\n\r\nI am planning to deepen the model. \r\nWhich one would you suggest : \r\n\r\n1.  adding additional layers for both encoder and decoder\r\n2.  or increment number of hidden unit size?\r\n\r\nI have been training more than 10 days with nearly 1M parallel corpora but when I evaluate the model, after 1M iterations, with test set I get 0 for Blue which seems awkward. Because I have trained once with a different parallel corpora (nearly 20M sentence pairs) and at least the 1-gram evaluation in Blue was around 26.5 and the overall BLEU near 3.50 .\r\n\r\nAlso I noticed, after 3 days, that in the source language the number of chars is 110, and the target language has 220 chars. And I set both to 120. :disappointed: .  Could this be the root of the failure ? (But in terms of morphology, interestingly,  word translations look fine.)\r\n\r\nDo you think continuing training is a good idea? \r\n\r\nB.R.\r\nKadir\r\n"}}
{"actor":{"display_login":"kadir-gunel"}}