{"action":"created","issue":{"url":"https://api.github.com/repos/rdspring1/PyTorch_GBW_LM/issues/2","repository_url":"https://api.github.com/repos/rdspring1/PyTorch_GBW_LM","labels_url":"https://api.github.com/repos/rdspring1/PyTorch_GBW_LM/issues/2/labels{/name}","comments_url":"https://api.github.com/repos/rdspring1/PyTorch_GBW_LM/issues/2/comments","events_url":"https://api.github.com/repos/rdspring1/PyTorch_GBW_LM/issues/2/events","html_url":"https://github.com/rdspring1/PyTorch_GBW_LM/issues/2","id":283429531,"number":2,"title":"state of the art performance?","user":{"login":"eric-haibin-lin","id":5545640,"avatar_url":"https://avatars1.githubusercontent.com/u/5545640?v=4","gravatar_id":"","url":"https://api.github.com/users/eric-haibin-lin","html_url":"https://github.com/eric-haibin-lin","followers_url":"https://api.github.com/users/eric-haibin-lin/followers","following_url":"https://api.github.com/users/eric-haibin-lin/following{/other_user}","gists_url":"https://api.github.com/users/eric-haibin-lin/gists{/gist_id}","starred_url":"https://api.github.com/users/eric-haibin-lin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/eric-haibin-lin/subscriptions","organizations_url":"https://api.github.com/users/eric-haibin-lin/orgs","repos_url":"https://api.github.com/users/eric-haibin-lin/repos","events_url":"https://api.github.com/users/eric-haibin-lin/events{/privacy}","received_events_url":"https://api.github.com/users/eric-haibin-lin/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2017-12-20T02:24:07Z","updated_at":"2017-12-30T16:57:16Z","closed_at":"2017-12-27T05:39:25Z","author_association":"NONE","body":"Nice work! I have a question regarding the result:\r\nIn the paper \"Exploring the limits of language modeling\", it reports test ppl of 54.1 using LSTM-512-512. Does it mean two 2 layers are used in the paper, while your result is obtained from 4 layers ? If so, what makes the difference? "},"comment":{"url":"https://api.github.com/repos/rdspring1/PyTorch_GBW_LM/issues/comments/354556236","html_url":"https://github.com/rdspring1/PyTorch_GBW_LM/issues/2#issuecomment-354556236","issue_url":"https://api.github.com/repos/rdspring1/PyTorch_GBW_LM/issues/2","id":354556236,"user":{"login":"rdspring1","id":3637896,"avatar_url":"https://avatars2.githubusercontent.com/u/3637896?v=4","gravatar_id":"","url":"https://api.github.com/users/rdspring1","html_url":"https://github.com/rdspring1","followers_url":"https://api.github.com/users/rdspring1/followers","following_url":"https://api.github.com/users/rdspring1/following{/other_user}","gists_url":"https://api.github.com/users/rdspring1/gists{/gist_id}","starred_url":"https://api.github.com/users/rdspring1/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rdspring1/subscriptions","organizations_url":"https://api.github.com/users/rdspring1/orgs","repos_url":"https://api.github.com/users/rdspring1/repos","events_url":"https://api.github.com/users/rdspring1/events{/privacy}","received_events_url":"https://api.github.com/users/rdspring1/received_events","type":"User","site_admin":false},"created_at":"2017-12-30T16:57:16Z","updated_at":"2017-12-30T16:57:16Z","author_association":"OWNER","body":"Sorry for the slow reply! I've been busy fine-tuning the hyperparameters, fixing small bugs, and reproducing the results. The latest model reports test ppl of 46.47 using LSTM 2048-256 - a single-layer lstm with 256 projection layer. You can run the model on a single gpu - (1080 Ti or higher) to reproduce the results."}}
{"actor":{"display_login":"rdspring1"}}