{"action":"created","issue":{"url":"https://api.github.com/repos/renll/RSAM/issues/1","repository_url":"https://api.github.com/repos/renll/RSAM","labels_url":"https://api.github.com/repos/renll/RSAM/issues/1/labels{/name}","comments_url":"https://api.github.com/repos/renll/RSAM/issues/1/comments","events_url":"https://api.github.com/repos/renll/RSAM/issues/1/events","html_url":"https://github.com/renll/RSAM/issues/1","id":226449494,"number":1,"title":"optimizer error?","user":{"login":"WERush","id":3814027,"avatar_url":"https://avatars3.githubusercontent.com/u/3814027?v=3","gravatar_id":"","url":"https://api.github.com/users/WERush","html_url":"https://github.com/WERush","followers_url":"https://api.github.com/users/WERush/followers","following_url":"https://api.github.com/users/WERush/following{/other_user}","gists_url":"https://api.github.com/users/WERush/gists{/gist_id}","starred_url":"https://api.github.com/users/WERush/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/WERush/subscriptions","organizations_url":"https://api.github.com/users/WERush/orgs","repos_url":"https://api.github.com/users/WERush/repos","events_url":"https://api.github.com/users/WERush/events{/privacy}","received_events_url":"https://api.github.com/users/WERush/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2017-05-05T01:11:42Z","updated_at":"2017-05-06T03:46:23Z","closed_at":null,"body":"In this line, https://github.com/renll/RSAM/blob/master/RSAM2layerLOC2.py#L230, you define a new optimizer at every batch. Is it right? \r\nI think that optimizer should be initialized at the start only once, and so it can change the parameters in the model and hyperparameters in itself with the epoch goes by. "},"comment":{"url":"https://api.github.com/repos/renll/RSAM/issues/comments/299613225","html_url":"https://github.com/renll/RSAM/issues/1#issuecomment-299613225","issue_url":"https://api.github.com/repos/renll/RSAM/issues/1","id":299613225,"user":{"login":"renll","id":11554003,"avatar_url":"https://avatars1.githubusercontent.com/u/11554003?v=3","gravatar_id":"","url":"https://api.github.com/users/renll","html_url":"https://github.com/renll","followers_url":"https://api.github.com/users/renll/followers","following_url":"https://api.github.com/users/renll/following{/other_user}","gists_url":"https://api.github.com/users/renll/gists{/gist_id}","starred_url":"https://api.github.com/users/renll/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/renll/subscriptions","organizations_url":"https://api.github.com/users/renll/orgs","repos_url":"https://api.github.com/users/renll/repos","events_url":"https://api.github.com/users/renll/events{/privacy}","received_events_url":"https://api.github.com/users/renll/received_events","type":"User","site_admin":false},"created_at":"2017-05-06T03:46:23Z","updated_at":"2017-05-06T03:46:23Z","body":"You can check the Pytorch example Word level Language Modeling using LSTM RNNs and prove that my optimizer is the same as the version that without gradient clips.\r\n"}}
{"actor":{"display_login":"renll"}}