{"action":"created","issue":{"url":"https://api.github.com/repos/SeanNaren/deepspeech.pytorch/issues/173","repository_url":"https://api.github.com/repos/SeanNaren/deepspeech.pytorch","labels_url":"https://api.github.com/repos/SeanNaren/deepspeech.pytorch/issues/173/labels{/name}","comments_url":"https://api.github.com/repos/SeanNaren/deepspeech.pytorch/issues/173/comments","events_url":"https://api.github.com/repos/SeanNaren/deepspeech.pytorch/issues/173/events","html_url":"https://github.com/SeanNaren/deepspeech.pytorch/issues/173","id":271178649,"number":173,"title":"Pre-trained model shows more CER than when it was trained and saved","user":{"login":"bishwa420","id":12081798,"avatar_url":"https://avatars3.githubusercontent.com/u/12081798?v=4","gravatar_id":"","url":"https://api.github.com/users/bishwa420","html_url":"https://github.com/bishwa420","followers_url":"https://api.github.com/users/bishwa420/followers","following_url":"https://api.github.com/users/bishwa420/following{/other_user}","gists_url":"https://api.github.com/users/bishwa420/gists{/gist_id}","starred_url":"https://api.github.com/users/bishwa420/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bishwa420/subscriptions","organizations_url":"https://api.github.com/users/bishwa420/orgs","repos_url":"https://api.github.com/users/bishwa420/repos","events_url":"https://api.github.com/users/bishwa420/events{/privacy}","received_events_url":"https://api.github.com/users/bishwa420/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2017-11-04T09:20:38Z","updated_at":"2017-11-05T11:52:23Z","closed_at":"2017-11-04T09:31:05Z","author_association":"NONE","body":"This may sound strange, but, the model had been training for about a month (of course there is no GPU) and then saved with the best validation performance:\r\n\r\n> Model name:          run_1_on_main.pth.tar\r\n> DeepSpeech version:  0.0.1\r\n> \r\n> Recurrent Neural Network Properties\r\n>   RNN Type:          gru\r\n>   RNN Layers:        7\r\n>   RNN Size:          768\r\n>   Classes:           29\r\n> \r\n> Model Features\r\n>   Labels:             _CGOSTUXabcdefghijklnoprstuy\r\n>   Sample Rate:       16000\r\n>   Window Type:       hamming\r\n>   Window Size:       0.02\r\n>   Window Stride:     0.01\r\n> \r\n> Training Information\r\n>   Epochs:            47\r\n>   Current Loss:      0.032\r\n>   Current CER:       3.693\r\n>   Current WER:       42.079\r\n> \r\n\r\nBut when I loaded the model (25+- days after being saved) from the disk, and ran the **test.py** with the same validation data, it gave me CER more than 15%. I was flabbergasted. What could be the possible reason?\r\n\r\nPS: My machine is Ubuntu 16.04."},"comment":{"url":"https://api.github.com/repos/SeanNaren/deepspeech.pytorch/issues/comments/341967431","html_url":"https://github.com/SeanNaren/deepspeech.pytorch/issues/173#issuecomment-341967431","issue_url":"https://api.github.com/repos/SeanNaren/deepspeech.pytorch/issues/173","id":341967431,"user":{"login":"ryanleary","id":2212584,"avatar_url":"https://avatars3.githubusercontent.com/u/2212584?v=4","gravatar_id":"","url":"https://api.github.com/users/ryanleary","html_url":"https://github.com/ryanleary","followers_url":"https://api.github.com/users/ryanleary/followers","following_url":"https://api.github.com/users/ryanleary/following{/other_user}","gists_url":"https://api.github.com/users/ryanleary/gists{/gist_id}","starred_url":"https://api.github.com/users/ryanleary/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ryanleary/subscriptions","organizations_url":"https://api.github.com/users/ryanleary/orgs","repos_url":"https://api.github.com/users/ryanleary/repos","events_url":"https://api.github.com/users/ryanleary/events{/privacy}","received_events_url":"https://api.github.com/users/ryanleary/received_events","type":"User","site_admin":false},"created_at":"2017-11-05T11:52:23Z","updated_at":"2017-11-05T11:52:23Z","author_association":"COLLABORATOR","body":"Perfect! Glad you figured it out.\r\n\r\nIssues generally can't be deleted, so it's good practice if reporting an issue and coming to a resolution on it to indicate what the solution was. Cheers!"}}
{"actor":{"display_login":"ryanleary"}}