{"action":"created","issue":{"url":"https://api.github.com/repos/dleebrown/ANNA/issues/7","repository_url":"https://api.github.com/repos/dleebrown/ANNA","labels_url":"https://api.github.com/repos/dleebrown/ANNA/issues/7/labels{/name}","comments_url":"https://api.github.com/repos/dleebrown/ANNA/issues/7/comments","events_url":"https://api.github.com/repos/dleebrown/ANNA/issues/7/events","html_url":"https://github.com/dleebrown/ANNA/issues/7","id":234346255,"number":7,"title":"Preprocessing stalling GPU","user":{"login":"dleebrown","id":13820374,"avatar_url":"https://avatars2.githubusercontent.com/u/13820374?v=3","gravatar_id":"","url":"https://api.github.com/users/dleebrown","html_url":"https://github.com/dleebrown","followers_url":"https://api.github.com/users/dleebrown/followers","following_url":"https://api.github.com/users/dleebrown/following{/other_user}","gists_url":"https://api.github.com/users/dleebrown/gists{/gist_id}","starred_url":"https://api.github.com/users/dleebrown/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dleebrown/subscriptions","organizations_url":"https://api.github.com/users/dleebrown/orgs","repos_url":"https://api.github.com/users/dleebrown/repos","events_url":"https://api.github.com/users/dleebrown/events{/privacy}","received_events_url":"https://api.github.com/users/dleebrown/received_events","type":"User","site_admin":false},"labels":[{"id":616262834,"url":"https://api.github.com/repos/dleebrown/ANNA/labels/bug","name":"bug","color":"ee0701","default":true},{"id":616262840,"url":"https://api.github.com/repos/dleebrown/ANNA/labels/wontfix","name":"wontfix","color":"ffffff","default":true}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2017-06-07T21:19:47Z","updated_at":"2017-07-10T19:02:16Z","closed_at":null,"body":"Right now the code is set to do preprocessing on a single thread and then passing batches to the gpu. Looks like there's something with the GIL not being released quickly enough or the preprocessing taking too long relative to the time to do the gpu compute. Spawing more preprocessing threads doesn't solve the issue, so it's not an IO bottleneck. This is a nontrivial issue that might require looking into multitprocess preprocessing, rather than threading. "},"comment":{"url":"https://api.github.com/repos/dleebrown/ANNA/issues/comments/314203059","html_url":"https://github.com/dleebrown/ANNA/issues/7#issuecomment-314203059","issue_url":"https://api.github.com/repos/dleebrown/ANNA/issues/7","id":314203059,"user":{"login":"dleebrown","id":13820374,"avatar_url":"https://avatars2.githubusercontent.com/u/13820374?v=3","gravatar_id":"","url":"https://api.github.com/users/dleebrown","html_url":"https://github.com/dleebrown","followers_url":"https://api.github.com/users/dleebrown/followers","following_url":"https://api.github.com/users/dleebrown/following{/other_user}","gists_url":"https://api.github.com/users/dleebrown/gists{/gist_id}","starred_url":"https://api.github.com/users/dleebrown/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dleebrown/subscriptions","organizations_url":"https://api.github.com/users/dleebrown/orgs","repos_url":"https://api.github.com/users/dleebrown/repos","events_url":"https://api.github.com/users/dleebrown/events{/privacy}","received_events_url":"https://api.github.com/users/dleebrown/received_events","type":"User","site_admin":false},"created_at":"2017-07-10T19:02:16Z","updated_at":"2017-07-10T19:02:16Z","body":"This seems like a difficult issue to solve and doesn't seem to be critical to fix. "}}
{"actor":{"display_login":"dleebrown"}}