{"action":"opened","issue":{"url":"https://api.github.com/repos/tensorflow/agents/issues/10","repository_url":"https://api.github.com/repos/tensorflow/agents","labels_url":"https://api.github.com/repos/tensorflow/agents/issues/10/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/agents/issues/10/comments","events_url":"https://api.github.com/repos/tensorflow/agents/issues/10/events","html_url":"https://github.com/tensorflow/agents/issues/10","id":262592030,"number":10,"title":"Enabling GPU compromises performance","user":{"login":"jimfleming","id":226553,"avatar_url":"https://avatars3.githubusercontent.com/u/226553?v=4","gravatar_id":"","url":"https://api.github.com/users/jimfleming","html_url":"https://github.com/jimfleming","followers_url":"https://api.github.com/users/jimfleming/followers","following_url":"https://api.github.com/users/jimfleming/following{/other_user}","gists_url":"https://api.github.com/users/jimfleming/gists{/gist_id}","starred_url":"https://api.github.com/users/jimfleming/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jimfleming/subscriptions","organizations_url":"https://api.github.com/users/jimfleming/orgs","repos_url":"https://api.github.com/users/jimfleming/repos","events_url":"https://api.github.com/users/jimfleming/events{/privacy}","received_events_url":"https://api.github.com/users/jimfleming/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2017-10-03T21:23:46Z","updated_at":"2017-10-03T21:23:46Z","closed_at":null,"author_association":"NONE","body":"I've run several trials with TF Agents and found that enabling the GPU through the `use_gpu` configuration flag stalls or inhibits task convergence. Any help troubleshooting this would be appreciated.\r\n\r\nThe problem seems to exist in all environments but is most prominent in the pendulum task. (Plots below.)\r\n\r\nWith GPU (4 runs):\r\n\r\n<img width=\"866\" alt=\"screen shot 2017-10-03 at 2 18 04 pm\" src=\"https://user-images.githubusercontent.com/226553/31149716-bd1efaac-a845-11e7-8de5-7bc4da40f1b7.png\">\r\n\r\nWithout GPU (4 runs):\r\n\r\n<img width=\"870\" alt=\"screen shot 2017-10-03 at 2 20 14 pm\" src=\"https://user-images.githubusercontent.com/226553/31149793-ff536b4c-a845-11e7-9f72-174698861e42.png\">\r\n\r\nThese runs were generated with a fresh clone of the TF Agents repo as of this morning but previous versions showed similar results. The only difference between the two graphs is the use of the GPU.\r\n\r\nIt's also about 3x slower to use the GPU on the pendulum task but I suspect that's due to the relatively small size of the network vs the cost of data transfer to the GPU.\r\n\r\nAlso tested with:\r\n\r\n- CUDNN 6 and 5\r\n- TensorFlow 1.3.0 and 1.2.1\r\n- Both tensorflow and tensorflow-gpu packages (no apparent difference b/w these two for CPU)\r\n\r\n(This issue may be related to #8?)\r\n\r\ncc @danijar "}}
{"actor":{"display_login":"jimfleming"}}