{"action":"created","issue":{"url":"https://api.github.com/repos/bulletphysics/bullet3/issues/910","repository_url":"https://api.github.com/repos/bulletphysics/bullet3","labels_url":"https://api.github.com/repos/bulletphysics/bullet3/issues/910/labels{/name}","comments_url":"https://api.github.com/repos/bulletphysics/bullet3/issues/910/comments","events_url":"https://api.github.com/repos/bulletphysics/bullet3/issues/910/events","html_url":"https://github.com/bulletphysics/bullet3/pull/910","id":199086300,"number":910,"title":"[WIP] Basic DQN agent training on CartPolev0 env with pybullet","user":{"login":"benelot","id":3111851,"avatar_url":"https://avatars.githubusercontent.com/u/3111851?v=3","gravatar_id":"","url":"https://api.github.com/users/benelot","html_url":"https://github.com/benelot","followers_url":"https://api.github.com/users/benelot/followers","following_url":"https://api.github.com/users/benelot/following{/other_user}","gists_url":"https://api.github.com/users/benelot/gists{/gist_id}","starred_url":"https://api.github.com/users/benelot/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/benelot/subscriptions","organizations_url":"https://api.github.com/users/benelot/orgs","repos_url":"https://api.github.com/users/benelot/repos","events_url":"https://api.github.com/users/benelot/events{/privacy}","received_events_url":"https://api.github.com/users/benelot/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2017-01-05T23:25:54Z","updated_at":"2017-01-05T23:32:34Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/bulletphysics/bullet3/pulls/910","html_url":"https://github.com/bulletphysics/bullet3/pull/910","diff_url":"https://github.com/bulletphysics/bullet3/pull/910.diff","patch_url":"https://github.com/bulletphysics/bullet3/pull/910.patch"},"body":"Here is an example using a hand-implemented OpenAI environment. It is still work in progress since it does not use the URDF with the joint in it (I will fix it with the insights from #909).\r\n\r\nI have some args to set to train it with and without gui. How should we make it runnable out of the box? Different scripts to train and one to load a trained agent to show that it works? \r\n\r\nI will additionally make an example loading the environment using the xml file. How do you like the organization of my files? Do you have something in mind on how to organize the python files in the pybullet folder in case they get more and more?\r\n\r\nP.S. I will add the cartpole++ example of matpalm as a reference later, since I learned a lot from it to build this. \r\n\r\nHave a good day, it is time to sleep here!"},"comment":{"url":"https://api.github.com/repos/bulletphysics/bullet3/issues/comments/270789163","html_url":"https://github.com/bulletphysics/bullet3/pull/910#issuecomment-270789163","issue_url":"https://api.github.com/repos/bulletphysics/bullet3/issues/910","id":270789163,"user":{"login":"erwincoumans","id":725468,"avatar_url":"https://avatars.githubusercontent.com/u/725468?v=3","gravatar_id":"","url":"https://api.github.com/users/erwincoumans","html_url":"https://github.com/erwincoumans","followers_url":"https://api.github.com/users/erwincoumans/followers","following_url":"https://api.github.com/users/erwincoumans/following{/other_user}","gists_url":"https://api.github.com/users/erwincoumans/gists{/gist_id}","starred_url":"https://api.github.com/users/erwincoumans/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/erwincoumans/subscriptions","organizations_url":"https://api.github.com/users/erwincoumans/orgs","repos_url":"https://api.github.com/users/erwincoumans/repos","events_url":"https://api.github.com/users/erwincoumans/events{/privacy}","received_events_url":"https://api.github.com/users/erwincoumans/received_events","type":"User","site_admin":false},"created_at":"2017-01-05T23:32:34Z","updated_at":"2017-01-05T23:32:34Z","body":">>How should we make it runnable out of the box? Different scripts to train and one to load a trained agent to show that it works?\r\n\r\nHow does the original OpenAI GYM cartpole example with MuJoCO deal with this? Ideally we follow that approach as close as possible."}}
{"actor":{"display_login":"erwincoumans"}}