{"action":"created","issue":{"url":"https://api.github.com/repos/openai/gym/issues/33","repository_url":"https://api.github.com/repos/openai/gym","labels_url":"https://api.github.com/repos/openai/gym/issues/33/labels{/name}","comments_url":"https://api.github.com/repos/openai/gym/issues/33/comments","events_url":"https://api.github.com/repos/openai/gym/issues/33/events","html_url":"https://github.com/openai/gym/issues/33","id":152002449,"number":33,"title":"Env should provide reward range","user":{"login":"rafaelcp","id":2145555,"avatar_url":"https://avatars3.githubusercontent.com/u/2145555?v=3","gravatar_id":"","url":"https://api.github.com/users/rafaelcp","html_url":"https://github.com/rafaelcp","followers_url":"https://api.github.com/users/rafaelcp/followers","following_url":"https://api.github.com/users/rafaelcp/following{/other_user}","gists_url":"https://api.github.com/users/rafaelcp/gists{/gist_id}","starred_url":"https://api.github.com/users/rafaelcp/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rafaelcp/subscriptions","organizations_url":"https://api.github.com/users/rafaelcp/orgs","repos_url":"https://api.github.com/users/rafaelcp/repos","events_url":"https://api.github.com/users/rafaelcp/events{/privacy}","received_events_url":"https://api.github.com/users/rafaelcp/received_events","type":"User","site_admin":false},"labels":[{"id":365091527,"url":"https://api.github.com/repos/openai/gym/labels/enhancement","name":"enhancement","color":"84b6eb","default":true}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2016-04-30T02:51:06Z","updated_at":"2017-05-16T18:25:12Z","closed_at":"2016-05-01T02:53:30Z","body":"In some algorithms like [R-Max](http://jmlr.csail.mit.edu/papers/volume3/brafman02a/brafman02a.pdf) it is necessary to know the maximum reward given at any _single step_ by the environment. Just like continuous state environments provide ranges for each dimension, I suggest that they should provide reward ranges too. Note that it is not the _accumulated reward_ range, but _single step_ reward range.\n"},"comment":{"url":"https://api.github.com/repos/openai/gym/issues/comments/301872034","html_url":"https://github.com/openai/gym/issues/33#issuecomment-301872034","issue_url":"https://api.github.com/repos/openai/gym/issues/33","id":301872034,"user":{"login":"shelhamer","id":311113,"avatar_url":"https://avatars3.githubusercontent.com/u/311113?v=3","gravatar_id":"","url":"https://api.github.com/users/shelhamer","html_url":"https://github.com/shelhamer","followers_url":"https://api.github.com/users/shelhamer/followers","following_url":"https://api.github.com/users/shelhamer/following{/other_user}","gists_url":"https://api.github.com/users/shelhamer/gists{/gist_id}","starred_url":"https://api.github.com/users/shelhamer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/shelhamer/subscriptions","organizations_url":"https://api.github.com/users/shelhamer/orgs","repos_url":"https://api.github.com/users/shelhamer/repos","events_url":"https://api.github.com/users/shelhamer/events{/privacy}","received_events_url":"https://api.github.com/users/shelhamer/received_events","type":"User","site_admin":false},"created_at":"2017-05-16T18:25:12Z","updated_at":"2017-05-16T18:25:12Z","body":"Note the Atari environments (and perhaps others) are still at the default (-inf, inf) range."}}
{"actor":{"display_login":"shelhamer"}}