{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/k8s/issues/159","repository_url":"https://api.github.com/repos/tensorflow/k8s","labels_url":"https://api.github.com/repos/tensorflow/k8s/issues/159/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/k8s/issues/159/comments","events_url":"https://api.github.com/repos/tensorflow/k8s/issues/159/events","html_url":"https://github.com/tensorflow/k8s/pull/159","id":275007976,"number":159,"title":"[WIP] Example training tf/agents PPO via tfjob","user":{"login":"cwbeitel","id":2348401,"avatar_url":"https://avatars3.githubusercontent.com/u/2348401?v=4","gravatar_id":"","url":"https://api.github.com/users/cwbeitel","html_url":"https://github.com/cwbeitel","followers_url":"https://api.github.com/users/cwbeitel/followers","following_url":"https://api.github.com/users/cwbeitel/following{/other_user}","gists_url":"https://api.github.com/users/cwbeitel/gists{/gist_id}","starred_url":"https://api.github.com/users/cwbeitel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cwbeitel/subscriptions","organizations_url":"https://api.github.com/users/cwbeitel/orgs","repos_url":"https://api.github.com/users/cwbeitel/repos","events_url":"https://api.github.com/users/cwbeitel/events{/privacy}","received_events_url":"https://api.github.com/users/cwbeitel/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":32,"created_at":"2017-11-17T21:54:54Z","updated_at":"2017-12-17T10:19:47Z","closed_at":null,"author_association":"NONE","pull_request":{"url":"https://api.github.com/repos/tensorflow/k8s/pulls/159","html_url":"https://github.com/tensorflow/k8s/pull/159","diff_url":"https://github.com/tensorflow/k8s/pull/159.diff","patch_url":"https://github.com/tensorflow/k8s/pull/159.patch"},"body":"What was done\r\n\r\n- py/example_runner\r\n  - py/example_runner script to make running examples more accessible\r\n    - uses code from TF on GKE notebook and py/ to build container, submit job to existing cluster, and poll progress\r\n    - the python code for creating a cluster does not work for me\r\n  - the way job configs are templated by example_runner and the way containers are built and passed parameters here is an example of how it can be done but one of the benefits of TfJob is that it isn't prescriptive at this level\r\n  - what it isn't\r\n    - not meant as a production quality entrypoint to ML on kubernetes in general\r\n    - including a top-level runner in tf/k8s raises issues about scope and relates to https://github.com/tensorflow/k8s/issues/150\r\n\r\n- examples/agents\r\n  - preliminary demonstration of a model for how to train tf/agents models using TfJob\r\n  - currently hyperparameters specified in python form in the same place as model code\r\n    - it seems to make sense to have these provided as a separate config for hptuning\r\n  - has not yet been tested with accelerators (my quota is zero)\r\n  - the example is not distributed. many RL applications seem better suited to MPI than using tensorflow for distribution.\r\n  - haven't yet clarified on the best way to generate a visualization from a model trained\r\n    in this way.\n\n<!-- Reviewable:start -->\n---\nThis change is [<img src=\"https://reviewable.io/review_button.svg\" height=\"34\" align=\"absmiddle\" alt=\"Reviewable\"/>](https://reviewable.io/reviews/tensorflow/k8s/159)\n<!-- Reviewable:end -->\n"},"comment":{"url":"https://api.github.com/repos/tensorflow/k8s/issues/comments/352245278","html_url":"https://github.com/tensorflow/k8s/pull/159#issuecomment-352245278","issue_url":"https://api.github.com/repos/tensorflow/k8s/issues/159","id":352245278,"user":{"login":"danijar","id":2111293,"avatar_url":"https://avatars0.githubusercontent.com/u/2111293?v=4","gravatar_id":"","url":"https://api.github.com/users/danijar","html_url":"https://github.com/danijar","followers_url":"https://api.github.com/users/danijar/followers","following_url":"https://api.github.com/users/danijar/following{/other_user}","gists_url":"https://api.github.com/users/danijar/gists{/gist_id}","starred_url":"https://api.github.com/users/danijar/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/danijar/subscriptions","organizations_url":"https://api.github.com/users/danijar/orgs","repos_url":"https://api.github.com/users/danijar/repos","events_url":"https://api.github.com/users/danijar/events{/privacy}","received_events_url":"https://api.github.com/users/danijar/received_events","type":"User","site_admin":false},"created_at":"2017-12-17T10:19:47Z","updated_at":"2017-12-17T10:19:47Z","author_association":"MEMBER","body":"I'm not very familiar with the `Experiment` class so it's hard to judge whether it will support all our needs. Moreover, migration would need to be simple since several teams are using the existing setup. Maybe we should discuss this via email?"}}
{"actor":{"display_login":"danijar"}}