{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/18380","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/18380/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/18380/comments","events_url":"https://api.github.com/repos/apache/spark/issues/18380/events","html_url":"https://github.com/apache/spark/pull/18380","id":237650206,"number":18380,"title":"[SPARK-16019][yarn] Use separate RM poll interval when starting client AM.","user":{"login":"vanzin","id":1694083,"avatar_url":"https://avatars3.githubusercontent.com/u/1694083?v=3","gravatar_id":"","url":"https://api.github.com/users/vanzin","html_url":"https://github.com/vanzin","followers_url":"https://api.github.com/users/vanzin/followers","following_url":"https://api.github.com/users/vanzin/following{/other_user}","gists_url":"https://api.github.com/users/vanzin/gists{/gist_id}","starred_url":"https://api.github.com/users/vanzin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vanzin/subscriptions","organizations_url":"https://api.github.com/users/vanzin/orgs","repos_url":"https://api.github.com/users/vanzin/repos","events_url":"https://api.github.com/users/vanzin/events{/privacy}","received_events_url":"https://api.github.com/users/vanzin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2017-06-21T20:09:55Z","updated_at":"2017-07-10T17:09:43Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/18380","html_url":"https://github.com/apache/spark/pull/18380","diff_url":"https://github.com/apache/spark/pull/18380.diff","patch_url":"https://github.com/apache/spark/pull/18380.patch"},"body":"Currently the code monitoring the launch of the client AM uses the value of\r\nspark.yarn.report.interval as the interval for polling the RM; if someone\r\nhas that value to a really large interval, it would take that long to detect\r\nthat the client AM has started, which is not expected.\r\n\r\nInstead, have a separate config for the interval to use when the client AM is\r\nstarting. The other config is still used in cluster mode, and to detect the\r\nstatus of the client AM after it is already running.\r\n\r\nTested by running client and cluster mode apps with a modified value of\r\nspark.yarn.report.interval, verifying client AM launch is detected before\r\nthat interval elapses.\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/314171771","html_url":"https://github.com/apache/spark/pull/18380#issuecomment-314171771","issue_url":"https://api.github.com/repos/apache/spark/issues/18380","id":314171771,"user":{"login":"vanzin","id":1694083,"avatar_url":"https://avatars3.githubusercontent.com/u/1694083?v=3","gravatar_id":"","url":"https://api.github.com/users/vanzin","html_url":"https://github.com/vanzin","followers_url":"https://api.github.com/users/vanzin/followers","following_url":"https://api.github.com/users/vanzin/following{/other_user}","gists_url":"https://api.github.com/users/vanzin/gists{/gist_id}","starred_url":"https://api.github.com/users/vanzin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vanzin/subscriptions","organizations_url":"https://api.github.com/users/vanzin/orgs","repos_url":"https://api.github.com/users/vanzin/repos","events_url":"https://api.github.com/users/vanzin/events{/privacy}","received_events_url":"https://api.github.com/users/vanzin/received_events","type":"User","site_admin":false},"created_at":"2017-07-10T17:09:43Z","updated_at":"2017-07-10T17:09:43Z","body":"@tgravescs "}}
{"actor":{"display_login":"vanzin"}}