{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/19467","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/19467/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/19467/comments","events_url":"https://api.github.com/repos/apache/spark/issues/19467/events","html_url":"https://github.com/apache/spark/pull/19467","id":264392755,"number":19467,"title":"[SPARK-22238] Fix plan resolution bug caused by EnsureStatefulOpPartitioning","user":{"login":"brkyvz","id":5243515,"avatar_url":"https://avatars1.githubusercontent.com/u/5243515?v=4","gravatar_id":"","url":"https://api.github.com/users/brkyvz","html_url":"https://github.com/brkyvz","followers_url":"https://api.github.com/users/brkyvz/followers","following_url":"https://api.github.com/users/brkyvz/following{/other_user}","gists_url":"https://api.github.com/users/brkyvz/gists{/gist_id}","starred_url":"https://api.github.com/users/brkyvz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/brkyvz/subscriptions","organizations_url":"https://api.github.com/users/brkyvz/orgs","repos_url":"https://api.github.com/users/brkyvz/repos","events_url":"https://api.github.com/users/brkyvz/events{/privacy}","received_events_url":"https://api.github.com/users/brkyvz/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2017-10-10T22:07:19Z","updated_at":"2017-10-12T17:57:13Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/19467","html_url":"https://github.com/apache/spark/pull/19467","diff_url":"https://github.com/apache/spark/pull/19467.diff","patch_url":"https://github.com/apache/spark/pull/19467.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nIn EnsureStatefulOpPartitioning, we check that the inputRDD to a SparkPlan has the expected partitioning for Streaming Stateful Operators. The problem is that we are not allowed to access this information during planning.\r\nThe reason we added that check was because CoalesceExec could actually create RDDs with 0 partitions. We should fix it such that when CoalesceExec says that there is a SinglePartition, there is in fact an inputRDD of 1 partition instead of 0 partitions.\r\n\r\n## How was this patch tested?\r\n\r\nRegression test in StreamingQuerySuite\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/336216731","html_url":"https://github.com/apache/spark/pull/19467#issuecomment-336216731","issue_url":"https://api.github.com/repos/apache/spark/issues/19467","id":336216731,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars3.githubusercontent.com/u/4031291?v=4","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2017-10-12T17:57:13Z","updated_at":"2017-10-12T17:57:13Z","author_association":"NONE","body":"Merged build finished. Test FAILed."}}
{"actor":{"display_login":"AmplabJenkins"}}