{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/19679","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/19679/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/19679/comments","events_url":"https://api.github.com/repos/apache/spark/issues/19679/events","html_url":"https://github.com/apache/spark/pull/19679","id":271619446,"number":19679,"title":"[SPARK-20647][core] Port StorageTab to the new UI backend.","user":{"login":"vanzin","id":1694083,"avatar_url":"https://avatars0.githubusercontent.com/u/1694083?v=4","gravatar_id":"","url":"https://api.github.com/users/vanzin","html_url":"https://github.com/vanzin","followers_url":"https://api.github.com/users/vanzin/followers","following_url":"https://api.github.com/users/vanzin/following{/other_user}","gists_url":"https://api.github.com/users/vanzin/gists{/gist_id}","starred_url":"https://api.github.com/users/vanzin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vanzin/subscriptions","organizations_url":"https://api.github.com/users/vanzin/orgs","repos_url":"https://api.github.com/users/vanzin/repos","events_url":"https://api.github.com/users/vanzin/events{/privacy}","received_events_url":"https://api.github.com/users/vanzin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":8,"created_at":"2017-11-06T21:03:04Z","updated_at":"2017-11-09T05:48:16Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/19679","html_url":"https://github.com/apache/spark/pull/19679","diff_url":"https://github.com/apache/spark/pull/19679.diff","patch_url":"https://github.com/apache/spark/pull/19679.patch"},"body":"This required adding information about StreamBlockId to the store,\r\nwhich is not available yet via the API. So an internal type was added\r\nuntil there's a need to expose that information in the API.\r\n\r\nThe UI only lists RDDs that have cached partitions, and that information\r\nwasn't being correctly captured in the listener, so that's also fixed,\r\nalong with some minor (internal) API adjustments so that the UI can\r\nget the correct data.\r\n\r\nBecause of the way partitions are cached, some optimizations w.r.t. how\r\noften the data is flushed to the store could not be applied to this code;\r\nbecause of that, some different ways to make the code more performant\r\nwere added to the data structures tracking RDD blocks, with the goal of\r\navoiding expensive copies when lots of blocks are being updated.\r\n\r\nTested with existing and updated unit tests."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/343053908","html_url":"https://github.com/apache/spark/pull/19679#issuecomment-343053908","issue_url":"https://api.github.com/repos/apache/spark/issues/19679","id":343053908,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars3.githubusercontent.com/u/4031291?v=4","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2017-11-09T05:48:16Z","updated_at":"2017-11-09T05:48:16Z","author_association":"NONE","body":"Test PASSed.\nRefer to this link for build results (access rights to CI server needed): \nhttps://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83619/\nTest PASSed."}}
{"actor":{"display_login":"AmplabJenkins"}}