{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/17739","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/17739/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/17739/comments","events_url":"https://api.github.com/repos/apache/spark/issues/17739/events","html_url":"https://github.com/apache/spark/pull/17739","id":223714158,"number":17739,"title":"[SPARK-20443][MLLIB][ML] set ALS blockify size","user":{"login":"mpjlu","id":13826327,"avatar_url":"https://avatars2.githubusercontent.com/u/13826327?v=3","gravatar_id":"","url":"https://api.github.com/users/mpjlu","html_url":"https://github.com/mpjlu","followers_url":"https://api.github.com/users/mpjlu/followers","following_url":"https://api.github.com/users/mpjlu/following{/other_user}","gists_url":"https://api.github.com/users/mpjlu/gists{/gist_id}","starred_url":"https://api.github.com/users/mpjlu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mpjlu/subscriptions","organizations_url":"https://api.github.com/users/mpjlu/orgs","repos_url":"https://api.github.com/users/mpjlu/repos","events_url":"https://api.github.com/users/mpjlu/events{/privacy}","received_events_url":"https://api.github.com/users/mpjlu/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":12,"created_at":"2017-04-24T06:20:39Z","updated_at":"2017-05-11T07:12:38Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/17739","html_url":"https://github.com/apache/spark/pull/17739","diff_url":"https://github.com/apache/spark/pull/17739.diff","patch_url":"https://github.com/apache/spark/pull/17739.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\n\r\nThe blockSize of MLLIB ALS is very important for ALS performance.\r\nIn our test, when the blockSize is 128, the performance is about 4X comparing with the blockSize is 4096 (default value).\r\nThe following are our test results:\r\nBlockSize(recommendationForAll time)\r\n128(124s), 256(160s), 512(184s), 1024(244s), 2048(332s), 4096(488s), 8192(OOM)\r\n\r\nThe Test Environment:\r\n3 workers: each work 10 core, each work 30G memory, each work 1 executor.\r\nThe Data: User 480,000, and Item 17,000\r\n\r\n\r\n## How was this patch tested?\r\nThe existing UT\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/300703087","html_url":"https://github.com/apache/spark/pull/17739#issuecomment-300703087","issue_url":"https://api.github.com/repos/apache/spark/issues/17739","id":300703087,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars2.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2017-05-11T07:12:38Z","updated_at":"2017-05-11T07:12:38Z","body":"**[Test build #76787 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76787/testReport)** for PR 17739 at commit [`ffe79b8`](https://github.com/apache/spark/commit/ffe79b8cd94ebda58fd6afd51d19aa4990727e2b)."}}
{"actor":{"display_login":"SparkQA"}}