{"action":"created","issue":{"url":"https://api.github.com/repos/apache/carbondata/issues/570","repository_url":"https://api.github.com/repos/apache/carbondata","labels_url":"https://api.github.com/repos/apache/carbondata/issues/570/labels{/name}","comments_url":"https://api.github.com/repos/apache/carbondata/issues/570/comments","events_url":"https://api.github.com/repos/apache/carbondata/issues/570/events","html_url":"https://github.com/apache/carbondata/pull/570","id":203020051,"number":570,"title":"[CARBONDATA-657]added support for shared dictionary columns in spark 2.1 ","user":{"login":"anubhav100","id":17251469,"avatar_url":"https://avatars3.githubusercontent.com/u/17251469?v=4","gravatar_id":"","url":"https://api.github.com/users/anubhav100","html_url":"https://github.com/anubhav100","followers_url":"https://api.github.com/users/anubhav100/followers","following_url":"https://api.github.com/users/anubhav100/following{/other_user}","gists_url":"https://api.github.com/users/anubhav100/gists{/gist_id}","starred_url":"https://api.github.com/users/anubhav100/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/anubhav100/subscriptions","organizations_url":"https://api.github.com/users/anubhav100/orgs","repos_url":"https://api.github.com/users/anubhav100/repos","events_url":"https://api.github.com/users/anubhav100/events{/privacy}","received_events_url":"https://api.github.com/users/anubhav100/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":9,"created_at":"2017-01-25T06:04:16Z","updated_at":"2017-10-23T22:49:10Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/apache/carbondata/pulls/570","html_url":"https://github.com/apache/carbondata/pull/570","diff_url":"https://github.com/apache/carbondata/pull/570.diff","patch_url":"https://github.com/apache/carbondata/pull/570.patch"},"body":"in spark 1.6 shared columns works fine\r\n\r\n0: jdbc:hive2://localhost:10000> CREATE TABLE uniq_shared_dictionary (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES('DICTIONARY_INCLUDE'='CUST_ID,Double_COLUMN2,DECIMAL_COLUMN2','columnproperties.CUST_ID.shared_column'='shared.CUST_ID','columnproperties.decimal_column2.shared_column'='shared.decimal_column2');\r\n+---------+--+\r\n| Result  |\r\n+---------+--+\r\n+---------+--+\r\n\r\nbut in spark 2.1 it gives exception\r\n\r\n0: jdbc:hive2://hadoop-master:10000> CREATE TABLE uniq_shared_dictionary (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES('DICTIONARY_INCLUDE'='CUST_ID,Double_COLUMN2,DECIMAL_COLUMN2','columnproperties.CUST_ID.shared_column'='shared.CUST_ID','columnproperties.decimal_column2.shared_column'='shared.decimal_column2');\r\nError: org.apache.carbondata.spark.exception.MalformedCarbonCommandException: Invalid table properties columnproperties.cust_id.shared_column (state=,code=0)\r\nLOGS\r\nERROR 18-01 13:31:18,147 - Error executing query, currentState RUNNING, \r\norg.apache.carbondata.spark.exception.MalformedCarbonCommandException: Invalid table properties columnproperties.cust_id.shared_column\r\n\r\nbut if we give column name in  lower case it works fine\r\n\r\nCREATE TABLE uniq_shared_dictionary (cust_id int,CUST_NAME String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), decimal_column2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES('DICTIONARY_INCLUDE'='CUST_ID,Double_COLUMN2,DECIMAL_COLUMN2','columnproperties.cust_id.shared_column'='shared.cust_id','columnproperties.decimal_column2.shared_column'='shared.decimal_column2');\r\n+---------+--+\r\n| Result  |\r\n+---------+--+\r\n+---------+--+\r\nNo rows selected (2.644 seconds)\r\n\r\nwith this pr user will be able to create shared columns in spark 2.1 in both case\r\n"},"comment":{"url":"https://api.github.com/repos/apache/carbondata/issues/comments/338819163","html_url":"https://github.com/apache/carbondata/pull/570#issuecomment-338819163","issue_url":"https://api.github.com/repos/apache/carbondata/issues/570","id":338819163,"user":{"login":"ravipesala","id":8134086,"avatar_url":"https://avatars2.githubusercontent.com/u/8134086?v=4","gravatar_id":"","url":"https://api.github.com/users/ravipesala","html_url":"https://github.com/ravipesala","followers_url":"https://api.github.com/users/ravipesala/followers","following_url":"https://api.github.com/users/ravipesala/following{/other_user}","gists_url":"https://api.github.com/users/ravipesala/gists{/gist_id}","starred_url":"https://api.github.com/users/ravipesala/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ravipesala/subscriptions","organizations_url":"https://api.github.com/users/ravipesala/orgs","repos_url":"https://api.github.com/users/ravipesala/repos","events_url":"https://api.github.com/users/ravipesala/events{/privacy}","received_events_url":"https://api.github.com/users/ravipesala/received_events","type":"User","site_admin":false},"created_at":"2017-10-23T22:49:10Z","updated_at":"2017-10-23T22:49:10Z","author_association":"CONTRIBUTOR","body":"SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/1263/\n"}}
{"actor":{"display_login":"ravipesala"}}