{"push_id":1525177380,"size":1,"distinct_size":0,"ref":"refs/heads/branch-2.1","head":"fc1adbb2b6b3097edfe90ed77306682af3d1b8aa","before":"6b60fec8c9dbb76cf542d1206fa614c534f00064","commits":[{"sha":"fc1adbb2b6b3097edfe90ed77306682af3d1b8aa","author":{"name":"Dongjoon Hyun","email":"1bf3a3c57610939bd1558dffb564906c959abecb@apache.org"},"message":"[SPARK-LLAP-30] `DROP PARTITION` should work without HDFS privilege (#33)\n\n## What changes were proposed in this pull request?\r\n\r\nCurrently, `ALTER TABLE ... DROP PARTITION` fails with the following errors when the user doesn't have a enough HDFS privilege to change `hive` warehouse directory. When Spark Thrift Server is running as `hive`, this is not a problem. Also, this is not about permission issue. After correct authorization, this situation happens.\r\n\r\n```\r\n[alter_drop_partiton_3_t_alter] dongjoon ALTER TABLE t_alter_part DROP PARTITION (c=1)\r\nError: org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: Got exception: java.io.IOException Failed to move to trash:\r\nhdfs://.../apps/hive/warehouse/spark_ranger_test.db/t_alter_part/c=1; (state=,code=0)\r\n```\r\n\r\n## How was this patch tested?\r\n\r\nFor example, run Spark Thrift Server in a normal user account without `HDFS` privilege, and\r\nexecute `ALTER TABLE ... DROP PARTITION` statement.\r\n\r\nNote that the test script contains user id `spark`. To run the test script with non-`spark` user, both test script and answer files should be fixed manually.\r\n\r\nThis closes #32 .","distinct":false,"url":"https://api.github.com/repos/hortonworks-spark/spark-llap/commits/fc1adbb2b6b3097edfe90ed77306682af3d1b8aa"}]}
{"actor":{"display_login":"dongjoon-hyun"}}