-
- Downloads
[SPARK-13478][YARN] Use real user when fetching delegation tokens.
The Hive client library is not smart enough to notice that the current user is a proxy user; so when using a proxy user, it fails to fetch delegation tokens from the metastore because of a missing kerberos TGT for the current user. To fix it, just run the code that fetches the delegation token as the real logged in user. Tested on a kerberos cluster both submitting normally and with a proxy user; Hive and HBase tokens are retrieved correctly in both cases. Author: Marcelo Vanzin <vanzin@cloudera.com> Closes #11358 from vanzin/SPARK-13478.
Showing
- core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala 5 additions, 0 deletions.../scala/org/apache/spark/deploy/SparkSubmitArguments.scala
- yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala 35 additions, 11 deletions...la/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala
- yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtilSuite.scala 1 addition, 1 deletion...g/apache/spark/deploy/yarn/YarnSparkHadoopUtilSuite.scala
Loading
Please register or sign in to comment