Skip to content
Snippets Groups Projects
  • Marcelo Vanzin's avatar
    ed167e70
    [SPARK-5493] [core] Add option to impersonate user. · ed167e70
    Marcelo Vanzin authored
    Hadoop has a feature that allows users to impersonate other users
    when submitting applications or talking to HDFS, for example. These
    impersonated users are referred generally as "proxy users".
    
    Services such as Oozie or Hive use this feature to run applications
    as the requesting user.
    
    This change makes SparkSubmit accept a new command line option to
    run the application as a proxy user. It also fixes the plumbing
    of the user name through the UI (and a couple of other places) to
    refer to the correct user running the application, which can be
    different than `sys.props("user.name")` even without proxies (e.g.
    when using kerberos).
    
    Author: Marcelo Vanzin <vanzin@cloudera.com>
    
    Closes #4405 from vanzin/SPARK-5493 and squashes the following commits:
    
    df82427 [Marcelo Vanzin] Clarify the reason for the special exception handling.
    05bfc08 [Marcelo Vanzin] Remove unneeded annotation.
    4840de9 [Marcelo Vanzin] Review feedback.
    8af06ff [Marcelo Vanzin] Fix usage string.
    2e4fa8f [Marcelo Vanzin] Merge branch 'master' into SPARK-5493
    b6c947d [Marcelo Vanzin] Merge branch 'master' into SPARK-5493
    0540d38 [Marcelo Vanzin] [SPARK-5493] [core] Add option to impersonate user.
    ed167e70
    History
    [SPARK-5493] [core] Add option to impersonate user.
    Marcelo Vanzin authored
    Hadoop has a feature that allows users to impersonate other users
    when submitting applications or talking to HDFS, for example. These
    impersonated users are referred generally as "proxy users".
    
    Services such as Oozie or Hive use this feature to run applications
    as the requesting user.
    
    This change makes SparkSubmit accept a new command line option to
    run the application as a proxy user. It also fixes the plumbing
    of the user name through the UI (and a couple of other places) to
    refer to the correct user running the application, which can be
    different than `sys.props("user.name")` even without proxies (e.g.
    when using kerberos).
    
    Author: Marcelo Vanzin <vanzin@cloudera.com>
    
    Closes #4405 from vanzin/SPARK-5493 and squashes the following commits:
    
    df82427 [Marcelo Vanzin] Clarify the reason for the special exception handling.
    05bfc08 [Marcelo Vanzin] Remove unneeded annotation.
    4840de9 [Marcelo Vanzin] Review feedback.
    8af06ff [Marcelo Vanzin] Fix usage string.
    2e4fa8f [Marcelo Vanzin] Merge branch 'master' into SPARK-5493
    b6c947d [Marcelo Vanzin] Merge branch 'master' into SPARK-5493
    0540d38 [Marcelo Vanzin] [SPARK-5493] [core] Add option to impersonate user.