Skip to content
Snippets Groups Projects
  • Jeff Zhang's avatar
    19fdb21a
    [SPARK-12993][PYSPARK] Remove usage of ADD_FILES in pyspark · 19fdb21a
    Jeff Zhang authored
    environment variable ADD_FILES is created for adding python files on spark context to be distributed to executors (SPARK-865), this is deprecated now. User are encouraged to use --py-files for adding python files.
    
    Author: Jeff Zhang <zjffdu@apache.org>
    
    Closes #10913 from zjffdu/SPARK-12993.
    19fdb21a
    History
    [SPARK-12993][PYSPARK] Remove usage of ADD_FILES in pyspark
    Jeff Zhang authored
    environment variable ADD_FILES is created for adding python files on spark context to be distributed to executors (SPARK-865), this is deprecated now. User are encouraged to use --py-files for adding python files.
    
    Author: Jeff Zhang <zjffdu@apache.org>
    
    Closes #10913 from zjffdu/SPARK-12993.
shell.py 2.32 KiB