Skip to content
Snippets Groups Projects
  1. Mar 01, 2016
    • Masayoshi TSUZUKI's avatar
      [SPARK-13592][WINDOWS] fix path of spark-submit2.cmd in spark-submit.cmd · 12a2a57e
      Masayoshi TSUZUKI authored
      ## What changes were proposed in this pull request?
      
      This patch fixes the problem that pyspark fails on Windows because pyspark can't find ```spark-submit2.cmd```.
      
      ## How was this patch tested?
      
      manual tests:
        I ran ```bin\pyspark.cmd``` and checked if pyspark is launched correctly after this patch is applyed.
      
      Author: Masayoshi TSUZUKI <tsudukim@oss.nttdata.co.jp>
      
      Closes #11442 from tsudukim/feature/SPARK-13592.
      12a2a57e
  2. Feb 10, 2016
  3. Oct 14, 2014
    • Masayoshi TSUZUKI's avatar
      [SPARK-3943] Some scripts bin\*.cmd pollutes environment variables in Windows · 66af8e25
      Masayoshi TSUZUKI authored
      Modified not to pollute environment variables.
      Just moved the main logic into `XXX2.cmd` from `XXX.cmd`, and call `XXX2.cmd` with cmd command in `XXX.cmd`.
      `pyspark.cmd` and `spark-class.cmd` are already using the same way, but `spark-shell.cmd`, `spark-submit.cmd` and `/python/docs/make.bat` are not.
      
      Author: Masayoshi TSUZUKI <tsudukim@oss.nttdata.co.jp>
      
      Closes #2797 from tsudukim/feature/SPARK-3943 and squashes the following commits:
      
      b397a7d [Masayoshi TSUZUKI] [SPARK-3943] Some scripts bin\*.cmd pollutes environment variables in Windows
      66af8e25
  4. Aug 27, 2014
    • Andrew Or's avatar
      [SPARK-3167] Handle special driver configs in Windows · 7557c4cf
      Andrew Or authored
      This is an effort to bring the Windows scripts up to speed after recent splashing changes in #1845.
      
      Author: Andrew Or <andrewor14@gmail.com>
      
      Closes #2129 from andrewor14/windows-config and squashes the following commits:
      
      881a8f0 [Andrew Or] Add reference to Windows taskkill
      92e6047 [Andrew Or] Update a few comments (minor)
      22b1acd [Andrew Or] Fix style again (minor)
      afcffea [Andrew Or] Fix style (minor)
      72004c2 [Andrew Or] Actually respect --driver-java-options
      803218b [Andrew Or] Actually respect SPARK_*_CLASSPATH
      eeb34a0 [Andrew Or] Update outdated comment (minor)
      35caecc [Andrew Or] In Windows, actually kill Java processes on exit
      f97daa2 [Andrew Or] Fix Windows spark shell stdin issue
      83ebe60 [Andrew Or] Parse special driver configs in Windows (broken)
      7557c4cf
  5. May 12, 2014
    • Andrew Or's avatar
      [SPARK-1736] Spark submit for Windows · beb9cbac
      Andrew Or authored
      Tested on Windows 7.
      
      Author: Andrew Or <andrewor14@gmail.com>
      
      Closes #745 from andrewor14/windows-submit and squashes the following commits:
      
      c0b58fb [Andrew Or] Allow spaces in parameters
      162e54d [Andrew Or] Merge branch 'master' of github.com:apache/spark into windows-submit
      91597ce [Andrew Or] Make spark-shell.cmd use spark-submit.cmd
      af6fd29 [Andrew Or] Add spark submit for Windows
      beb9cbac
Loading