Skip to content
Snippets Groups Projects
  • Yuming Wang's avatar
    2ab8551e
    [SPARK-18645][DEPLOY] Fix spark-daemon.sh arguments error lead to throws Unrecognized option · 2ab8551e
    Yuming Wang authored
    ## What changes were proposed in this pull request?
    
    spark-daemon.sh will lost single quotes around after #15338. as follows:
    ```
    execute_command nice -n 0 bash /opt/cloudera/parcels/SPARK-2.1.0-cdh5.4.3.d20161129-21.04.38/lib/spark/bin/spark-submit --class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2 --name Thrift JDBC/ODBC Server --conf spark.driver.extraJavaOptions=-XX:+UseG1GC -XX:-HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp
    ```
    With this fix, as follows:
    ```
    execute_command nice -n 0 bash /opt/cloudera/parcels/SPARK-2.1.0-cdh5.4.3.d20161129-21.04.38/lib/spark/bin/spark-submit --class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2 --name 'Thrift JDBC/ODBC Server' --conf 'spark.driver.extraJavaOptions=-XX:+UseG1GC -XX:-HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp'
    ```
    
    ## How was this patch tested?
    
    - Manual tests
    - Build the package and start-thriftserver.sh with `--conf 'spark.driver.extraJavaOptions=-XX:+UseG1GC -XX:-HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp'`
    
    Author: Yuming Wang <wgyumg@gmail.com>
    
    Closes #16079 from wangyum/SPARK-18645.
    [SPARK-18645][DEPLOY] Fix spark-daemon.sh arguments error lead to throws Unrecognized option
    Yuming Wang authored
    ## What changes were proposed in this pull request?
    
    spark-daemon.sh will lost single quotes around after #15338. as follows:
    ```
    execute_command nice -n 0 bash /opt/cloudera/parcels/SPARK-2.1.0-cdh5.4.3.d20161129-21.04.38/lib/spark/bin/spark-submit --class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2 --name Thrift JDBC/ODBC Server --conf spark.driver.extraJavaOptions=-XX:+UseG1GC -XX:-HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp
    ```
    With this fix, as follows:
    ```
    execute_command nice -n 0 bash /opt/cloudera/parcels/SPARK-2.1.0-cdh5.4.3.d20161129-21.04.38/lib/spark/bin/spark-submit --class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2 --name 'Thrift JDBC/ODBC Server' --conf 'spark.driver.extraJavaOptions=-XX:+UseG1GC -XX:-HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp'
    ```
    
    ## How was this patch tested?
    
    - Manual tests
    - Build the package and start-thriftserver.sh with `--conf 'spark.driver.extraJavaOptions=-XX:+UseG1GC -XX:-HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp'`
    
    Author: Yuming Wang <wgyumg@gmail.com>
    
    Closes #16079 from wangyum/SPARK-18645.