Skip to content
Snippets Groups Projects
Commit 934ecc82 authored by Tathagata Das's avatar Tathagata Das
Browse files

Removed streaming-env.sh.template

parent 3dc87dd9
No related branches found
No related tags found
No related merge requests found
#!/usr/bin/env bash
# This file contains a few additional setting that are useful for
# running streaming jobs in Spark. Copy this file as streaming-env.sh .
# Note that this shell script will be read after spark-env.sh, so settings
# in this file may override similar settings (if present) in spark-env.sh .
# Using concurrent GC is strongly recommended as it can significantly
# reduce GC related pauses.
SPARK_JAVA_OPTS+=" -XX:+UseConcMarkSweepGC"
# Using Kryo serialization can improve serialization performance
# and therefore the throughput of the Spark Streaming programs. However,
# using Kryo serialization with custom classes may required you to
# register the classes with Kryo. Refer to the Spark documentation
# for more details.
# SPARK_JAVA_OPTS+=" -Dspark.serializer=spark.KryoSerializer"
export SPARK_JAVA_OPTS
......@@ -13,10 +13,6 @@ if [ -e $FWDIR/conf/spark-env.sh ] ; then
. $FWDIR/conf/spark-env.sh
fi
if [ -e $FWDIR/conf/streaming-env.sh ] ; then
. $FWDIR/conf/streaming-env.sh
fi
if [ "$SPARK_LAUNCH_WITH_SCALA" == "1" ]; then
if [ `command -v scala` ]; then
RUNNER="scala"
......
Hello world!
What's up?
There is no cow level
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment