Skip to content
Snippets Groups Projects
Commit d7081a92 authored by Mosharaf Chowdhury's avatar Mosharaf Chowdhury
Browse files

Updated conf/java-opts

parent de676428
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
Showing
with 14 additions and 1 deletion
conf/java-opts
+ 14
− 1
View file @ d7081a92
-Dspark.shuffle.class=spark.TrackedCustomBlockedLocalFileShuffle -Dspark.shuffle.masterHostAddress=127.0.0.1 -Dspark.shuffle.masterTrackerPort=22222 -Dspark.shuffle.trackerStrategy=spark.BalanceRemainingShuffleTrackerStrategy -Dspark.shuffle.maxRxConnections=2 -Dspark.shuffle.maxTxConnections=2 -Dspark.shuffle.blockSize=4096 -Dspark.shuffle.minKnockInterval=100 -Dspark.shuffle.maxKnockInterval=2000 -Dspark.shuffle.maxChatTime=10 -Dspark.shuffle.throttleFraction=2.0 -Dspark.shuffle.class=spark.CustomParallelLocalFileShuffle
-Dspark.shuffle.masterHostAddress=127.0.0.1
-Dspark.shuffle.masterTrackerPort=22222
-Dspark.shuffle.trackerStrategy=spark.BalanceRemainingShuffleTrackerStrategy
-Dspark.shuffle.maxRxConnections=40
-Dspark.shuffle.maxTxConnections=120
-Dspark.shuffle.blockSize=4096
-Dspark.shuffle.minKnockInterval=100
-Dspark.shuffle.maxKnockInterval=5000
-Dspark.shuffle.maxChatTime=500
-Dspark.shuffle.throttleFraction=2.0
-verbose:gc
-XX:+PrintGCTimeStamps
-XX:+PrintGCDetails
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment