-
- Downloads
[SPARK-11563][CORE][REPL] Use RpcEnv to transfer REPL-generated classes.
This avoids bringing up yet another HTTP server on the driver, and instead reuses the file server already managed by the driver's RpcEnv. As a bonus, the repl now inherits the security features of the network library. There's also a small change to create the directory for storing classes under the root temp dir for the application (instead of directly under java.io.tmpdir). Author: Marcelo Vanzin <vanzin@cloudera.com> Closes #9923 from vanzin/SPARK-11563.
Showing
- core/src/main/scala/org/apache/spark/HttpFileServer.scala 5 additions, 0 deletionscore/src/main/scala/org/apache/spark/HttpFileServer.scala
- core/src/main/scala/org/apache/spark/HttpServer.scala 17 additions, 9 deletionscore/src/main/scala/org/apache/spark/HttpServer.scala
- core/src/main/scala/org/apache/spark/SparkContext.scala 6 additions, 0 deletionscore/src/main/scala/org/apache/spark/SparkContext.scala
- core/src/main/scala/org/apache/spark/executor/Executor.scala 3 additions, 3 deletionscore/src/main/scala/org/apache/spark/executor/Executor.scala
- core/src/main/scala/org/apache/spark/rpc/RpcEnv.scala 18 additions, 0 deletionscore/src/main/scala/org/apache/spark/rpc/RpcEnv.scala
- core/src/main/scala/org/apache/spark/rpc/akka/AkkaRpcEnv.scala 5 additions, 0 deletions...src/main/scala/org/apache/spark/rpc/akka/AkkaRpcEnv.scala
- core/src/main/scala/org/apache/spark/rpc/netty/NettyStreamManager.scala 21 additions, 1 deletion...scala/org/apache/spark/rpc/netty/NettyStreamManager.scala
- core/src/test/scala/org/apache/spark/rpc/RpcEnvSuite.scala 23 additions, 2 deletionscore/src/test/scala/org/apache/spark/rpc/RpcEnvSuite.scala
- docs/configuration.md 0 additions, 8 deletionsdocs/configuration.md
- docs/security.md 0 additions, 8 deletionsdocs/security.md
- repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkILoop.scala 11 additions, 6 deletions....10/src/main/scala/org/apache/spark/repl/SparkILoop.scala
- repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkIMain.scala 4 additions, 24 deletions....10/src/main/scala/org/apache/spark/repl/SparkIMain.scala
- repl/scala-2.11/src/main/scala/org/apache/spark/repl/Main.scala 12 additions, 11 deletions...cala-2.11/src/main/scala/org/apache/spark/repl/Main.scala
- repl/src/main/scala/org/apache/spark/repl/ExecutorClassLoader.scala 20 additions, 16 deletions...ain/scala/org/apache/spark/repl/ExecutorClassLoader.scala
- repl/src/test/scala/org/apache/spark/repl/ExecutorClassLoaderSuite.scala 38 additions, 10 deletions...cala/org/apache/spark/repl/ExecutorClassLoaderSuite.scala
Loading
Please register or sign in to comment