-
- Downloads
[SPARK-10004] [SHUFFLE] Perform auth checks when clients read shuffle data.
To correctly isolate applications, when requests to read shuffle data arrive at the shuffle service, proper authorization checks need to be performed. This change makes sure that only the application that created the shuffle data can read from it. Such checks are only enabled when "spark.authenticate" is enabled, otherwise there's no secure way to make sure that the client is really who it says it is. Author: Marcelo Vanzin <vanzin@cloudera.com> Closes #8218 from vanzin/SPARK-10004.
Showing
- core/src/main/scala/org/apache/spark/network/netty/NettyBlockRpcServer.scala 2 additions, 1 deletion.../org/apache/spark/network/netty/NettyBlockRpcServer.scala
- core/src/main/scala/org/apache/spark/network/netty/NettyBlockTransferService.scala 1 addition, 1 deletion...pache/spark/network/netty/NettyBlockTransferService.scala
- network/common/pom.xml 4 additions, 0 deletionsnetwork/common/pom.xml
- network/common/src/main/java/org/apache/spark/network/client/TransportClient.java 22 additions, 0 deletions...java/org/apache/spark/network/client/TransportClient.java
- network/common/src/main/java/org/apache/spark/network/sasl/SaslClientBootstrap.java 2 additions, 0 deletions...va/org/apache/spark/network/sasl/SaslClientBootstrap.java
- network/common/src/main/java/org/apache/spark/network/sasl/SaslRpcHandler.java 1 addition, 0 deletions...in/java/org/apache/spark/network/sasl/SaslRpcHandler.java
- network/common/src/main/java/org/apache/spark/network/server/OneForOneStreamManager.java 26 additions, 5 deletions...g/apache/spark/network/server/OneForOneStreamManager.java
- network/common/src/main/java/org/apache/spark/network/server/StreamManager.java 9 additions, 0 deletions...n/java/org/apache/spark/network/server/StreamManager.java
- network/common/src/main/java/org/apache/spark/network/server/TransportRequestHandler.java 1 addition, 0 deletions.../apache/spark/network/server/TransportRequestHandler.java
- network/shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockHandler.java 13 additions, 3 deletions...he/spark/network/shuffle/ExternalShuffleBlockHandler.java
- network/shuffle/src/test/java/org/apache/spark/network/sasl/SaslIntegrationSuite.java 138 additions, 25 deletions...a/org/apache/spark/network/sasl/SaslIntegrationSuite.java
- network/shuffle/src/test/java/org/apache/spark/network/shuffle/ExternalShuffleBlockHandlerSuite.java 1 addition, 1 deletion...ark/network/shuffle/ExternalShuffleBlockHandlerSuite.java
- project/MimaExcludes.scala 1 addition, 0 deletionsproject/MimaExcludes.scala
Loading
Please register or sign in to comment