-
- Downloads
[SPARK-5682][CORE] Add encrypted shuffle in spark
This patch is using Apache Commons Crypto library to enable shuffle encryption support. Author: Ferdinand Xu <cheng.a.xu@intel.com> Author: kellyzly <kellyzly@126.com> Closes #8880 from winningsix/SPARK-10771.
Showing
- core/pom.xml 4 additions, 0 deletionscore/pom.xml
- core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeSorterSpillReader.java 1 addition, 1 deletion.../util/collection/unsafe/sort/UnsafeSorterSpillReader.java
- core/src/main/scala/org/apache/spark/SecurityManager.scala 20 additions, 0 deletionscore/src/main/scala/org/apache/spark/SecurityManager.scala
- core/src/main/scala/org/apache/spark/SparkContext.scala 5 additions, 0 deletionscore/src/main/scala/org/apache/spark/SparkContext.scala
- core/src/main/scala/org/apache/spark/internal/config/package.scala 20 additions, 0 deletions...main/scala/org/apache/spark/internal/config/package.scala
- core/src/main/scala/org/apache/spark/security/CryptoStreamUtils.scala 109 additions, 0 deletions...n/scala/org/apache/spark/security/CryptoStreamUtils.scala
- core/src/main/scala/org/apache/spark/serializer/SerializerManager.scala 40 additions, 7 deletions...scala/org/apache/spark/serializer/SerializerManager.scala
- core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala 2 additions, 2 deletions...la/org/apache/spark/shuffle/BlockStoreShuffleReader.scala
- core/src/main/scala/org/apache/spark/storage/BlockManager.scala 2 additions, 3 deletions...rc/main/scala/org/apache/spark/storage/BlockManager.scala
- core/src/main/scala/org/apache/spark/storage/DiskBlockObjectWriter.scala 3 additions, 2 deletions...cala/org/apache/spark/storage/DiskBlockObjectWriter.scala
- core/src/main/scala/org/apache/spark/storage/memory/MemoryStore.scala 1 addition, 1 deletion...n/scala/org/apache/spark/storage/memory/MemoryStore.scala
- core/src/main/scala/org/apache/spark/util/collection/ExternalAppendOnlyMap.scala 2 additions, 2 deletions.../apache/spark/util/collection/ExternalAppendOnlyMap.scala
- core/src/main/scala/org/apache/spark/util/collection/ExternalSorter.scala 3 additions, 3 deletions...ala/org/apache/spark/util/collection/ExternalSorter.scala
- core/src/test/java/org/apache/spark/shuffle/sort/UnsafeShuffleWriterSuite.java 2 additions, 2 deletions...g/apache/spark/shuffle/sort/UnsafeShuffleWriterSuite.java
- core/src/test/java/org/apache/spark/unsafe/map/AbstractBytesToBytesMapSuite.java 2 additions, 2 deletions...apache/spark/unsafe/map/AbstractBytesToBytesMapSuite.java
- core/src/test/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorterSuite.java 2 additions, 2 deletions...til/collection/unsafe/sort/UnsafeExternalSorterSuite.java
- core/src/test/scala/org/apache/spark/security/CryptoStreamUtilsSuite.scala 107 additions, 0 deletions...la/org/apache/spark/security/CryptoStreamUtilsSuite.scala
- core/src/test/scala/org/apache/spark/shuffle/sort/BypassMergeSortShuffleWriterSuite.scala 1 addition, 1 deletion...park/shuffle/sort/BypassMergeSortShuffleWriterSuite.scala
- dev/deps/spark-deps-hadoop-2.2 1 addition, 0 deletionsdev/deps/spark-deps-hadoop-2.2
- dev/deps/spark-deps-hadoop-2.3 1 addition, 0 deletionsdev/deps/spark-deps-hadoop-2.3
Loading
Please register or sign in to comment