-
- Downloads
[SPARK-16021] Fill freed memory in test to help catch correctness bugs
## What changes were proposed in this pull request? This patches `MemoryAllocator` to fill clean and freed memory with known byte values, similar to https://github.com/jemalloc/jemalloc/wiki/Use-Case:-Find-a-memory-corruption-bug . Memory filling is flag-enabled in test only by default. ## How was this patch tested? Unit test that it's on in test. cc sameeragarwal Author: Eric Liang <ekl@databricks.com> Closes #13983 from ericl/spark-16021.
Showing
- common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java 4 additions, 0 deletions...nsafe/src/main/java/org/apache/spark/unsafe/Platform.java
- common/unsafe/src/main/java/org/apache/spark/unsafe/memory/HeapMemoryAllocator.java 9 additions, 1 deletion...a/org/apache/spark/unsafe/memory/HeapMemoryAllocator.java
- common/unsafe/src/main/java/org/apache/spark/unsafe/memory/MemoryAllocator.java 12 additions, 1 deletion.../java/org/apache/spark/unsafe/memory/MemoryAllocator.java
- common/unsafe/src/main/java/org/apache/spark/unsafe/memory/MemoryBlock.java 7 additions, 0 deletions...main/java/org/apache/spark/unsafe/memory/MemoryBlock.java
- common/unsafe/src/main/java/org/apache/spark/unsafe/memory/UnsafeMemoryAllocator.java 8 additions, 1 deletion...org/apache/spark/unsafe/memory/UnsafeMemoryAllocator.java
- common/unsafe/src/test/java/org/apache/spark/unsafe/PlatformUtilSuite.java 16 additions, 0 deletions.../test/java/org/apache/spark/unsafe/PlatformUtilSuite.java
- project/SparkBuild.scala 1 addition, 0 deletionsproject/SparkBuild.scala
Loading
Please register or sign in to comment