-
- Downloads
Merge pull request #279 from aarondav/shuffle-cleanup0
Clean up shuffle files once their metadata is gone Previously, we would only clean the in-memory metadata for consolidated shuffle files. Additionally, fixes a bug where the Metadata Cleaner was ignoring type-specific TTLs.
No related branches found
No related tags found
Showing
- core/src/main/scala/org/apache/spark/storage/ShuffleBlockManager.scala 22 additions, 3 deletions.../scala/org/apache/spark/storage/ShuffleBlockManager.scala
- core/src/main/scala/org/apache/spark/util/MetadataCleaner.scala 1 addition, 1 deletion...rc/main/scala/org/apache/spark/util/MetadataCleaner.scala
- core/src/main/scala/org/apache/spark/util/TimeStampedHashMap.scala 12 additions, 3 deletions...main/scala/org/apache/spark/util/TimeStampedHashMap.scala
Loading
Please register or sign in to comment