Skip to content
Snippets Groups Projects
Commit 7ad8c5d8 authored by Mingfei's avatar Mingfei Committed by Andrew Or
Browse files

[SPARK-8161] Set externalBlockStoreInitialized to be true, after ExternalBlockStore is initialized

externalBlockStoreInitialized is never set to be true, which causes the blocks stored in ExternalBlockStore can not be removed.

Author: Mingfei <mingfei.shi@intel.com>

Closes #6702 from shimingfei/SetTrue and squashes the following commits:

add61d8 [Mingfei] Set externalBlockStoreInitialized to be true, after ExternalBlockStore is initialized
parent 98ee3512
No related branches found
No related tags found
No related merge requests found
...@@ -83,8 +83,10 @@ private[spark] class BlockManager( ...@@ -83,8 +83,10 @@ private[spark] class BlockManager(
private var externalBlockStoreInitialized = false private var externalBlockStoreInitialized = false
private[spark] val memoryStore = new MemoryStore(this, maxMemory) private[spark] val memoryStore = new MemoryStore(this, maxMemory)
private[spark] val diskStore = new DiskStore(this, diskBlockManager) private[spark] val diskStore = new DiskStore(this, diskBlockManager)
private[spark] lazy val externalBlockStore: ExternalBlockStore = private[spark] lazy val externalBlockStore: ExternalBlockStore = {
externalBlockStoreInitialized = true
new ExternalBlockStore(this, executorId) new ExternalBlockStore(this, executorId)
}
private[spark] private[spark]
val externalShuffleServiceEnabled = conf.getBoolean("spark.shuffle.service.enabled", false) val externalShuffleServiceEnabled = conf.getBoolean("spark.shuffle.service.enabled", false)
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment