Skip to content
Snippets Groups Projects
Commit bba436fc authored by skeirik2's avatar skeirik2
Browse files

updated updates file

parent b51570bc
No related branches found
No related tags found
No related merge requests found
......@@ -14,15 +14,18 @@ Modified:
====================================================
spark/SparkEnv :: added currentStage variable
spark/scheduler/DAGScheduler :: added preRDDs, depMap, curRunningRddMap --- based on narrowancestors and narrowcachedancestors, added renewDepMap function, added args to ShuffleMapTask/ResultTask
spark/scheduler/ResultTask :: modified primary ctor to add argument
spark/scheduler/ShuffleMapTask :: modified primary/aux ctor to add arguemnt
spark/scheduler/Task :: modified primary/aux ctor to add arguemnt
spark/rdd/RDD :: modified unpersist, added getNarrowCachedAncestors
spark/executor/Executor :: for each new stage, store a new StageExInfo object in the environment in stageExInfos
spark/executor/CoarseGrainedExecutorBackend :: set SparkEnv, BlockManager currentStage
spark/storage/BlockId :: added getRddId, getRddSplitIndex functions
spark/storage/BlockManager :: added blockExInfoMap, inMemBlockExInfo set, stageExInfos Map,
plus extra logic in removeRDD --- duh, this is because this is where the eviction happens!
NOTE: inMemBlockExInfo is a sorted set based on the normalized cost of an RDD.
Created:
====================================================
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment