diff --git a/updates b/updates index 9df2bcf24a825cee862494a6380532dc98f0bf57..012b173379fd3d070b68d260e764b6e4573e45c1 100755 --- a/updates +++ b/updates @@ -14,15 +14,18 @@ Modified: ==================================================== spark/SparkEnv :: added currentStage variable spark/scheduler/DAGScheduler :: added preRDDs, depMap, curRunningRddMap --- based on narrowancestors and narrowcachedancestors, added renewDepMap function, added args to ShuffleMapTask/ResultTask + spark/scheduler/ResultTask :: modified primary ctor to add argument spark/scheduler/ShuffleMapTask :: modified primary/aux ctor to add arguemnt spark/scheduler/Task :: modified primary/aux ctor to add arguemnt + spark/rdd/RDD :: modified unpersist, added getNarrowCachedAncestors spark/executor/Executor :: for each new stage, store a new StageExInfo object in the environment in stageExInfos spark/executor/CoarseGrainedExecutorBackend :: set SparkEnv, BlockManager currentStage spark/storage/BlockId :: added getRddId, getRddSplitIndex functions spark/storage/BlockManager :: added blockExInfoMap, inMemBlockExInfo set, stageExInfos Map, plus extra logic in removeRDD --- duh, this is because this is where the eviction happens! + NOTE: inMemBlockExInfo is a sorted set based on the normalized cost of an RDD. Created: ====================================================