-
- Downloads
[SPARK-11905][SQL] Support Persist/Cache and Unpersist in Dataset APIs
Persist and Unpersist exist in both RDD and Dataframe APIs. I think they are still very critical in Dataset APIs. Not sure if my understanding is correct? If so, could you help me check if the implementation is acceptable? Please provide your opinions. marmbrus rxin cloud-fan Thank you very much! Author: gatorsmile <gatorsmile@gmail.com> Author: xiaoli <lixiao1983@gmail.com> Author: Xiao Li <xiaoli@Xiaos-MacBook-Pro.local> Closes #9889 from gatorsmile/persistDS.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala 9 additions, 0 deletionssql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala
- sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala 47 additions, 3 deletionssql/core/src/main/scala/org/apache/spark/sql/Dataset.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 9 additions, 0 deletions...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala 14 additions, 13 deletions...n/scala/org/apache/spark/sql/execution/CacheManager.scala
- sql/core/src/test/scala/org/apache/spark/sql/DatasetCacheSuite.scala 80 additions, 0 deletions...c/test/scala/org/apache/spark/sql/DatasetCacheSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala 3 additions, 2 deletionssql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala
Loading
Please register or sign in to comment