Skip to content
  • Holden Karau's avatar
    da35330e
    Spark-3406 add a default storage level to python RDD persist API · da35330e
    Holden Karau authored
    Author: Holden Karau <holden@pigscanfly.ca>
    
    Closes #2280 from holdenk/SPARK-3406-Python-RDD-persist-api-does-not-have-default-storage-level and squashes the following commits:
    
    33eaade [Holden Karau] As Josh pointed out, sql also override persist. Make persist behave the same as in the underlying RDD as well
    e658227 [Holden Karau] Fix the test I added
    e95a6c5 [Holden Karau] The Python persist function did not have a default storageLevel unlike the Scala API. Noticed this issue because we got a bug report back from the book where we had documented it as if it was the same as the Scala API
    da35330e
    Spark-3406 add a default storage level to python RDD persist API
    Holden Karau authored
    Author: Holden Karau <holden@pigscanfly.ca>
    
    Closes #2280 from holdenk/SPARK-3406-Python-RDD-persist-api-does-not-have-default-storage-level and squashes the following commits:
    
    33eaade [Holden Karau] As Josh pointed out, sql also override persist. Make persist behave the same as in the underlying RDD as well
    e658227 [Holden Karau] Fix the test I added
    e95a6c5 [Holden Karau] The Python persist function did not have a default storageLevel unlike the Scala API. Noticed this issue because we got a bug report back from the book where we had documented it as if it was the same as the Scala API
Loading