Skip to content
Snippets Groups Projects
  • Felix Cheung's avatar
    af8b6cc8
    [SPARK-20689][PYSPARK] python doctest leaking bucketed table · af8b6cc8
    Felix Cheung authored
    ## What changes were proposed in this pull request?
    
    It turns out pyspark doctest is calling saveAsTable without ever dropping them. Since we have separate python tests for bucketed table, and there is no checking of results, there is really no need to run the doctest, other than leaving it as an example in the generated doc
    
    ## How was this patch tested?
    
    Jenkins
    
    Author: Felix Cheung <felixcheung_m@hotmail.com>
    
    Closes #17932 from felixcheung/pytablecleanup.
    af8b6cc8
    History
    [SPARK-20689][PYSPARK] python doctest leaking bucketed table
    Felix Cheung authored
    ## What changes were proposed in this pull request?
    
    It turns out pyspark doctest is calling saveAsTable without ever dropping them. Since we have separate python tests for bucketed table, and there is no checking of results, there is really no need to run the doctest, other than leaving it as an example in the generated doc
    
    ## How was this patch tested?
    
    Jenkins
    
    Author: Felix Cheung <felixcheung_m@hotmail.com>
    
    Closes #17932 from felixcheung/pytablecleanup.