Skip to content
Snippets Groups Projects
  • Anant's avatar
    010c460d
    [SPARK-2061] Made splits deprecated in JavaRDDLike · 010c460d
    Anant authored
    The jira for the issue can be found at: https://issues.apache.org/jira/browse/SPARK-2061
    Most of spark has used over to consistently using `partitions` instead of `splits`. We should do likewise and add a `partitions` method to JavaRDDLike and have `splits` just call that. We should also go through all cases where other API's (e.g. Python) call `splits` and we should change those to use the newer API.
    
    Author: Anant <anant.asty@gmail.com>
    
    Closes #1062 from anantasty/SPARK-2061 and squashes the following commits:
    
    b83ce6b [Anant] Fixed syntax issue
    21f9210 [Anant] Fixed version number in deprecation string
    9315b76 [Anant] made related changes to use partitions in python api
    8c62dd1 [Anant] Made splits deprecated in JavaRDDLike
    010c460d
    History
    [SPARK-2061] Made splits deprecated in JavaRDDLike
    Anant authored
    The jira for the issue can be found at: https://issues.apache.org/jira/browse/SPARK-2061
    Most of spark has used over to consistently using `partitions` instead of `splits`. We should do likewise and add a `partitions` method to JavaRDDLike and have `splits` just call that. We should also go through all cases where other API's (e.g. Python) call `splits` and we should change those to use the newer API.
    
    Author: Anant <anant.asty@gmail.com>
    
    Closes #1062 from anantasty/SPARK-2061 and squashes the following commits:
    
    b83ce6b [Anant] Fixed syntax issue
    21f9210 [Anant] Fixed version number in deprecation string
    9315b76 [Anant] made related changes to use partitions in python api
    8c62dd1 [Anant] Made splits deprecated in JavaRDDLike
context.py 31.41 KiB