Skip to content
Snippets Groups Projects
  • Wenchen Fan's avatar
    2d05f325
    [SPARK-7133] [SQL] Implement struct, array, and map field accessor · 2d05f325
    Wenchen Fan authored
    It's the first step: generalize UnresolvedGetField to support all map, struct, and array
    TODO: add `apply` in Scala and `__getitem__` in Python, and unify the `getItem` and `getField` methods to one single API(or should we keep them for compatibility?).
    
    Author: Wenchen Fan <cloud0fan@outlook.com>
    
    Closes #5744 from cloud-fan/generalize and squashes the following commits:
    
    715c589 [Wenchen Fan] address comments
    7ea5b31 [Wenchen Fan] fix python test
    4f0833a [Wenchen Fan] add python test
    f515d69 [Wenchen Fan] add apply method and test cases
    8df6199 [Wenchen Fan] fix python test
    239730c [Wenchen Fan] fix test compile
    2a70526 [Wenchen Fan] use _bin_op in dataframe.py
    6bf72bc [Wenchen Fan] address comments
    3f880c3 [Wenchen Fan] add java doc
    ab35ab5 [Wenchen Fan] fix python test
    b5961a9 [Wenchen Fan] fix style
    c9d85f5 [Wenchen Fan] generalize UnresolvedGetField to support all map, struct, and array
    2d05f325
    History
    [SPARK-7133] [SQL] Implement struct, array, and map field accessor
    Wenchen Fan authored
    It's the first step: generalize UnresolvedGetField to support all map, struct, and array
    TODO: add `apply` in Scala and `__getitem__` in Python, and unify the `getItem` and `getField` methods to one single API(or should we keep them for compatibility?).
    
    Author: Wenchen Fan <cloud0fan@outlook.com>
    
    Closes #5744 from cloud-fan/generalize and squashes the following commits:
    
    715c589 [Wenchen Fan] address comments
    7ea5b31 [Wenchen Fan] fix python test
    4f0833a [Wenchen Fan] add python test
    f515d69 [Wenchen Fan] add apply method and test cases
    8df6199 [Wenchen Fan] fix python test
    239730c [Wenchen Fan] fix test compile
    2a70526 [Wenchen Fan] use _bin_op in dataframe.py
    6bf72bc [Wenchen Fan] address comments
    3f880c3 [Wenchen Fan] add java doc
    ab35ab5 [Wenchen Fan] fix python test
    b5961a9 [Wenchen Fan] fix style
    c9d85f5 [Wenchen Fan] generalize UnresolvedGetField to support all map, struct, and array