Skip to content
  • William Benton's avatar
    e060d3ee
    SPARK-2226: [SQL] transform HAVING clauses with aggregate expressions that... · e060d3ee
    William Benton authored
    SPARK-2226:  [SQL] transform HAVING clauses with aggregate expressions that aren't in the aggregation list
    
    This change adds an analyzer rule to
      1. find expressions in `HAVING` clause filters that depend on unresolved attributes,
      2. push these expressions down to the underlying aggregates, and then
      3. project them away above the filter.
    
    It also enables the `HAVING` queries in the Hive compatibility suite.
    
    Author: William Benton <willb@redhat.com>
    
    Closes #1497 from willb/spark-2226 and squashes the following commits:
    
    92c9a93 [William Benton] Removed unnecessary import
    f1d4f34 [William Benton] Cleanups missed in prior commit
    0e1624f [William Benton] Incorporated suggestions from @marmbrus; thanks!
    541d4ee [William Benton] Cleanups from review
    5a12647 [William Benton] Explanatory comments and stylistic cleanups.
    c7f2b2c [William Benton] Whitelist HAVING queries.
    29a26e3 [William Benton] Added rule to handle unresolved attributes in HAVING clauses (SPARK-2226)
    e060d3ee
    SPARK-2226: [SQL] transform HAVING clauses with aggregate expressions that...
    William Benton authored
    SPARK-2226:  [SQL] transform HAVING clauses with aggregate expressions that aren't in the aggregation list
    
    This change adds an analyzer rule to
      1. find expressions in `HAVING` clause filters that depend on unresolved attributes,
      2. push these expressions down to the underlying aggregates, and then
      3. project them away above the filter.
    
    It also enables the `HAVING` queries in the Hive compatibility suite.
    
    Author: William Benton <willb@redhat.com>
    
    Closes #1497 from willb/spark-2226 and squashes the following commits:
    
    92c9a93 [William Benton] Removed unnecessary import
    f1d4f34 [William Benton] Cleanups missed in prior commit
    0e1624f [William Benton] Incorporated suggestions from @marmbrus; thanks!
    541d4ee [William Benton] Cleanups from review
    5a12647 [William Benton] Explanatory comments and stylistic cleanups.
    c7f2b2c [William Benton] Whitelist HAVING queries.
    29a26e3 [William Benton] Added rule to handle unresolved attributes in HAVING clauses (SPARK-2226)
Loading