Skip to content
  • Cheng Hao's avatar
    13321e65
    [SPARK-7859] [SQL] Collect_set() behavior differences which fails the unit test under jdk8 · 13321e65
    Cheng Hao authored
    To reproduce that:
    ```
    JAVA_HOME=/home/hcheng/Java/jdk1.8.0_45 | build/sbt -Phadoop-2.3 -Phive  'test-only org.apache.spark.sql.hive.execution.HiveWindowFunctionQueryWithoutCodeGenSuite'
    ```
    
    A simple workaround to fix that is update the original query, for getting the output size instead of the exact elements of the array (output by collect_set())
    
    Author: Cheng Hao <hao.cheng@intel.com>
    
    Closes #6402 from chenghao-intel/windowing and squashes the following commits:
    
    99312ad [Cheng Hao] add order by for the select clause
    edf8ce3 [Cheng Hao] update the code as suggested
    7062da7 [Cheng Hao] fix the collect_set() behaviour differences under different versions of JDK
    13321e65
    [SPARK-7859] [SQL] Collect_set() behavior differences which fails the unit test under jdk8
    Cheng Hao authored
    To reproduce that:
    ```
    JAVA_HOME=/home/hcheng/Java/jdk1.8.0_45 | build/sbt -Phadoop-2.3 -Phive  'test-only org.apache.spark.sql.hive.execution.HiveWindowFunctionQueryWithoutCodeGenSuite'
    ```
    
    A simple workaround to fix that is update the original query, for getting the output size instead of the exact elements of the array (output by collect_set())
    
    Author: Cheng Hao <hao.cheng@intel.com>
    
    Closes #6402 from chenghao-intel/windowing and squashes the following commits:
    
    99312ad [Cheng Hao] add order by for the select clause
    edf8ce3 [Cheng Hao] update the code as suggested
    7062da7 [Cheng Hao] fix the collect_set() behaviour differences under different versions of JDK
Loading