-
- Downloads
[SPARK-9360] [SQL] Support BinaryType in PrefixComparators for UnsafeExternalSort
The current implementation of UnsafeExternalSort uses NoOpPrefixComparator for binary-typed data. So, we need to add BinaryPrefixComparator in PrefixComparators. Author: Takeshi YAMAMURO <linguin.m.s@gmail.com> Closes #7676 from maropu/BinaryTypePrefixComparator and squashes the following commits: fe6f31b [Takeshi YAMAMURO] Apply comments d943c04 [Takeshi YAMAMURO] Add a codegen'd entry for BinaryType in SortPrefix ecf3ac5 [Takeshi YAMAMURO] Support BinaryType in PrefixComparator
Showing
- core/src/main/java/org/apache/spark/util/collection/unsafe/sort/PrefixComparators.java 35 additions, 0 deletions.../spark/util/collection/unsafe/sort/PrefixComparators.java
- core/src/test/scala/org/apache/spark/util/collection/unsafe/sort/PrefixComparatorsSuite.scala 38 additions, 0 deletions.../util/collection/unsafe/sort/PrefixComparatorsSuite.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/SortOrder.scala 3 additions, 0 deletions...org/apache/spark/sql/catalyst/expressions/SortOrder.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SortPrefixUtils.scala 2 additions, 0 deletions...cala/org/apache/spark/sql/execution/SortPrefixUtils.scala
Loading
Please register or sign in to comment