-
- Downloads
[SPARK-2190][SQL] Specialized ColumnType for Timestamp
JIRA issue: [SPARK-2190](https://issues.apache.org/jira/browse/SPARK-2190) Added specialized in-memory column type for `Timestamp`. Whitelisted all timestamp related Hive tests except `timestamp_udf`, which is timezone sensitive. Author: Cheng Lian <lian.cs.zju@gmail.com> Closes #1440 from liancheng/timestamp-column-type and squashes the following commits: e682175 [Cheng Lian] Enabled more timezone sensitive Hive tests. 53a358f [Cheng Lian] Fixed failed test suites 01b592d [Cheng Lian] Fixed SimpleDateFormat thread safety issue 2a59343 [Cheng Lian] Removed timezone sensitive Hive timestamp tests 45dd05d [Cheng Lian] Added Timestamp specific in-memory columnar representation
Showing
- .gitignore 1 addition, 0 deletions.gitignore
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala 23 additions, 0 deletions...cala/org/apache/spark/sql/catalyst/expressions/Cast.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvaluationSuite.scala 11 additions, 11 deletions.../sql/catalyst/expressions/ExpressionEvaluationSuite.scala
- sql/core/src/main/scala/org/apache/spark/sql/columnar/ColumnAccessor.scala 14 additions, 10 deletions.../scala/org/apache/spark/sql/columnar/ColumnAccessor.scala
- sql/core/src/main/scala/org/apache/spark/sql/columnar/ColumnBuilder.scala 3 additions, 0 deletions...n/scala/org/apache/spark/sql/columnar/ColumnBuilder.scala
- sql/core/src/main/scala/org/apache/spark/sql/columnar/ColumnStats.scala 34 additions, 3 deletions...ain/scala/org/apache/spark/sql/columnar/ColumnStats.scala
- sql/core/src/main/scala/org/apache/spark/sql/columnar/ColumnType.scala 35 additions, 12 deletions...main/scala/org/apache/spark/sql/columnar/ColumnType.scala
- sql/core/src/test/scala/org/apache/spark/sql/columnar/ColumnStatsSuite.scala 9 additions, 8 deletions...cala/org/apache/spark/sql/columnar/ColumnStatsSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/columnar/ColumnTypeSuite.scala 13 additions, 21 deletions...scala/org/apache/spark/sql/columnar/ColumnTypeSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/columnar/ColumnarTestUtils.scala 15 additions, 10 deletions...ala/org/apache/spark/sql/columnar/ColumnarTestUtils.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala 3 additions, 0 deletions...rc/main/scala/org/apache/spark/sql/hive/HiveContext.scala
- sql/hive/src/test/resources/golden/timestamp_1-10-343c75daac6695917608c17db8bf473e 1 addition, 0 deletions...es/golden/timestamp_1-10-343c75daac6695917608c17db8bf473e
- sql/hive/src/test/resources/golden/timestamp_1-11-cf19f7359a6d3456c4526b2c69f92d6a 1 addition, 0 deletions...es/golden/timestamp_1-11-cf19f7359a6d3456c4526b2c69f92d6a
- sql/hive/src/test/resources/golden/timestamp_1-12-6328d3b3dfd295dd5ec453ffb47ff4d0 0 additions, 0 deletions...es/golden/timestamp_1-12-6328d3b3dfd295dd5ec453ffb47ff4d0
- sql/hive/src/test/resources/golden/timestamp_1-13-90269c1e50c7ae8e75ca9cc297982135 1 addition, 0 deletions...es/golden/timestamp_1-13-90269c1e50c7ae8e75ca9cc297982135
- sql/hive/src/test/resources/golden/timestamp_1-14-e6bfca320c4ee3aff39cf2f179d57da6 1 addition, 0 deletions...es/golden/timestamp_1-14-e6bfca320c4ee3aff39cf2f179d57da6
- sql/hive/src/test/resources/golden/timestamp_1-15-d0291a9bd42054b2732cb4f54cf39ae7 1 addition, 0 deletions...es/golden/timestamp_1-15-d0291a9bd42054b2732cb4f54cf39ae7
- sql/hive/src/test/resources/golden/timestamp_1-16-e7b398d2a8107a42419c83771bda41e6 1 addition, 0 deletions...es/golden/timestamp_1-16-e7b398d2a8107a42419c83771bda41e6
- sql/hive/src/test/resources/golden/timestamp_1-17-a3eeec08bccae78d0d94ad2cb923e1cf 1 addition, 0 deletions...es/golden/timestamp_1-17-a3eeec08bccae78d0d94ad2cb923e1cf
- sql/hive/src/test/resources/golden/timestamp_1-18-67f274bf16de625cf4e85af0c6185cac 1 addition, 0 deletions...es/golden/timestamp_1-18-67f274bf16de625cf4e85af0c6185cac
Loading
Please register or sign in to comment