-
- Downloads
[SPARK-8307] [SQL] improve timestamp from parquet
This PR change to convert julian day to unix timestamp directly (without Calendar and Timestamp). cc adrian-wang rxin Author: Davies Liu <davies@databricks.com> Closes #6759 from davies/improve_ts and squashes the following commits: 849e301 [Davies Liu] Merge branch 'master' of github.com:apache/spark into improve_ts b0e4cad [Davies Liu] Merge branch 'master' of github.com:apache/spark into improve_ts 8e2d56f [Davies Liu] address comments 634b9f5 [Davies Liu] fix mima 4891efb [Davies Liu] address comment bfc437c [Davies Liu] fix build ae5979c [Davies Liu] Merge branch 'master' of github.com:apache/spark into improve_ts 602b969 [Davies Liu] remove jodd 2f2e48c [Davies Liu] fix test 8ace611 [Davies Liu] fix mima 212143b [Davies Liu] fix mina c834108 [Davies Liu] Merge branch 'master' of github.com:apache/spark into improve_ts a3171b8 [Davies Liu] Merge branch 'master' of github.com:apache/spark into improve_ts 5233974 [Davies Liu] fix scala style 361fd62 [Davies Liu] address comments ea196d4 [Davies Liu] improve timestamp from parquet
Showing
- pom.xml 0 additions, 1 deletionpom.xml
- project/MimaExcludes.scala 11 additions, 1 deletionproject/MimaExcludes.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/CatalystTypeConverters.scala 7 additions, 7 deletions...rg/apache/spark/sql/catalyst/CatalystTypeConverters.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala 8 additions, 8 deletions...cala/org/apache/spark/sql/catalyst/expressions/Cast.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/literals.scala 3 additions, 3 deletions.../org/apache/spark/sql/catalyst/expressions/literals.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala 36 additions, 5 deletions...la/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CastSuite.scala 6 additions, 5 deletions...org/apache/spark/sql/catalyst/expressions/CastSuite.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/PredicateSuite.scala 3 additions, 3 deletions...pache/spark/sql/catalyst/expressions/PredicateSuite.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/UnsafeRowConverterSuite.scala 5 additions, 5 deletions...rk/sql/catalyst/expressions/UnsafeRowConverterSuite.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala 20 additions, 8 deletions...g/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala
- sql/core/pom.xml 0 additions, 5 deletionssql/core/pom.xml
- sql/core/src/main/scala/org/apache/spark/sql/execution/pythonUdfs.scala 5 additions, 5 deletions...ain/scala/org/apache/spark/sql/execution/pythonUdfs.scala
- sql/core/src/main/scala/org/apache/spark/sql/jdbc/JDBCRDD.scala 6 additions, 6 deletions...re/src/main/scala/org/apache/spark/sql/jdbc/JDBCRDD.scala
- sql/core/src/main/scala/org/apache/spark/sql/json/JacksonParser.scala 3 additions, 3 deletions.../main/scala/org/apache/spark/sql/json/JacksonParser.scala
- sql/core/src/main/scala/org/apache/spark/sql/json/JsonRDD.scala 4 additions, 4 deletions...re/src/main/scala/org/apache/spark/sql/json/JsonRDD.scala
- sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetConverter.scala 11 additions, 75 deletions...scala/org/apache/spark/sql/parquet/ParquetConverter.scala
- sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableSupport.scala 13 additions, 6 deletions...la/org/apache/spark/sql/parquet/ParquetTableSupport.scala
- sql/core/src/main/scala/org/apache/spark/sql/parquet/timestamp/NanoTime.scala 0 additions, 69 deletions...ala/org/apache/spark/sql/parquet/timestamp/NanoTime.scala
- sql/core/src/test/scala/org/apache/spark/sql/json/JsonSuite.scala 11 additions, 9 deletions.../src/test/scala/org/apache/spark/sql/json/JsonSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetIOSuite.scala 2 additions, 2 deletions...t/scala/org/apache/spark/sql/parquet/ParquetIOSuite.scala
Loading
Please register or sign in to comment