-
- Downloads
[SPARK-8753][SQL] Create an IntervalType data type
We need a new data type to represent time intervals. Because we can't determine how many days in a month, so we need 2 values for interval: a int `months`, a long `microseconds`. The interval literal syntax looks like: `interval 3 years -4 month 4 weeks 3 second` Because we use number of 100ns as value of `TimestampType`, so it may not makes sense to support nano second unit. Author: Wenchen Fan <cloud0fan@outlook.com> Closes #7226 from cloud-fan/interval and squashes the following commits: 632062d [Wenchen Fan] address comments ac348c3 [Wenchen Fan] use case class 0342d2e [Wenchen Fan] use array byte df9256c [Wenchen Fan] fix style fd6f18a [Wenchen Fan] address comments 1856af3 [Wenchen Fan] support interval type
Showing
- sql/catalyst/src/main/java/org/apache/spark/sql/types/DataTypes.java 5 additions, 0 deletions...t/src/main/java/org/apache/spark/sql/types/DataTypes.java
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala 67 additions, 19 deletions.../main/scala/org/apache/spark/sql/catalyst/SqlParser.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/types/IntervalType.scala 37 additions, 0 deletions.../main/scala/org/apache/spark/sql/types/IntervalType.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/types/TimestampType.scala 1 addition, 1 deletion...main/scala/org/apache/spark/sql/types/TimestampType.scala
- sql/core/src/main/scala/org/apache/spark/sql/sources/ddl.scala 3 additions, 0 deletions...ore/src/main/scala/org/apache/spark/sql/sources/ddl.scala
- sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala 25 additions, 0 deletions...e/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala
- unsafe/src/main/java/org/apache/spark/unsafe/types/Interval.java 47 additions, 0 deletions...src/main/java/org/apache/spark/unsafe/types/Interval.java
Loading
Please register or sign in to comment