-
- Downloads
[SPARK-8610] [SQL] Separate Row and InternalRow (part 2)
Currently, we use GenericRow both for Row and InternalRow, which is confusing because it could contain Scala type also Catalyst types. This PR changes to use GenericInternalRow for InternalRow (contains catalyst types), GenericRow for Row (contains Scala types). Also fixes some incorrect use of InternalRow or Row. Author: Davies Liu <davies@databricks.com> Closes #7003 from davies/internalrow and squashes the following commits: d05866c [Davies Liu] fix test: rollback changes for pyspark 72878dd [Davies Liu] Merge branch 'master' of github.com:apache/spark into internalrow efd0b25 [Davies Liu] fix copy of MutableRow 87b13cf [Davies Liu] fix test d2ebd72 [Davies Liu] fix style eb4b473 [Davies Liu] mark expensive API as final bd4e99c [Davies Liu] Merge branch 'master' of github.com:apache/spark into internalrow bdfb78f [Davies Liu] remove BaseMutableRow 6f99a97 [Davies Liu] fix catalyst test defe931 [Davies Liu] remove BaseRow 288b31f [Davies Liu] Merge branch 'master' of github.com:apache/spark into internalrow 9d24350 [Davies Liu] separate Row and InternalRow (part 2)
Showing
- sql/catalyst/src/main/java/org/apache/spark/sql/BaseMutableRow.java 0 additions, 68 deletions...st/src/main/java/org/apache/spark/sql/BaseMutableRow.java
- sql/catalyst/src/main/java/org/apache/spark/sql/BaseRow.java 0 additions, 197 deletionssql/catalyst/src/main/java/org/apache/spark/sql/BaseRow.java
- sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeRow.java 4 additions, 15 deletions.../org/apache/spark/sql/catalyst/expressions/UnsafeRow.java
- sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala 25 additions, 16 deletionssql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/CatalystTypeConverters.scala 2 additions, 2 deletions...rg/apache/spark/sql/catalyst/CatalystTypeConverters.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/InternalRow.scala 26 additions, 14 deletions...ain/scala/org/apache/spark/sql/catalyst/InternalRow.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Projection.scala 7 additions, 43 deletions...rg/apache/spark/sql/catalyst/expressions/Projection.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/SpecificMutableRow.scala 1 addition, 1 deletion...e/spark/sql/catalyst/expressions/SpecificMutableRow.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/GenerateMutableProjection.scala 1 addition, 1 deletion...alyst/expressions/codegen/GenerateMutableProjection.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/GenerateProjection.scala 13 additions, 3 deletions...sql/catalyst/expressions/codegen/GenerateProjection.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/generators.scala 7 additions, 5 deletions...rg/apache/spark/sql/catalyst/expressions/generators.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/rows.scala 75 additions, 74 deletions...cala/org/apache/spark/sql/catalyst/expressions/rows.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala 2 additions, 2 deletions...spark/sql/catalyst/expressions/ExpressionEvalHelper.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/UnsafeFixedWidthAggregationMapSuite.scala 3 additions, 3 deletions...yst/expressions/UnsafeFixedWidthAggregationMapSuite.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 14 additions, 10 deletions...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/main/scala/org/apache/spark/sql/columnar/ColumnType.scala 35 additions, 35 deletions...main/scala/org/apache/spark/sql/columnar/ColumnType.scala
- sql/core/src/main/scala/org/apache/spark/sql/columnar/InMemoryColumnarTableScan.scala 2 additions, 1 deletion...apache/spark/sql/columnar/InMemoryColumnarTableScan.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlSerializer.scala 10 additions, 11 deletions...a/org/apache/spark/sql/execution/SparkSqlSerializer.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlSerializer2.scala 3 additions, 2 deletions.../org/apache/spark/sql/execution/SparkSqlSerializer2.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala 1 addition, 2 deletions...cala/org/apache/spark/sql/execution/SparkStrategies.scala
Loading
Please register or sign in to comment