-
- Downloads
[SPARK-5579][SQL][DataFrame] Support for project/filter using SQL expressions
```scala
df.selectExpr("abs(colA)", "colB")
df.filter("age > 21")
```
Author: Reynold Xin <rxin@databricks.com>
Closes #4348 from rxin/SPARK-5579 and squashes the following commits:
2baeef2 [Reynold Xin] Fix Python.
b416372 [Reynold Xin] [SPARK-5579][SQL][DataFrame] Support for project/filter using SQL expressions.
Showing
- python/pyspark/sql.py 2 additions, 3 deletionspython/pyspark/sql.py
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala 10 additions, 0 deletions.../main/scala/org/apache/spark/sql/catalyst/SqlParser.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala 21 additions, 2 deletionssql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameImpl.scala 16 additions, 6 deletions...e/src/main/scala/org/apache/spark/sql/DataFrameImpl.scala
- sql/core/src/main/scala/org/apache/spark/sql/IncomputableColumn.scala 6 additions, 2 deletions.../main/scala/org/apache/spark/sql/IncomputableColumn.scala
- sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala 12 additions, 0 deletions.../src/test/scala/org/apache/spark/sql/DataFrameSuite.scala
Loading
Please register or sign in to comment