-
- Downloads
[SPARK-12833][SQL] Initial import of spark-csv
CSV is the most common data format in the "small data" world. It is often the first format people want to try when they see Spark on a single node. Having to rely on a 3rd party component for this leads to poor user experience for new users. This PR merges the popular spark-csv data source package (https://github.com/databricks/spark-csv) with SparkSQL. This is a first PR to bring the functionality to spark 2.0 master. We will complete items outlines in the design document (see JIRA attachment) in follow up pull requests. Author: Hossein <hossein@databricks.com> Author: Reynold Xin <rxin@databricks.com> Closes #10766 from rxin/csv.
Showing
- sql/core/src/test/resources/comments.csv 6 additions, 0 deletionssql/core/src/test/resources/comments.csv
- sql/core/src/test/resources/disable_comments.csv 2 additions, 0 deletionssql/core/src/test/resources/disable_comments.csv
- sql/core/src/test/resources/empty.csv 0 additions, 0 deletionssql/core/src/test/resources/empty.csv
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVInferSchemaSuite.scala 71 additions, 0 deletions...k/sql/execution/datasources/csv/CSVInferSchemaSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVParserSuite.scala 125 additions, 0 deletions.../spark/sql/execution/datasources/csv/CSVParserSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala 341 additions, 0 deletions...apache/spark/sql/execution/datasources/csv/CSVSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVTypeCastSuite.scala 98 additions, 0 deletions...park/sql/execution/datasources/csv/CSVTypeCastSuite.scala
Loading
Please register or sign in to comment