Skip to content
Snippets Groups Projects
  • Reynold Xin's avatar
    e1a897b6
    [SPARK-11274] [SQL] Text data source support for Spark SQL. · e1a897b6
    Reynold Xin authored
    This adds API for reading and writing text files, similar to SparkContext.textFile and RDD.saveAsTextFile.
    ```
    SQLContext.read.text("/path/to/something.txt")
    DataFrame.write.text("/path/to/write.txt")
    ```
    
    Using the new Dataset API, this also supports
    ```
    val ds: Dataset[String] = SQLContext.read.text("/path/to/something.txt").as[String]
    ```
    
    Author: Reynold Xin <rxin@databricks.com>
    
    Closes #9240 from rxin/SPARK-11274.
    e1a897b6
    History
    [SPARK-11274] [SQL] Text data source support for Spark SQL.
    Reynold Xin authored
    This adds API for reading and writing text files, similar to SparkContext.textFile and RDD.saveAsTextFile.
    ```
    SQLContext.read.text("/path/to/something.txt")
    DataFrame.write.text("/path/to/write.txt")
    ```
    
    Using the new Dataset API, this also supports
    ```
    val ds: Dataset[String] = SQLContext.read.text("/path/to/something.txt").as[String]
    ```
    
    Author: Reynold Xin <rxin@databricks.com>
    
    Closes #9240 from rxin/SPARK-11274.