-
- Downloads
[SPARK-19397][SQL] Make option names of LIBSVM and TEXT case insensitive
### What changes were proposed in this pull request? Prior to Spark 2.1, the option names are case sensitive for all the formats. Since Spark 2.1, the option key names become case insensitive except the format `Text` and `LibSVM `. This PR is to fix these issues. Also, add a check to know whether the input option vector type is legal for `LibSVM`. ### How was this patch tested? Added test cases Author: gatorsmile <gatorsmile@gmail.com> Closes #16737 from gatorsmile/libSVMTextOptions.
Showing
- mllib/src/main/scala/org/apache/spark/ml/source/libsvm/LibSVMOptions.scala 51 additions, 0 deletions...ala/org/apache/spark/ml/source/libsvm/LibSVMOptions.scala
- mllib/src/main/scala/org/apache/spark/ml/source/libsvm/LibSVMRelation.scala 8 additions, 6 deletions...la/org/apache/spark/ml/source/libsvm/LibSVMRelation.scala
- mllib/src/test/scala/org/apache/spark/ml/source/libsvm/LibSVMRelationSuite.scala 14 additions, 0 deletions...g/apache/spark/ml/source/libsvm/LibSVMRelationSuite.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/text/TextFileFormat.scala 3 additions, 2 deletions...spark/sql/execution/datasources/text/TextFileFormat.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/text/TextOptions.scala 40 additions, 0 deletions...he/spark/sql/execution/datasources/text/TextOptions.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/text/TextSuite.scala 20 additions, 2 deletions...ache/spark/sql/execution/datasources/text/TextSuite.scala
Loading
Please register or sign in to comment