-
- Downloads
[SPARK-12966][SQL] ArrayType(DecimalType) support in Postgres JDBC
Fixes error `org.postgresql.util.PSQLException: Unable to find server array type for provided name decimal(38,18)`. * Passes scale metadata to JDBC dialect for usage in type conversions. * Removes unused length/scale/precision parameters from `createArrayOf` parameter `typeName` (for writing). * Adds configurable precision and scale to Postgres `DecimalType` (for reading). * Adds a new kind of test that verifies the schema written by `DataFrame.write.jdbc`. Author: Brandon Bradley <bradleytastic@gmail.com> Closes #10928 from blbradley/spark-12966.
Showing
- docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/PostgresIntegrationSuite.scala 11 additions, 5 deletions.../org/apache/spark/sql/jdbc/PostgresIntegrationSuite.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala 3 additions, 1 deletion...apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala 4 additions, 1 deletion...ache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala
- sql/core/src/main/scala/org/apache/spark/sql/jdbc/PostgresDialect.scala 12 additions, 6 deletions...ain/scala/org/apache/spark/sql/jdbc/PostgresDialect.scala
Loading
Please register or sign in to comment