-
- Downloads
[SPARK-9818] Re-enable Docker tests for JDBC data source
This patch re-enables tests for the Docker JDBC data source. These tests were reverted in #4872 due to transitive dependency conflicts introduced by the `docker-client` library. This patch should avoid those problems by using a version of `docker-client` which shades its transitive dependencies and by performing some build-magic to work around problems with that shaded JAR. In addition, I significantly refactored the tests to simplify the setup and teardown code and to fix several Docker networking issues which caused problems when running in `boot2docker`. Closes #8101. Author: Josh Rosen <joshrosen@databricks.com> Author: Yijie Shen <henry.yijieshen@gmail.com> Closes #9503 from JoshRosen/docker-jdbc-tests.
Showing
- docker-integration-tests/pom.xml 149 additions, 0 deletionsdocker-integration-tests/pom.xml
- docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/DockerJDBCIntegrationSuite.scala 160 additions, 0 deletions...rg/apache/spark/sql/jdbc/DockerJDBCIntegrationSuite.scala
- docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/MySQLIntegrationSuite.scala 153 additions, 0 deletions...ala/org/apache/spark/sql/jdbc/MySQLIntegrationSuite.scala
- docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/PostgresIntegrationSuite.scala 82 additions, 0 deletions.../org/apache/spark/sql/jdbc/PostgresIntegrationSuite.scala
- docker-integration-tests/src/test/scala/org/apache/spark/util/DockerUtils.scala 68 additions, 0 deletions...ts/src/test/scala/org/apache/spark/util/DockerUtils.scala
- pom.xml 14 additions, 0 deletionspom.xml
- project/SparkBuild.scala 12 additions, 2 deletionsproject/SparkBuild.scala
- tags/src/main/java/org/apache/spark/tags/DockerTest.java 26 additions, 0 deletionstags/src/main/java/org/apache/spark/tags/DockerTest.java
Loading
Please register or sign in to comment