-
- Downloads
[SPARK-3616] Add basic Selenium tests to WebUISuite
This patch adds Selenium tests for Spark's web UI. To avoid adding extra dependencies to the test environment, the tests use Selenium's HtmlUnitDriver, which is pure-Java, instead of, say, ChromeDriver. I added new tests to try to reproduce a few UI bugs reported on JIRA, namely SPARK-3021, SPARK-2105, and SPARK-2527. I wasn't able to reproduce these bugs; I suspect that the older ones might have been fixed by other patches. In order to use HtmlUnitDriver, I added an explicit dependency on the org.apache.httpcomponents version of httpclient in order to prevent jets3t's older version from taking precedence on the classpath. I also upgraded ScalaTest to 2.2.1. Author: Josh Rosen <joshrosen@apache.org> Author: Josh Rosen <joshrosen@databricks.com> Closes #2474 from JoshRosen/webui-selenium-tests and squashes the following commits: fcc9e83 [Josh Rosen] scalautils -> scalactic package rename 510e54a [Josh Rosen] [SPARK-3616] Add basic Selenium tests to WebUISuite.
Showing
- core/pom.xml 5 additions, 0 deletionscore/pom.xml
- core/src/main/scala/org/apache/spark/ui/UIUtils.scala 4 additions, 3 deletionscore/src/main/scala/org/apache/spark/ui/UIUtils.scala
- core/src/main/scala/org/apache/spark/ui/WebUI.scala 1 addition, 1 deletioncore/src/main/scala/org/apache/spark/ui/WebUI.scala
- core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala 4 additions, 2 deletions.../src/main/scala/org/apache/spark/ui/storage/RDDPage.scala
- core/src/main/scala/org/apache/spark/ui/storage/StoragePage.scala 1 addition, 1 deletion.../main/scala/org/apache/spark/ui/storage/StoragePage.scala
- core/src/test/scala/org/apache/spark/ui/UISeleniumSuite.scala 112 additions, 0 deletions.../src/test/scala/org/apache/spark/ui/UISeleniumSuite.scala
- pom.xml 7 additions, 1 deletionpom.xml
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvaluationSuite.scala 1 addition, 1 deletion.../sql/catalyst/expressions/ExpressionEvaluationSuite.scala
Loading
Please register or sign in to comment