Skip to content
Snippets Groups Projects
Commit 82c8c37c authored by Marcelo Vanzin's avatar Marcelo Vanzin Committed by Sean Owen
Browse files

[MINOR] [HIVE] Fix QueryPartitionSuite.

At least in the version of Hive I tested on, the test was deleting
a temp directory generated by Hive instead of one containing partition
data. So fix the filter to only consider partition directories when
deciding what to delete.

Author: Marcelo Vanzin <vanzin@cloudera.com>

Closes #5854 from vanzin/hive-test-fix and squashes the following commits:

7594ae9 [Marcelo Vanzin] Fix typo.
729fa80 [Marcelo Vanzin] [minor] [hive] Fix QueryPartitionSuite.
parent bfcd528d
No related branches found
No related tags found
No related merge requests found
......@@ -28,7 +28,7 @@ import org.apache.spark.util.Utils
class QueryPartitionSuite extends QueryTest {
import org.apache.spark.sql.hive.test.TestHive.implicits._
test("SPARK-5068: query data when path doesn't exists"){
test("SPARK-5068: query data when path doesn't exist"){
val testData = TestHive.sparkContext.parallelize(
(1 to 10).map(i => TestData(i, i.toString))).toDF()
testData.registerTempTable("testData")
......@@ -52,8 +52,9 @@ class QueryPartitionSuite extends QueryTest {
++ testData.toSchemaRDD.collect ++ testData.toSchemaRDD.collect)
// delete the path of one partition
val folders = tmpDir.listFiles.filter(_.isDirectory)
Utils.deleteRecursively(folders(0))
tmpDir.listFiles
.find { f => f.isDirectory && f.getName().startsWith("ds=") }
.foreach { f => Utils.deleteRecursively(f) }
// test for after delete the path
checkAnswer(sql("select key,value from table_with_partition"),
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment