Skip to content
Snippets Groups Projects
Commit da25c86d authored by Yin Huai's avatar Yin Huai Committed by Cheng Lian
Browse files

[SQL] Use path.makeQualified in newParquet.

Author: Yin Huai <yhuai@databricks.com>

Closes #5353 from yhuai/wrongFS and squashes the following commits:

849603b [Yin Huai] Not use deprecated method.
6d6ae34 [Yin Huai] Use path.makeQualified.
parent 9b40c17a
No related branches found
No related tags found
No related merge requests found
...@@ -268,7 +268,8 @@ private[sql] case class ParquetRelation2( ...@@ -268,7 +268,8 @@ private[sql] case class ParquetRelation2(
// containing Parquet files (e.g. partitioned Parquet table). // containing Parquet files (e.g. partitioned Parquet table).
val baseStatuses = paths.distinct.map { p => val baseStatuses = paths.distinct.map { p =>
val fs = FileSystem.get(URI.create(p), sparkContext.hadoopConfiguration) val fs = FileSystem.get(URI.create(p), sparkContext.hadoopConfiguration)
val qualified = fs.makeQualified(new Path(p)) val path = new Path(p)
val qualified = path.makeQualified(fs.getUri, fs.getWorkingDirectory)
if (!fs.exists(qualified) && maybeSchema.isDefined) { if (!fs.exists(qualified) && maybeSchema.isDefined) {
fs.mkdirs(qualified) fs.mkdirs(qualified)
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment