Skip to content
Snippets Groups Projects
Commit d8a87a3e authored by hyukjinkwon's avatar hyukjinkwon Committed by Davies Liu
Browse files

[TRIVIAL] [PYSPARK] Clean up orc compression option as well

## What changes were proposed in this pull request?

This PR corrects ORC compression option for PySpark as well. I think this was missed mistakenly in https://github.com/apache/spark/pull/13948.

## How was this patch tested?

N/A

Author: hyukjinkwon <gurwls223@gmail.com>

Closes #13963 from HyukjinKwon/minor-orc-compress.
parent 64132a14
No related branches found
No related tags found
No related merge requests found
......@@ -695,8 +695,7 @@ class DataFrameWriter(OptionUtils):
self.mode(mode)
if partitionBy is not None:
self.partitionBy(partitionBy)
if compression is not None:
self.option("compression", compression)
self._set_opts(compression=compression)
self._jwrite.orc(path)
@since(1.4)
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment