Skip to content
Snippets Groups Projects
Commit 047a31bb authored by Shixiong Zhu's avatar Shixiong Zhu Committed by Davies Liu
Browse files

[SPARK-12617] [PYSPARK] Clean up the leak sockets of Py4J 

This patch added Py4jCallbackConnectionCleaner to clean the leak sockets of Py4J every 30 seconds. This is a workaround before Py4J fixes the leak issue https://github.com/bartdag/py4j/issues/187

Author: Shixiong Zhu <shixiong@databricks.com>

Closes #10579 from zsxwing/SPARK-12617.
parent d202ad2f
No related branches found
No related tags found
Hide whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment