-
- Downloads
[SPARK-11935][PYSPARK] Send the Python exceptions in TransformFunction and...
[SPARK-11935][PYSPARK] Send the Python exceptions in TransformFunction and TransformFunctionSerializer to Java The Python exception track in TransformFunction and TransformFunctionSerializer is not sent back to Java. Py4j just throws a very general exception, which is hard to debug. This PRs adds `getFailure` method to get the failure message in Java side. Author: Shixiong Zhu <shixiong@databricks.com> Closes #9922 from zsxwing/SPARK-11935.
Showing
- python/pyspark/streaming/tests.py 81 additions, 1 deletionpython/pyspark/streaming/tests.py
- python/pyspark/streaming/util.py 20 additions, 9 deletionspython/pyspark/streaming/util.py
- streaming/src/main/scala/org/apache/spark/streaming/api/python/PythonDStream.scala 43 additions, 9 deletions...org/apache/spark/streaming/api/python/PythonDStream.scala
Loading
Please register or sign in to comment