-
- Downloads
[SPARK-11713] [PYSPARK] [STREAMING] Initial RDD updateStateByKey for PySpark
Adding ability to define an initial state RDD for use with updateStateByKey PySpark. Added unit test and changed stateful_network_wordcount example to use initial RDD. Author: Bryan Cutler <bjcutler@us.ibm.com> Closes #10082 from BryanCutler/initial-rdd-updateStateByKey-SPARK-11713.
Showing
- examples/src/main/python/streaming/stateful_network_wordcount.py 4 additions, 1 deletion...s/src/main/python/streaming/stateful_network_wordcount.py
- python/pyspark/streaming/dstream.py 11 additions, 2 deletionspython/pyspark/streaming/dstream.py
- python/pyspark/streaming/tests.py 20 additions, 0 deletionspython/pyspark/streaming/tests.py
- streaming/src/main/scala/org/apache/spark/streaming/api/python/PythonDStream.scala 12 additions, 2 deletions...org/apache/spark/streaming/api/python/PythonDStream.scala
Loading
Please register or sign in to comment