-
- Downloads
[SPARK-13027][STREAMING] Added batch time as a parameter to updateStateByKey
Added RDD batch time as an input parameter to the update function in updateStateByKey. Author: Aaditya Ramesh <aramesh@conviva.com> Closes #11122 from aramesh117/SPARK-13027. (cherry picked from commit 6f9e598c) Signed-off-by:Shixiong Zhu <shixiong@databricks.com>
Showing
- streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala 33 additions, 7 deletions...apache/spark/streaming/dstream/PairDStreamFunctions.scala
- streaming/src/main/scala/org/apache/spark/streaming/dstream/StateDStream.scala 15 additions, 13 deletions...ala/org/apache/spark/streaming/dstream/StateDStream.scala
- streaming/src/test/scala/org/apache/spark/streaming/BasicOperationsSuite.scala 66 additions, 0 deletions...ala/org/apache/spark/streaming/BasicOperationsSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/DStreamClosureSuite.scala 12 additions, 0 deletions...cala/org/apache/spark/streaming/DStreamClosureSuite.scala
Loading
Please register or sign in to comment