-
- Downloads
[SPARK-20057][SS] Renamed KeyedState to GroupState in mapGroupsWithState
## What changes were proposed in this pull request? Since the state is tied a "group" in the "mapGroupsWithState" operations, its better to call the state "GroupState" instead of a key. This would make it more general if you extends this operation to RelationGroupedDataset and python APIs. ## How was this patch tested? Existing unit tests. Author: Tathagata Das <tathagata.das1565@gmail.com> Closes #17385 from tdas/SPARK-20057.
Showing
- sql/catalyst/src/main/java/org/apache/spark/sql/streaming/GroupStateTimeout.java 9 additions, 9 deletions...ava/org/apache/spark/sql/streaming/GroupStateTimeout.java
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/object.scala 9 additions, 9 deletions.../org/apache/spark/sql/catalyst/plans/logical/object.scala
- sql/catalyst/src/test/java/org/apache/spark/sql/streaming/JavaGroupStateTimeoutSuite.java 6 additions, 2 deletions...pache/spark/sql/streaming/JavaGroupStateTimeoutSuite.java
- sql/core/src/main/java/org/apache/spark/api/java/function/FlatMapGroupsWithStateFunction.java 2 additions, 2 deletions...ark/api/java/function/FlatMapGroupsWithStateFunction.java
- sql/core/src/main/java/org/apache/spark/api/java/function/MapGroupsWithStateFunction.java 2 additions, 2 deletions...e/spark/api/java/function/MapGroupsWithStateFunction.java
- sql/core/src/main/scala/org/apache/spark/sql/KeyValueGroupedDataset.scala 23 additions, 23 deletions...n/scala/org/apache/spark/sql/KeyValueGroupedDataset.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/objects.scala 4 additions, 4 deletions...c/main/scala/org/apache/spark/sql/execution/objects.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FlatMapGroupsWithStateExec.scala 8 additions, 8 deletions.../sql/execution/streaming/FlatMapGroupsWithStateExec.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/GroupStateImpl.scala 10 additions, 9 deletions...apache/spark/sql/execution/streaming/GroupStateImpl.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/statefulOperators.scala 2 additions, 2 deletions...che/spark/sql/execution/streaming/statefulOperators.scala
- sql/core/src/main/scala/org/apache/spark/sql/streaming/GroupState.scala 34 additions, 34 deletions...ain/scala/org/apache/spark/sql/streaming/GroupState.scala
- sql/core/src/test/java/test/org/apache/spark/sql/JavaDatasetSuite.java 2 additions, 2 deletions...test/java/test/org/apache/spark/sql/JavaDatasetSuite.java
- sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala 61 additions, 61 deletions...che/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala
Loading
Please register or sign in to comment