-
- Downloads
[SPARK-7799][SPARK-12786][STREAMING] Add "streaming-akka" project
Include the following changes: 1. Add "streaming-akka" project and org.apache.spark.streaming.akka.AkkaUtils for creating an actorStream 2. Remove "StreamingContext.actorStream" and "JavaStreamingContext.actorStream" 3. Update the ActorWordCount example and add the JavaActorWordCount example 4. Make "streaming-zeromq" depend on "streaming-akka" and update the codes accordingly Author: Shixiong Zhu <shixiong@databricks.com> Closes #10744 from zsxwing/streaming-akka-2.
Showing
- dev/sparktestsupport/modules.py 12 additions, 0 deletionsdev/sparktestsupport/modules.py
- docs/streaming-custom-receivers.md 39 additions, 10 deletionsdocs/streaming-custom-receivers.md
- docs/streaming-programming-guide.md 2 additions, 2 deletionsdocs/streaming-programming-guide.md
- examples/pom.xml 5 additions, 0 deletionsexamples/pom.xml
- examples/src/main/java/org/apache/spark/examples/streaming/JavaActorWordCount.java 9 additions, 5 deletions...g/apache/spark/examples/streaming/JavaActorWordCount.java
- examples/src/main/scala/org/apache/spark/examples/streaming/ActorWordCount.scala 21 additions, 16 deletions.../org/apache/spark/examples/streaming/ActorWordCount.scala
- examples/src/main/scala/org/apache/spark/examples/streaming/ZeroMQWordCount.scala 9 additions, 4 deletions...org/apache/spark/examples/streaming/ZeroMQWordCount.scala
- external/akka/pom.xml 73 additions, 0 deletionsexternal/akka/pom.xml
- external/akka/src/main/scala/org/apache/spark/streaming/akka/ActorReceiver.scala 44 additions, 20 deletions...scala/org/apache/spark/streaming/akka/ActorReceiver.scala
- external/akka/src/main/scala/org/apache/spark/streaming/akka/AkkaUtils.scala 147 additions, 0 deletions...ain/scala/org/apache/spark/streaming/akka/AkkaUtils.scala
- external/akka/src/test/java/org/apache/spark/streaming/akka/JavaAkkaUtilsSuite.java 66 additions, 0 deletions...a/org/apache/spark/streaming/akka/JavaAkkaUtilsSuite.java
- external/akka/src/test/scala/org/apache/spark/streaming/akka/AkkaUtilsSuite.scala 64 additions, 0 deletions...cala/org/apache/spark/streaming/akka/AkkaUtilsSuite.scala
- external/zeromq/pom.xml 5 additions, 0 deletionsexternal/zeromq/pom.xml
- external/zeromq/src/main/scala/org/apache/spark/streaming/zeromq/ZeroMQReceiver.scala 1 addition, 1 deletion...la/org/apache/spark/streaming/zeromq/ZeroMQReceiver.scala
- external/zeromq/src/main/scala/org/apache/spark/streaming/zeromq/ZeroMQUtils.scala 53 additions, 23 deletions...scala/org/apache/spark/streaming/zeromq/ZeroMQUtils.scala
- external/zeromq/src/test/java/org/apache/spark/streaming/zeromq/JavaZeroMQStreamSuite.java 22 additions, 9 deletions.../apache/spark/streaming/zeromq/JavaZeroMQStreamSuite.java
- external/zeromq/src/test/scala/org/apache/spark/streaming/zeromq/ZeroMQStreamSuite.scala 12 additions, 4 deletions...org/apache/spark/streaming/zeromq/ZeroMQStreamSuite.scala
- pom.xml 1 addition, 0 deletionspom.xml
- project/MimaExcludes.scala 10 additions, 0 deletionsproject/MimaExcludes.scala
- project/SparkBuild.scala 5 additions, 4 deletionsproject/SparkBuild.scala
Loading
Please register or sign in to comment