Skip to content
Snippets Groups Projects
  • Prabeesh K's avatar
    853809e9
    [SPARK-5155] [PYSPARK] [STREAMING] Mqtt streaming support in Python · 853809e9
    Prabeesh K authored
    This PR is based on #4229, thanks prabeesh.
    
    Closes #4229
    
    Author: Prabeesh K <prabsmails@gmail.com>
    Author: zsxwing <zsxwing@gmail.com>
    Author: prabs <prabsmails@gmail.com>
    Author: Prabeesh K <prabeesh.k@namshi.com>
    
    Closes #7833 from zsxwing/pr4229 and squashes the following commits:
    
    9570bec [zsxwing] Fix the variable name and check null in finally
    4a9c79e [zsxwing] Fix pom.xml indentation
    abf5f18 [zsxwing] Merge branch 'master' into pr4229
    935615c [zsxwing] Fix the flaky MQTT tests
    47278c5 [zsxwing] Include the project class files
    478f844 [zsxwing] Add unpack
    5f8a1d4 [zsxwing] Make the maven build generate the test jar for Python MQTT tests
    734db99 [zsxwing] Merge branch 'master' into pr4229
    126608a [Prabeesh K] address the comments
    b90b709 [Prabeesh K] Merge pull request #1 from zsxwing/pr4229
    d07f454 [zsxwing] Register StreamingListerner before starting StreamingContext; Revert unncessary changes; fix the python unit test
    a6747cb [Prabeesh K] wait for starting the receiver before publishing data
    87fc677 [Prabeesh K] address the comments:
    97244ec [zsxwing] Make sbt build the assembly test jar for streaming mqtt
    80474d1 [Prabeesh K] fix
    1f0cfe9 [Prabeesh K] python style fix
    e1ee016 [Prabeesh K] scala style fix
    a5a8f9f [Prabeesh K] added Python test
    9767d82 [Prabeesh K] implemented Python-friendly class
    a11968b [Prabeesh K] fixed python style
    795ec27 [Prabeesh K] address comments
    ee387ae [Prabeesh K] Fix assembly jar location of mqtt-assembly
    3f4df12 [Prabeesh K] updated version
    b34c3c1 [prabs] adress comments
    3aa7fff [prabs] Added Python streaming mqtt word count example
    b7d42ff [prabs] Mqtt streaming support in Python
    853809e9
    History
    [SPARK-5155] [PYSPARK] [STREAMING] Mqtt streaming support in Python
    Prabeesh K authored
    This PR is based on #4229, thanks prabeesh.
    
    Closes #4229
    
    Author: Prabeesh K <prabsmails@gmail.com>
    Author: zsxwing <zsxwing@gmail.com>
    Author: prabs <prabsmails@gmail.com>
    Author: Prabeesh K <prabeesh.k@namshi.com>
    
    Closes #7833 from zsxwing/pr4229 and squashes the following commits:
    
    9570bec [zsxwing] Fix the variable name and check null in finally
    4a9c79e [zsxwing] Fix pom.xml indentation
    abf5f18 [zsxwing] Merge branch 'master' into pr4229
    935615c [zsxwing] Fix the flaky MQTT tests
    47278c5 [zsxwing] Include the project class files
    478f844 [zsxwing] Add unpack
    5f8a1d4 [zsxwing] Make the maven build generate the test jar for Python MQTT tests
    734db99 [zsxwing] Merge branch 'master' into pr4229
    126608a [Prabeesh K] address the comments
    b90b709 [Prabeesh K] Merge pull request #1 from zsxwing/pr4229
    d07f454 [zsxwing] Register StreamingListerner before starting StreamingContext; Revert unncessary changes; fix the python unit test
    a6747cb [Prabeesh K] wait for starting the receiver before publishing data
    87fc677 [Prabeesh K] address the comments:
    97244ec [zsxwing] Make sbt build the assembly test jar for streaming mqtt
    80474d1 [Prabeesh K] fix
    1f0cfe9 [Prabeesh K] python style fix
    e1ee016 [Prabeesh K] scala style fix
    a5a8f9f [Prabeesh K] added Python test
    9767d82 [Prabeesh K] implemented Python-friendly class
    a11968b [Prabeesh K] fixed python style
    795ec27 [Prabeesh K] address comments
    ee387ae [Prabeesh K] Fix assembly jar location of mqtt-assembly
    3f4df12 [Prabeesh K] updated version
    b34c3c1 [prabs] adress comments
    3aa7fff [prabs] Added Python streaming mqtt word count example
    b7d42ff [prabs] Mqtt streaming support in Python