Skip to content
Snippets Groups Projects
  • Roberto Agostino Vitillo's avatar
    b083ec51
    [SPARK-19517][SS] KafkaSource fails to initialize partition offsets · b083ec51
    Roberto Agostino Vitillo authored
    ## What changes were proposed in this pull request?
    
    This patch fixes a bug in `KafkaSource` with the (de)serialization of the length of the JSON string that contains the initial partition offsets.
    
    ## How was this patch tested?
    
    I ran the test suite for spark-sql-kafka-0-10.
    
    Author: Roberto Agostino Vitillo <ra.vitillo@gmail.com>
    
    Closes #16857 from vitillo/kafka_source_fix.
    b083ec51
    History
    [SPARK-19517][SS] KafkaSource fails to initialize partition offsets
    Roberto Agostino Vitillo authored
    ## What changes were proposed in this pull request?
    
    This patch fixes a bug in `KafkaSource` with the (de)serialization of the length of the JSON string that contains the initial partition offsets.
    
    ## How was this patch tested?
    
    I ran the test suite for spark-sql-kafka-0-10.
    
    Author: Roberto Agostino Vitillo <ra.vitillo@gmail.com>
    
    Closes #16857 from vitillo/kafka_source_fix.