Skip to content
Snippets Groups Projects
  • Davies Liu's avatar
    809c785b
    [SPARK-2652] [PySpark] donot use KyroSerializer as default serializer · 809c785b
    Davies Liu authored
    KyroSerializer can not serialize customized class without registered explicitly, use it as default serializer in PySpark will introduce some regression in MLlib.
    
    cc mengxr
    
    Author: Davies Liu <davies@databricks.com>
    
    Closes #2916 from davies/revert and squashes the following commits:
    
    43eb6d3 [Davies Liu] donot use KyroSerializer as default serializer
    809c785b
    History
    [SPARK-2652] [PySpark] donot use KyroSerializer as default serializer
    Davies Liu authored
    KyroSerializer can not serialize customized class without registered explicitly, use it as default serializer in PySpark will introduce some regression in MLlib.
    
    cc mengxr
    
    Author: Davies Liu <davies@databricks.com>
    
    Closes #2916 from davies/revert and squashes the following commits:
    
    43eb6d3 [Davies Liu] donot use KyroSerializer as default serializer