Skip to content
Snippets Groups Projects
  • Ian O Connell's avatar
    efdaeb11
    [SPARK-2102][SQL][CORE] Add option for kryo registration required and use a... · efdaeb11
    Ian O Connell authored
    [SPARK-2102][SQL][CORE] Add option for kryo registration required and use a resource pool in Spark SQL for Kryo instances.
    
    Author: Ian O Connell <ioconnell@twitter.com>
    
    Closes #1377 from ianoc/feature/SPARK-2102 and squashes the following commits:
    
    5498566 [Ian O Connell] Docs update suggested by Patrick
    20e8555 [Ian O Connell] Slight style change
    f92c294 [Ian O Connell] Add docs for new KryoSerializer option
    f3735c8 [Ian O Connell] Add using a kryo resource pool for the SqlSerializer
    4e5c342 [Ian O Connell] Register the SparkConf for kryo, it gets swept into serialization
    665805a [Ian O Connell] Add a spark.kryo.registrationRequired option for configuring the Kryo Serializer
    efdaeb11
    History
    [SPARK-2102][SQL][CORE] Add option for kryo registration required and use a...
    Ian O Connell authored
    [SPARK-2102][SQL][CORE] Add option for kryo registration required and use a resource pool in Spark SQL for Kryo instances.
    
    Author: Ian O Connell <ioconnell@twitter.com>
    
    Closes #1377 from ianoc/feature/SPARK-2102 and squashes the following commits:
    
    5498566 [Ian O Connell] Docs update suggested by Patrick
    20e8555 [Ian O Connell] Slight style change
    f92c294 [Ian O Connell] Add docs for new KryoSerializer option
    f3735c8 [Ian O Connell] Add using a kryo resource pool for the SqlSerializer
    4e5c342 [Ian O Connell] Register the SparkConf for kryo, it gets swept into serialization
    665805a [Ian O Connell] Add a spark.kryo.registrationRequired option for configuring the Kryo Serializer