Skip to content
Snippets Groups Projects
Commit 78887f94 authored by Bertrand Bossy's avatar Bertrand Bossy Committed by Patrick Wendell
Browse files

SPARK-3039: Allow spark to be built using avro-mapred for hadoop2


SPARK-3039: Adds the maven property "avro.mapred.classifier" to build spark-assembly with avro-mapred with support for the new Hadoop API. Sets this property to hadoop2 for Hadoop 2 profiles.

I am not very familiar with maven, nor do I know whether this potentially breaks something in the hive part of spark. There might be a more elegant way of doing this.

Author: Bertrand Bossy <bertrandbossy@gmail.com>

Closes #1945 from bbossy/SPARK-3039 and squashes the following commits:

c32ce59 [Bertrand Bossy] SPARK-3039: Allow spark to be built using avro-mapred for hadoop2

(cherry picked from commit c243b21a)
Signed-off-by: default avatarPatrick Wendell <pwendell@gmail.com>
parent 70f93d5a
No related branches found
No related tags found
No related merge requests found
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment