Skip to content
Snippets Groups Projects
  1. Apr 24, 2017
  2. Dec 02, 2016
  3. Sep 21, 2016
    • Josh Rosen's avatar
      [SPARK-17418] Prevent kinesis-asl-assembly artifacts from being published · d7ee1221
      Josh Rosen authored
      This patch updates the `kinesis-asl-assembly` build to prevent that module from being published as part of Maven releases and snapshot builds.
      
      The `kinesis-asl-assembly` includes classes from the Kinesis Client Library (KCL) and Kinesis Producer Library (KPL), both of which are licensed under the Amazon Software License and are therefore prohibited from being distributed in Apache releases.
      
      Author: Josh Rosen <joshrosen@databricks.com>
      
      Closes #15167 from JoshRosen/stop-publishing-kinesis-assembly.
      d7ee1221
  4. Jul 19, 2016
  5. Jul 11, 2016
    • Reynold Xin's avatar
      [SPARK-16477] Bump master version to 2.1.0-SNAPSHOT · ffcb6e05
      Reynold Xin authored
      ## What changes were proposed in this pull request?
      After SPARK-16476 (committed earlier today as #14128), we can finally bump the version number.
      
      ## How was this patch tested?
      N/A
      
      Author: Reynold Xin <rxin@databricks.com>
      
      Closes #14130 from rxin/SPARK-16477.
      ffcb6e05
  6. May 12, 2016
    • Brian O'Neill's avatar
      [SPARK-14421] Upgrades protobuf dependency to 2.6.1 for the new version of KCL, and… · 81e3bfc1
      Brian O'Neill authored
      ## What changes were proposed in this pull request?
      
      When running with Kinesis Consumer Library (KCL), against a stream that contains aggregated data, the KCL needs access to protobuf to de-aggregate the records.   Without this patch, that results in the following error message:
      
      ```
         Caused by: java.lang.ClassNotFoundException: com.google.protobuf.ProtocolStringList
      ```
      
      This PR upgrades the protobuf dependency within the kinesis-asl-assembly, and relocates that package (as not to conflict with Spark's use of 2.5.0), which fixes the above CNFE.
      
      ## How was this patch tested?
      
      Used kinesis word count example against a stream containing aggregated data.
      
      See: SPARK-14421
      
      Author: Brian O'Neill <bone@alumni.brown.edu>
      
      Closes #13054 from boneill42/protobuf-relocation-for-kcl.
      81e3bfc1
  7. May 05, 2016
    • mcheah's avatar
      [SPARK-12154] Upgrade to Jersey 2 · b7fdc23c
      mcheah authored
      ## What changes were proposed in this pull request?
      
      Replace com.sun.jersey with org.glassfish.jersey. Changes to the Spark Web UI code were required to compile. The changes were relatively standard Jersey migration things.
      
      ## How was this patch tested?
      
      I did a manual test for the standalone web APIs. Although I didn't test the functionality of the security filter itself, the code that changed non-trivially is how we actually register the filter. I attached a debugger to the Spark master and verified that the SecurityFilter code is indeed invoked upon hitting /api/v1/applications.
      
      Author: mcheah <mcheah@palantir.com>
      
      Closes #12715 from mccheah/feature/upgrade-jersey.
      b7fdc23c
  8. Mar 09, 2016
    • Sean Owen's avatar
      [SPARK-13595][BUILD] Move docker, extras modules into external · 256704c7
      Sean Owen authored
      ## What changes were proposed in this pull request?
      
      Move `docker` dirs out of top level into `external/`; move `extras/*` into `external/`
      
      ## How was this patch tested?
      
      This is tested with Jenkins tests.
      
      Author: Sean Owen <sowen@cloudera.com>
      
      Closes #11523 from srowen/SPARK-13595.
      256704c7
Loading