Skip to content
  • Marcelo Vanzin's avatar
    b16b5434
    [MINOR] [BUILD] Use custom temp directory during build. · b16b5434
    Marcelo Vanzin authored
    Even with all the efforts to cleanup the temp directories created by
    unit tests, Spark leaves a lot of garbage in /tmp after a test run.
    This change overrides java.io.tmpdir to place those files under the
    build directory instead.
    
    After an sbt full unit test run, I was left with > 400 MB of temp
    files. Since they're now under the build dir, it's much easier to
    clean them up.
    
    Also make a slight change to a unit test to make it not pollute the
    source directory with test data.
    
    Author: Marcelo Vanzin <vanzin@cloudera.com>
    
    Closes #6653 from vanzin/unit-test-tmp and squashes the following commits:
    
    31e2dd5 [Marcelo Vanzin] Fix tests that depend on each other.
    aa92944 [Marcelo Vanzin] [minor] [build] Use custom temp directory during build.
    b16b5434
    [MINOR] [BUILD] Use custom temp directory during build.
    Marcelo Vanzin authored
    Even with all the efforts to cleanup the temp directories created by
    unit tests, Spark leaves a lot of garbage in /tmp after a test run.
    This change overrides java.io.tmpdir to place those files under the
    build directory instead.
    
    After an sbt full unit test run, I was left with > 400 MB of temp
    files. Since they're now under the build dir, it's much easier to
    clean them up.
    
    Also make a slight change to a unit test to make it not pollute the
    source directory with test data.
    
    Author: Marcelo Vanzin <vanzin@cloudera.com>
    
    Closes #6653 from vanzin/unit-test-tmp and squashes the following commits:
    
    31e2dd5 [Marcelo Vanzin] Fix tests that depend on each other.
    aa92944 [Marcelo Vanzin] [minor] [build] Use custom temp directory during build.
Loading