[SPARK-12807] [YARN] Spark External Shuffle not working in Hadoop clusters with Jackson 2.2.3#10780

Closed

steveloughran wants to merge 15 commits intoapache:masterfrom

steveloughran:stevel/patches/SPARK-12807-master-shuffle

Commits on Feb 8, 2016

SPARK-12807 WiP shading patch + integration tests (after shading) to verify shading is there. currently they fail
steveloughran
committed
SPARK-12807 add log4j.properties test resource
steveloughran
committed
SPARK-12807 IT test to use / paths. Moot, as tests classpaths aren't right
steveloughran
committed
SPARK-12807 Switch to using Ant to scan internals of zipfile. Guaranteed to be asserting state of JAR
steveloughran
committed
SPARK-12807 class check taking place in verify phase; works on clean builds
steveloughran
committed
SPARK-12807 add probe for scala module
steveloughran
committed
SPARK-12807 cut explicit references for jackson
steveloughran
committed
SPARK-12807 tightened build: reduced diff to master, leave out jackson-module-scala
steveloughran
committed
SPARK-12807 macrodefing the build process, for scalability of checks
steveloughran
committed
SPARK-12807 <shaded> extends <exists>, which can be used for probing unshaded artifacts
steveloughran
committed
SPARK-12807 add leveldb-provided profile, which excludes leveldb from the artifact. the build fails, as the verify stage is still probing for it
steveloughran
committed
SPARK-12807 cut leveldb check
steveloughran
committed
SPARK-12807 cull (broken) test methods obsoleted by build file checks
steveloughran
committed
[SPARK-12807] remove netty & javax.annotation from relocation
steveloughran
committed
[SPARK-12807] remove all leveldb related work; rely on hadoop and shuffle versions being in perfect sync, so duplication is harmless
steveloughran
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[SPARK-12807] [YARN] Spark External Shuffle not working in Hadoop clusters with Jackson 2.2.3#10780

[SPARK-12807] [YARN] Spark External Shuffle not working in Hadoop clusters with Jackson 2.2.3#10780
steveloughran wants to merge 15 commits intoapache:masterfrom
steveloughran:stevel/patches/SPARK-12807-master-shuffle

Commits on Feb 8, 2016

SPARK-12807 WiP shading patch + integration tests (after shading) to verify shading is there. currently they fail

SPARK-12807 add log4j.properties test resource

SPARK-12807 IT test to use / paths. Moot, as tests classpaths aren't right

SPARK-12807 Switch to using Ant to scan internals of zipfile. Guaranteed to be asserting state of JAR

SPARK-12807 class check taking place in verify phase; works on clean builds

SPARK-12807 add probe for scala module

SPARK-12807 cut explicit references for jackson

SPARK-12807 tightened build: reduced diff to master, leave out jackson-module-scala

SPARK-12807 macrodefing the build process, for scalability of checks

SPARK-12807 <shaded> extends <exists>, which can be used for probing unshaded artifacts

SPARK-12807 add leveldb-provided profile, which excludes leveldb from the artifact. the build fails, as the verify stage is still probing for it

SPARK-12807 cut leveldb check

SPARK-12807 cull (broken) test methods obsoleted by build file checks

[SPARK-12807] remove netty & javax.annotation from relocation

[SPARK-12807] remove all leveldb related work; rely on hadoop and shuffle versions being in perfect sync, so duplication is harmless