[SPARK-9507] [BUILD] Remove dependency reduced POM hack now that shade plugin is updated

[srowen]

Update to shade plugin 2.4.1, which removes the need for the dependency-reduced-POM workaround and the 'release' profile. Fix management of shade plugin version so children inherit it; bump assembly plugin version while here

See https://issues.apache.org/jira/browse/SPARK-8819

I verified that mvn clean package -DskipTests works with Maven 3.3.3.

@pwendell are you up for trying this for the 1.5.0 release?

[SparkQA]

Test build #39211 has finished for PR 7826 at commit e0b0fd2.

• This patch fails SparkR unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[vanzin]

LGTM, I'd prefer if this was in the release.

[SparkQA]

Test build #1256 has finished for PR 7826 at commit e0b0fd2.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • class MulticlassClassificationEvaluator (override val uid: String)
  • class NaiveBayes(JavaEstimator, HasFeaturesCol, HasLabelCol, HasPredictionCol):
  • class NaiveBayesModel(JavaModel):
  • class MulticlassClassificationEvaluator(JavaEvaluator, HasLabelCol, HasPredictionCol):

[srowen]

Really can't be due to this change, but let me try it again

[pwendell]

Yeah seems like a good idea - LGTM

[SparkQA]

Test build #1259 has finished for PR 7826 at commit e0b0fd2.

• This patch passes all tests.
• This patch does not merge cleanly.
• This patch adds no public classes.

[srowen]

Since it passes tests as expected, and does appear to merge according to Github, I'm ignoring that "does not merge cleanly" and merging to master. I'll try to back-port to 1.4 and 1.3 since that's where SPARK-8819 was merged.