[SPARK-6067][SQL]delete the file with the same name before create the path for HiveFileFormatUtils.getHiveRecordWriter

[baishuo]

this is commit for https://issues.apache.org/jira/browse/SPARK-6067

[baishuo]

I think this patch should test by the Reporter of SPARK-6067

[marmbrus]

ok to test

[marmbrus]

/cc @liancheng

[SparkQA]

Test build #29636 has finished for PR 4980 at commit 5283708.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.
• This patch does not change any dependencies.

[srowen]

Maybe check for part- before getting a file system or checking if the file exists. This saves RPCs.
Did you mean > 0 in the sense of contains? that's not quite correct if so, since the condition should be >= 0. But then contains would be simpler anyway.
Finally, duplicat -> duplicate

[baishuo]

thank you @srowen

[SparkQA]

Test build #30804 has finished for PR 4980 at commit 4d5f65c.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.
• This patch does not change any dependencies.

[SparkQA]

Test build #31055 has started for PR 4980 at commit 4d5f65c.

[liancheng]

As @srowen mentioned, please check "part-" first, and then check existence, to save NameNode RPC.

[SparkQA]

Test build #31228 has finished for PR 4980 at commit d4f145e.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.
• This patch does not change any dependencies.

[baishuo]

can this patch be merged？:)

[andrewor14]

@liancheng can this patch be merged? Is it still relevant?

[baishuo]

hi @andrewor14 @liancheng , I think this is a useful patch :)

[liancheng]

Seems that this issue has already fixed by #6833?

[andrewor14]

Shall we close this PR then?

[baishuo]

no problem. close it :) @andrewor14 @liancheng