hdfs rename bug

[hexian55]

@deprecated
protected void rename(Path src, Path dst, Rename... options)
must change to
rename(Path var1, Path var2)

Exception in thread "plumber_merge_0" java.lang.IllegalAccessError: tried to access method org.apache.hadoop.fs.FileSystem.rename(Lorg/apache/hadoop/fs/Path;Lorg/apache/hadoop/fs/Path;[Lorg/apache/hadoop/fs/Options$Rename;)V from class org.apache.hadoop.fs.HadoopFsWrapper
at org.apache.hadoop.fs.HadoopFsWrapper.rename(HadoopFsWrapper.java:51)
at io.druid.storage.hdfs.HdfsDataSegmentPusher.copyFilesWithChecks(HdfsDataSegmentPusher.java:161)
at io.druid.storage.hdfs.HdfsDataSegmentPusher.push(HdfsDataSegmentPusher.java:142)
at io.druid.segment.realtime.plumber.RealtimePlumber$2.doRun(RealtimePlumber.java:430)
at io.druid.common.guava.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:42)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

[fjy]

@leventov what is this teamcity failure about?

[leventov]

@fjy this is because @hexian55 based his PR on pre-#4348 commit. The assumption is that post-#4348 PRs include that PR, but it may not hold for some PRs in the nearest future. Could be ignored. Travis failure is real (albeit transient) though.

[leventov]

@hexian55 could you please fill CLA http://druid.io/community/cla.html ?

[hexian55]

@leventov it‘s ok

[b-slim]

@hexian55 actually i don't think it is a bug as per the comment here

[hexian55]

@b-slim sorry , It seems that the problem is not so simple on the surface, druid 0.9.2 https://github.com/druid-io/druid/blob/0.9.2/extensions-core/hdfs-storage/src/main/java/org/apache/hadoop/fs/HadoopFsWrapper.java the same as 0.10.0,and my hdfs version not change.
druid 0.9.2 In my system running normally, but when I update it to 0.10.0, There was an exception like this PR . and segment write to hdfs failure.
If i change this class HadoopFsWrapper rename method for this PR, it's will be ok.
I will continue to find the cause of the problem, do you have any suggestions? Or what do you think may be the problem?

[b-slim]

@hexian55 what version of hadoop are you using ?

[himanshug]

@hexian55 see #3650 , two rename methods are not interchangeable . similar issue was reported in #3787 . please check all the hadoop jars you have on your classpath.

[b-slim]

@hexian55 i am assuming this can be closed ?

[hexian55]

ok , please close this PR