Transient failure on RemoteTaskRunnerTest.testStatusRemoved

[drcrallen]

Tests run: 16, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 33.32 sec <<< FAILURE! - in io.druid.indexing.overlord.RemoteTaskRunnerTest
testStatusRemoved(io.druid.indexing.overlord.RemoteTaskRunnerTest)  Time elapsed: 6.46 sec  <<< ERROR!
java.util.NoSuchElementException: null
    at com.google.common.collect.Iterators$1.next(Iterators.java:80)
    at io.druid.indexing.overlord.RemoteTaskRunnerTest.testStatusRemoved(RemoteTaskRunnerTest.java:337)

[himanshug]

its frequency has increased recently, I have seen it fail a couple of times.

'''
RemoteTaskRunnerTest.testStatusRemoved:315 » Timeout Timeout waiting for task.
'''

[nishantmonu51]

i wonder if this might be related to zk issue, bumping up version might help.

[himanshug]

well, I'm pretty positive that it would be a curator/zookeeper issue :)

[himanshug]

another failure stacktrace ...

testStatusRemoved(io.druid.indexing.overlord.RemoteTaskRunnerTest)  Time elapsed: 21.225 sec  <<< ERROR!
java.util.concurrent.TimeoutException: Timeout waiting for task.
	at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:269)
	at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:96)
	at io.druid.indexing.overlord.RemoteTaskRunnerTest.testStatusRemoved(RemoteTaskRunnerTest.java:316)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:367)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:274)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:161)
	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
Results :
Tests in error: 
  RemoteTaskRunnerTest.testStatusRemoved:316 » Timeout Timeout waiting for task.

[jihoonson]

@himanshug the latest failure is 100% reproducible even in my local laptop. Do you have any idea about it?

[himanshug]

@jihoonson being reproducible is even better, thanks for quick fix.