Ignore exceptions when pushing task logs to ensure task success

[GWphua]

Description

During task execution, the task is able to finish without disruptions, but is unable to complete successfully. Error logs show that the task is unable to push task logs to HDFS. This PR aims to allow the tasks to succeed even if the task is unable to push its logs to deep storage.

2024-12-26T12:41:40,943 INFO [forking-task-runner-3] org.apache.druid.indexing.overlord.ForkingTaskRunner - Exception caught during executionorg.apache.hadoop.ipc.RemoteException: Router <REDACTED> is in safe mode and cannot handle WRITE requests    
at org.apache.hadoop.hdfs.server.federation.router.RouterRpcServer.checkSafeMode(RouterRpcServer.java:563)    
at org.apache.hadoop.hdfs.server.federation.router.RouterRpcServer.checkOperation(RouterRpcServer.java:548)    
at org.apache.hadoop.hdfs.server.federation.router.RouterClientProtocol.create(RouterClientProtocol.java:383)    
at org.apache.hadoop.hdfs.server.federation.router.RouterRpcServer.create(RouterRpcServer.java:660)    
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.java:522)    
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)    
at org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:637)    
at org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:605)    
at org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:589)    
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1146)    
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:1249)    
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:1147)    
at java.security.AccessController.doPrivileged(Native Method)    
at javax.security.auth.Subject.doAs(Subject.java:422)    
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:2005)    
at org.apache.hadoop.ipc.DeepHandlerManager$SurfaceHandler.run(DeepHandlerManager.java:269)

Replaced unhandled exceptions with WARN loggings.

Release note

Tasks can successfully complete after finishing, even if there are problems pushing logs and report to deep storage.

---

Key changed/added classes in this PR

• ForkingTaskRunner

---

This PR has:

• been self-reviewed.
• a release note entry in the PR description.
• added unit tests or modified existing tests to cover new code paths, ensuring the threshold for code coverage is met.
• been tested in a test Druid cluster.

[FrankChen021]

LGTM