Add missing delta-storage dependency and class loader workaround to Delta table ingestion

[abhishekrb19]

With the upgrade to Kernel 3.2.0, the Druid Delta connector extension isn't able to read and ingest Delta tables successfully.

The Delta Kernel now requires the delta-storage dependency, so add this in our connector. However, even after adding the dependency, reading from a Delta table fails with the following error:

java.lang.IllegalArgumentException: Can not instantiate `LogStore` class: io.delta.storage.HDFSLogStore
	at io.delta.kernel.defaults.internal.DefaultEngineErrors.canNotInstantiateLogStore(DefaultEngineErrors.java:26)
	at io.delta.kernel.defaults.internal.logstore.LogStoreProvider.getLogStore(LogStoreProvider.java:88)
	at io.delta.kernel.defaults.engine.DefaultFileSystemClient.listFrom(DefaultFileSystemClient.java:76)
	at io.delta.kernel.internal.snapshot.SnapshotManager.listFrom(SnapshotManager.java:228)
	at io.delta.kernel.internal.snapshot.SnapshotManager.listFromOrNone(SnapshotManager.java:253)
	at io.delta.kernel.internal.snapshot.SnapshotManager.listDeltaAndCheckpointFiles(SnapshotManager.java:294)
	at io.delta.kernel.internal.snapshot.SnapshotManager.getLogSegmentForVersion(SnapshotManager.java:466)
	at io.delta.kernel.internal.snapshot.SnapshotManager.getLogSegmentFrom(SnapshotManager.java:415)
	at io.delta.kernel.internal.snapshot.SnapshotManager.getSnapshotAtInit(SnapshotManager.java:352)
	at io.delta.kernel.internal.snapshot.SnapshotManager.buildLatestSnapshot(SnapshotManager.java:113)
	at io.delta.kernel.internal.TableImpl.getLatestSnapshot(TableImpl.java:55)
	at org.apache.druid.delta.input.DeltaInputSource.createSplits(DeltaInputSource.java:210)
	at org.apache.druid.msq.input.external.ExternalInputSpecSlicer.sliceSplittableInputSource(ExternalInputSpecSlicer.java:119)

Please see the upstream issue delta-io/delta#3299 and fix delta-io/delta#3304. I verified the upstream fix by deploying a custom Kernel jar and reverting this Class loader workaround, so we should be able to remove it once we upgrade the Kernel to a later version.

But as the comments in this patch notes, this is only a temporary workaround until we update to the next upstream Kernel library version. The alternative to this patch would be to revert to 3.1.0 where this issue didn't exist. But we lose some new features and performance improvements made in 3.2.0.

Note that this issue wasn't caught in the unit tests present in our Druid extension because the test setup doesn't fully model an actual setup. For example, the DeltaLakeDruidModule configuration is skipped.
I will follow up with a sanity IT to catch such issues in the future.

This PR has:

• been self-reviewed.
• added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader.
• been tested in a test Druid cluster.