HIVE-29062: Add standalone module for packaging the Metastore

[dengzhhu653]

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

• mvn clean install -DskipTests -Pdist,docker from root/standalone-metastore directory
• Run the generated Metastore Docker image against Derby, MySQL, Postgres.

[deniskuzZ]

I wanted to do the same, but wasn't sure on the naming. Should we still build the apache-hive-standalone-metastore-[server]-bin.tar.gz?

Also, we are lacking the HMS client. There is already a patch with +1, but for some reason it wasn't merged.

• Separate metastore client code into its own module
  https://issues.apache.org/jira/browse/HIVE-20189

[deniskuzZ]

@dengzhhu653, do you plan to include this in branch-4.1?
cc @zhangbutao

[dengzhhu653]

I wanted to do the same, but wasn't sure on the naming. Should we still build the apache-hive-standalone-metastore-[server]-bin.tar.gz?

Also, we are lacking the HMS client. There is already a patch with +1, but for some reason it wasn't merged.

• Separate metastore client code into its own module
  https://issues.apache.org/jira/browse/HIVE-20189

Actually the Metastore needs the client, one example is the PartitionManagementTask.

do you plan to include this in branch-4.1?

yes, it's applicable

[dengzhhu653]

Upon the latest master, there is an error on the Initiator:

2025-07-03 15:48:50 Caused by: java.lang.NoClassDefFoundError: org/apache/tez/dag/app/TezTaskCommunicatorImpl
2025-07-03 15:48:50     at java.base/java.lang.ClassLoader.defineClass1(Native Method) ~[?:?]
2025-07-03 15:48:50     at java.base/java.lang.ClassLoader.defineClass(Unknown Source) ~[?:?]
2025-07-03 15:48:50     at java.base/java.security.SecureClassLoader.defineClass(Unknown Source) ~[?:?]
2025-07-03 15:48:50     at java.base/jdk.internal.loader.BuiltinClassLoader.defineClass(Unknown Source) ~[?:?]
2025-07-03 15:48:50     at java.base/jdk.internal.loader.BuiltinClassLoader.findClassOnClassPathOrNull(Unknown Source) ~[?:?]
2025-07-03 15:48:50     at java.base/jdk.internal.loader.BuiltinClassLoader.loadClassOrNull(Unknown Source) ~[?:?]
2025-07-03 15:48:50     at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(Unknown Source) ~[?:?]
2025-07-03 15:48:50     at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(Unknown Source) ~[?:?]
2025-07-03 15:48:50     at java.base/java.lang.ClassLoader.loadClass(Unknown Source) ~[?:?]
2025-07-03 15:48:50     at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.<clinit>(TezSessionState.java:115) ~[hive-exec-4.2.0-SNAPSHOT-core.jar:4.2.0-SNAPSHOT]
2025-07-03 15:48:50     at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:766) ~[hive-exec-4.2.0-SNAPSHOT-core.jar:4.2.0-SNAPSHOT]
2025-07-03 15:48:50     at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:683) ~[hive-exec-4.2.0-SNAPSHOT-core.jar:4.2.0-SNAPSHOT]
2025-07-03 15:48:50     at org.apache.iceberg.mr.hive.compaction.IcebergTableOptimizer.findPotentialCompactions(IcebergTableOptimizer.java:85) ~[hive-iceberg-handler-4.2.0-SNAPSHOT.jar:4.2.0-SNAPSHOT]

I think it might due to HIVE-29028, I haven't seen such error before HIVE-29045: Preparing for 4.2.0 development

[zhangbutao]

2025-07-03 15:48:50 Caused by: java.lang.NoClassDefFoundError: org/apache/tez/dag/app/TezTaskCommunicatorImpl

It seems that the HS2 process requires the loading of tez-dag.jar, but currently in our HS2, only tez-api.jar is loaded.

[deniskuzZ]

@dengzhhu653, @zhangbutao, IcebergTableOptimizer is called from the HMS Initiator process, it shouldn't require the tez. I think we should revert
cc @difin

[deniskuzZ]

Actually the Metastore needs the client, one example is the PartitionManagementTask.

true, still i've raised a PR for the HIVE-20189: Separate metastore client code into its own module to have a clear separation:
#5924

hive-standalone-metastore-common is used in multiple places including the hive-common

WDYT?

[dengzhhu653]

these files are not present in the standalone-metastore, should I include them?

[deniskuzZ]

should we include these as well? note, was able to find CHANGELOG

<include>LICENSE</include>
<include>NOTICE</include>
<include>CHANGELOG</include>
<include>RELEASE_NOTES.txt</include>

[deniskuzZ]

https://github.com/apache/hive/pull/5923/files#r2184736512

[deniskuzZ]

LGTM, some minor things

[deniskuzZ]

+1, pending tests

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud