[AMORO-3837] Integrate lance format

[majin1102]

Why are the changes needed?

Close #3837 and #4050

Brief change log

How was this patch tested?

• Add some test cases that check the changes thoroughly including negative and positive cases if possible

• Add screenshots for manual tests if appropriate

• Run test locally before making a pull request

Documentation

• Does this pull request introduce a new feature? (yes / no)
• If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

[codecov-commenter]

Codecov Report

❌ Patch coverage is 9.37500% with 58 lines in your changes missing coverage. Please review.
✅ Project coverage is 28.84%. Comparing base (cbdc517) to head (9ca7d2f).
⚠️ Report is 35 commits behind head on master.

Files with missing lines	Patch %	Lines
.../main/java/org/apache/amoro/utils/CatalogUtil.java	0.00%	55 Missing ⚠️
...server/dashboard/controller/CatalogController.java	75.00%	2 Missing ⚠️
...on/src/main/java/org/apache/amoro/TableFormat.java	0.00%	1 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##             master    #4051      +/-   ##
============================================
+ Coverage     22.12%   28.84%   +6.71%     
- Complexity     2461     3947    +1486     
============================================
  Files           445      657     +212     
  Lines         40897    52363   +11466     
  Branches       5767     6656     +889     
============================================
+ Hits           9050    15102    +6052     
- Misses        31089    36156    +5067     
- Partials        758     1105     +347     

Flag	Coverage Δ
core	28.84% <9.37%> (?)
trino	?

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.