Skip to content

Conversation

@github-actions
Copy link
Contributor

Cherry-picked from #56861

## What's Changed

1. **Refined Azure Blob Configuration Naming**
- Adopted Azure-native property names for better consistency with Azure
SDK conventions:
     - `account_name` → Azure Storage Account Name  
     - `account_key` → Azure Storage Account Key
- Ensures compatibility, clarity, and alignment with Azure Blob
attribute definitions.

2. **Full Feature Support for Azure Blob Storage**
   - Added comprehensive integration for the following modules:
     - **TVF (Table-Valued Function)**
     - **LOAD (Data Loading)**
     - **CATALOG (Metadata Querying)**
- Azure Blob can now be used as both a data source and destination
across all modules.

3. **Protocol Compatibility**
   - Added full support for multiple Azure storage access protocols:
     - `abfs://`
     - `abfss://`
     - `wasb://`
     - `wasbs://`
- Automatically recognizes protocol prefixes and maps them to the
correct Azure storage client implementation.

## todo
 **Unified Connectivity Testing Framework**
- Refactored the connectivity test logic into a unified implementation
shared across all object storage backends (S3, OSS, COS, OBS, BOS, and
Azure).
- Improves code reusability and simplifies the process of adding new
storage providers.
@github-actions github-actions bot requested a review from yiguolei as a code owner October 22, 2025 02:29
@Thearas
Copy link
Contributor

Thearas commented Oct 22, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Oct 22, 2025
@Thearas
Copy link
Contributor

Thearas commented Oct 22, 2025

run buildall

@doris-robot
Copy link

ClickBench: Total hot run time: 31.26 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9fb0874e0c968a4fb1749b7779dbcf63df183129, data reload: false

query1	0.07	0.06	0.05
query2	0.12	0.06	0.06
query3	0.25	0.08	0.08
query4	1.62	0.12	0.12
query5	0.29	0.25	0.25
query6	1.21	0.65	0.67
query7	0.03	0.03	0.03
query8	0.06	0.04	0.06
query9	0.61	0.54	0.53
query10	0.60	0.61	0.58
query11	0.17	0.12	0.12
query12	0.15	0.13	0.12
query13	0.63	0.62	0.63
query14	1.05	1.04	1.06
query15	0.92	0.89	0.88
query16	0.41	0.40	0.40
query17	1.09	1.07	1.08
query18	0.24	0.21	0.20
query19	1.94	1.96	1.97
query20	0.01	0.01	0.02
query21	15.39	1.00	0.64
query22	0.78	1.20	0.70
query23	15.01	1.42	0.67
query24	7.87	0.94	1.18
query25	0.47	0.17	0.09
query26	0.67	0.17	0.14
query27	0.06	0.06	0.06
query28	9.87	1.38	0.93
query29	12.64	4.28	3.50
query30	0.28	0.15	0.12
query31	2.88	0.62	0.40
query32	3.25	0.58	0.48
query33	3.06	3.07	3.19
query34	16.34	5.52	4.89
query35	4.96	4.94	4.91
query36	0.70	0.52	0.51
query37	0.11	0.08	0.08
query38	0.08	0.05	0.05
query39	0.04	0.03	0.03
query40	0.18	0.15	0.15
query41	0.08	0.04	0.03
query42	0.05	0.04	0.03
query43	0.04	0.04	0.03
Total cold run time: 106.28 s
Total hot run time: 31.26 s

@CalvinKirs
Copy link
Member

run buildall

@yiguolei yiguolei merged commit d8027c3 into branch-4.0 Oct 23, 2025
23 of 29 checks passed
@github-actions github-actions bot deleted the auto-pick-56861-branch-4.0 branch October 23, 2025 07:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants