-
Notifications
You must be signed in to change notification settings - Fork 3.7k
Support Tiered-Storage Provider for Tencent Cloud COS #15860
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Support Tiered-Storage Provider for Tencent Cloud COS #15860
Conversation
|
@ethqunzhong:Thanks for your contribution. For this PR, do we need to update docs? |
|
@ethqunzhong:Thanks for providing doc info! |
i will commit a new PR for adding documents independent. |
|
/pulsarbot run-failure-checks |
zymap
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think this implementation already covered all the S3-compatible storage services?
great! i will test this implementation for tencent cloud cos, because tencent cloud cos also compatible with the S3 API. |
@zymap hi, I use this implementation to offload data into tencent cloud cos failed because cos is use virtual host-style as default and s3 provider default is path-style. and i think we cloud add a "s3-compatible-storage" offloader to offload data into all these s3-compatible-storages. I commit a new PR to solve this problem. PTAL #15893 |
|
You can specify it using the jclouds properties. https://github.com/apache/pulsar/pull/15710/files#diff-5fa8cee1e48758e8c2ace441539e0fd696aef158af2da84341532c3e492efc61R333. The property is |
|
The pr had no activity for 30 days, mark with Stale label. |
Motivation
add new featrue to support tiered storage by tencent cloud cos
Modifications
Tencent Cloud COS is compatible with the S3 API.
official document as below:
China: https://cloud.tencent.com/document/product/436/41284
International: https://intl.cloud.tencent.com/document/product/436/34688
Verifying this change
Does this pull request potentially affect one of the following parts:
If
yeswas chosen, please highlight the changesDocumentation
doc-not-neededi will commit a new PR for adding documents.