HDDS-12727. Document high level architecture of S3 Gateway #8184
Conversation
adoroszlai
changed the title
|
@kerneltime please review this |
| Ozone separates metadata and data management: | ||
| - **Ozone Manager (OM):** Handles volumes, buckets, keys. | ||
| - **Storage Container Manager (SCM):** Manages DataNodes and allocates containers (storage units). | ||
| - **DataNodes:** Store the actual data chunks. |
There was a problem hiding this comment.
This is redundant on this page in the broader context.
|
|
||
| ### Mapping S3 to Ozone Concepts | ||
|
|
||
| In Ozone, data is organized into **volumes**, **buckets**, and **keys**. By default, the S3 Gateway uses a special volume named `/s3v` to store all S3 buckets. |
There was a problem hiding this comment.
This is not entirely accurate as the volume name can be changed. Also, bucket linking needs to be discussed.
There was a problem hiding this comment.
Note: bucket linking is mentioned in S3 Protocol page: https://ozone.apache.org/docs/edge/interface/s3.html
|
|
||
| This simplifies scaling and failure recovery. | ||
|
|
||
| ### Authentication and Security |
There was a problem hiding this comment.
This section needs to touch kerberos.
|
Please include the LLM footer |
Change-Id: I455848c2d5d2ee65cdce7456814cb4e5e8247973
Change-Id: I3055cf92f41eea2cf84e594ea338637b757d301b
| - Relies on OM for final authorization | ||
|
|
||
| Supports Kerberos authentication for secure clusters; In unsecured mode, allows anonymous or dummy access. | ||
|
|
There was a problem hiding this comment.
Do we need to mention the limitation that ozone hasn't supported some s3 feature(including event notification, life cycle) yet?
There was a problem hiding this comment.
The API support status is in this page: https://ozone.apache.org/docs/edge/interface/s3.html
There was a problem hiding this comment.
I had another draft to update the current API support, but couldn’t find it now.
There was a problem hiding this comment.
Will open a seperate PR for that.
chungen0126
left a comment
chungen0126
left a comment
There was a problem hiding this comment.
Thanks @jojochuang for the patch. Left some comments.
Change-Id: I608d90cb83fca17be0a6b9b279144514ba3249e4
Change-Id: I2c020ee354c7a812f376ee75c3fa8104e75629e0
|
@ivandika3 updated. |
|
Thanks @jojochuang for the docs and @kerneltime @peterxcli @chungen0126 for the reviews. |
6 participants
What changes were proposed in this pull request?
HDDS-12727. [Docs] High level architecture of Ozone S3 Gateway.
Please describe your PR in detail:
What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-12727
How was this patch tested?
Doc only.