feat: add native oss support for lance#4247
Conversation
Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
BubbleCal
left a comment
There was a problem hiding this comment.
have you tried this on aliyun OSS?
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #4247 +/- ##
==========================================
- Coverage 80.24% 80.20% -0.05%
==========================================
Files 297 298 +1
Lines 105211 105283 +72
Branches 105211 105283 +72
==========================================
+ Hits 84429 84440 +11
- Misses 17706 17769 +63
+ Partials 3076 3074 -2
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
Yep, tested with an oss example: Using dataset URI: oss://opendal-testing/test/dataset
Created test data with 5 rows
Writing data to OSS...
Data written successfully!
Reading data from OSS...
Dataset opened successfully!
Schema: Schema { fields: [Field { name: "id", id: 0, parent_id: -1, logical_type: LogicalType("int32"), metadata: {}, encoding: Some(Plain), nullable: false, children: [], dictionary: None, storage_class: Default, unenforced_primary_key: false }, Field { name: "name", id: 1, parent_id: -1, logical_type: LogicalType("string"), metadata: {}, encoding: Some(VarBinary), nullable: false, children: [], dictionary: None, storage_class: Default, unenforced_primary_key: false }, Field { name: "score", id: 2, parent_id: -1, logical_type: LogicalType("float"), metadata: {}, encoding: Some(Plain), nullable: false, children: [], dictionary: None, storage_class: Default, unenforced_primary_key: false }], metadata: {} }
Current version: 1
Number of rows: 5
Scanning data:
Batch 0: 5 rows
Sample data:
Row 0: id=1, name=Alice, score=85.5
Row 1: id=2, name=Bob, score=92.3
Row 2: id=3, name=Charlie, score=78.9
Row 3: id=4, name=David, score=88.1
Row 4: id=5, name=Eve, score=95.7
Example completed successfully! |
Signed-off-by: Xuanwo <github@xuanwo.io>
Hi @Xuanwo , thanks for adding this feature! |
Improvements #4247 alicloud storage config doc. Signed-off-by: FarmerChillax <farmerchillax@outlook.com>
Fix #4205