-
Notifications
You must be signed in to change notification settings - Fork 4k
Closed
Description
The Filesystem methods don't provide a human-friendly interface for basic operations like ls, mkdir, etc. Since we provide access to S3 and potentially other cloud storage, it would be nice to have simple methods for exploring it.
Additional ideas:
- S3Bucket class/constructor: it's basically a SubTreeFileSystem containing S3FS and a path, except that we can auto-detect a bucket's region.
- Add a class like the FileLocator C++ struct list(fs, path). also kinda like a SubTreeFileSystem, but with different methods and intents. Aside from use in ls/mkdir/cp, it could be used in file reader/writers instead of having an extra
filesystemargument added everywhere, e.g.fs$path("path/to/file"). See ARROW-9869: [R] Implement full S3FileSystem/S3Options constructor #8197 (comment)
Reporter: Neal Richardson / @nealrichardson
Assignee: Neal Richardson / @nealrichardson
PRs and other links:
Note: This issue was originally created as ARROW-9870. Please see the migration documentation for further details.