ARROW-15892: [C++] Dataset APIs require s3:ListBucket Permissions#12701

Closed

sanjibansg wants to merge 22 commits intoapache:masterfrom

sanjibansg:s3-directory

Commits on Apr 25, 2022

feat: flag in dataset writer for creating dir
sanjibansg
committed
test: testing put only limited s3 policy
sanjibansg
committed
fix: PrepareDirectory for create_dir flag
sanjibansg
committed
fix: lint issue for unused modules
sanjibansg
committed
feat: moved limited_s3_user to util
sanjibansg
committed
feat: using c_bool instead of bool for create_dir
sanjibansg
committed
test: test with expected failure for create_dir flag set to true
sanjibansg
committed
docs: docstring explaining test for s3 with put only policy
sanjibansg
committed
fix: python lint
sanjibansg
committed
fix: limited_s3_user used as a function and moved to util.py
sanjibansg
committed
fix: avoid creating dir if already present in _configure_limited_user
sanjibansg
committed
docs: changed docstring for create_dir in FileSystemDatasetWriteOptions
sanjibansg
committed
refactor: merged limited_s3_user into _configure_limited_user and renamed as _configure_s3_limited_user
sanjibansg
committed
refactor: stdlib imports in alphabetical order in util.py
sanjibansg
committed
docs: change docstring of create_dir in dataset.py and file_base.h
sanjibansg
committed
test: hive partitioning in test_write_dataset_s3_put_only
sanjibansg
committed
fix: remove dir if already exist in _configure_s3_limited_user
sanjibansg
committed
fix: added flag --ignore-existing in mc mb command
sanjibansg
committed
review: removed _ensure_minio_component_version
sanjibansg
committed
review: keep _ensure_minio_component_version and skip test if this fails
sanjibansg
committed
test: skip limited user s3 test if _ensure_minio_component_version() fails
sanjibansg
committed
fix: FileNotFoundError Exception and skipping in windows
sanjibansg
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ARROW-15892: [C++] Dataset APIs require s3:ListBucket Permissions#12701

ARROW-15892: [C++] Dataset APIs require s3:ListBucket Permissions#12701
sanjibansg wants to merge 22 commits intoapache:masterfrom
sanjibansg:s3-directory

Commits on Apr 25, 2022

feat: flag in dataset writer for creating dir

test: testing put only limited s3 policy

fix: PrepareDirectory for create_dir flag

fix: lint issue for unused modules

feat: moved limited_s3_user to util

feat: using c_bool instead of bool for create_dir

test: test with expected failure for create_dir flag set to true

docs: docstring explaining test for s3 with put only policy

fix: python lint

fix: limited_s3_user used as a function and moved to util.py

fix: avoid creating dir if already present in _configure_limited_user

docs: changed docstring for create_dir in FileSystemDatasetWriteOptions

refactor: merged limited_s3_user into _configure_limited_user and renamed as _configure_s3_limited_user

refactor: stdlib imports in alphabetical order in util.py

docs: change docstring of create_dir in dataset.py and file_base.h

test: hive partitioning in test_write_dataset_s3_put_only

fix: remove dir if already exist in _configure_s3_limited_user

fix: added flag --ignore-existing in mc mb command

review: removed _ensure_minio_component_version

review: keep _ensure_minio_component_version and skip test if this fails

test: skip limited user s3 test if _ensure_minio_component_version() fails

fix: FileNotFoundError Exception and skipping in windows