Skip to content

[Python][CI] S3 fixtures fail with Pytest 8.0.0 #39957

@AlenkaF

Description

@AlenkaF

Describe the bug, including details regarding any error messages, version, and platform.

S3 fixtures from out test suite fail with the new pytest=8.0.0 release with:

==================================== ERRORS ====================================
__________ ERROR at setup of test_parquet_file_with_filesystem[True] ___________

s3_server = {'connection': ('localhost', 37805, 'arrow', 'apachearrow'), 'process': <Popen: returncode: None args: ['minio', '--compat', 'server', '--quiet', '-...>, 'tempdir': local('/tmp/pytest-of-root/pytest-0')}

    @pytest.fixture
    def s3_example_fs(s3_server):
        from pyarrow.fs import FileSystem
    
        host, port, access_key, secret_key = s3_server['connection']
        uri = (
            "s3://{}:{}@mybucket/data.parquet?scheme=http&endpoint_override={}:{}"
            .format(access_key, secret_key, host, port)
        )
        fs, path = FileSystem.from_uri(uri)
    
>       fs.create_dir("mybucket")

opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/parquet/conftest.py:88: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
pyarrow/_fs.pyx:603: in pyarrow._fs.FileSystem.create_dir
    ???
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

>   ???
E   OSError: Bucket 'mybucket' not found. To create buckets, enable the allow_bucket_creation option.

see

Pytest currently has an upper pin so our CI is not failing.

Component(s)

Python

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions