Skip to content

[Python] Crash in test_parquet.py::test_parquet_writer_filesystem_s3_uri (closing NativeFile from S3FileSystem) #25939

@asfimport

Description

@asfimport

See #7991 (comment) and the commented out test added in that PR.

It doesn't give any clarifying traceback or crash message, but it segfaults when closing the NativeFile returned from S3FileSystem.open_output_stream in ParquetWriter.close().

With gdb I get a bit more context:

Thread 1 "python" received signal SIGSEGV, Segmentation fault.
0x00007fa1a39df8f2 in arrow::fs::(anonymous namespace)::ObjectOutputStream::UploadPart (this=0x5619a95ce820, data=0x7fa197641ec0, nbytes=15671, owned_buffer=...) at ../src/arrow/filesystem/s3fs.cc:806
806       client_->UploadPartAsync(req, handler);

Another S3 crash in the parquet tests: ARROW-9814 (although it doesn't seem fully related)

Reporter: Joris Van den Bossche / @jorisvandenbossche
Assignee: Antoine Pitrou / @pitrou

PRs and other links:

Note: This issue was originally created as ARROW-9906. Please see the migration documentation for further details.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions