Skip to content

[Python] Produce chunked arrays for nested types in pyarrow.array #22665

@asfimport

Description

@asfimport

As follow up to ARROW-5028 and other issues, in a case like

vals = [['x' * 1024]] * ((2 << 20) + 1)
arr = pa.array(vals)

The child array of the ListArray cannot hold all of the string data. After the patch for ARROW-5028, an exception is raised rather than returning a malformed array. We could (with some effort) instead produce a chunked array of list type

Reporter: Wes McKinney / @wesm
Assignee: Krisztian Szucs / @kszucs

Related issues:

Note: This issue was originally created as ARROW-6281. Please see the migration documentation for further details.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions