Skip to content

Opening large Zarr datasets should be lazy (and fast) #17

@alxmrs

Description

@alxmrs

Found out when trying to open ARCO-ERA5. It looks like it eagerly converts data to a dask dataframe.

Instead, it should return immediately with deferred calls to convert the chunks to dfs.

Implementation Notes

Change from_map to from_delayed.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions