Skip to content
This repository was archived by the owner on Mar 6, 2023. It is now read-only.
This repository was archived by the owner on Mar 6, 2023. It is now read-only.

Process fit_curve needs a lot of time #53

@ValentinaHutter

Description

@ValentinaHutter

The fit_curve process is working for small and large spatial extents, but it takes significantly longer for large spatial extents.
When fit_curve is calculating parameters the temporal extent must not be chunked. We now tried to chunk by spatial extent, but this did not improve the speed of the process.
So with an extent of 'x': (11.390419, 11.501999), 'y': (46.311778, 46.373875), 'time': ['2016-09-01', '2018-09-01'], 'measurements': ['B01', 'B02', 'B03', 'B04', 'B07']}) and 'dask_chunks': {'bands': 1, 'time': 150, 'x': 1000, 'y': 1000} applying the fit_curve process takes < 1 hour.
When using the same extent but 'dask_chunks': {'bands': 1, 'time': 150, 'x': 250, 'y': 250} the process took almost 2 hours. So chunking the dataset by spatial extent does not work the way it should.
While a smaller extent like 'x': (11.436012, 11.43804), 'y': (46.346286, 46.34833) takes a minute.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions