Splitting `environment.yml` into only the runtime depdendencies?

[scottstanie]

Hi, what are the thoughts on having just the requirements needed for running in the environment.yml?

I ask because I tried to install raider-base in my "catch-all" geospatial environment, and while I do have basically everything in there, the hard pin of

- jsonschema==3.2.0  # this is for ASF DAAC ingest schema validation

meant I couldn't install it.
Alternatively, we could remove some of them from the feedstock requirements list: https://github.com/conda-forge/raider-feedstock/blob/main/recipe/meta.yaml#L56 (I see that jsonschema is only used in one test)

[jlmaurer]

@scottstanie I think this is good. We have a lot of deps and they are getting a bit cluttered. Why does ASF DAAC need that specific version? or can we change it to >?

[jhkennedy]

Yes, I'd agree; we should make a lot of the dependencies optional.

IIRC, we are stuck on that specific version for jsonschema; @asjohnston-asf can you confirm?

But, there's no reason we couldn't have it be an optional import and test the optional stuff separately.

[asjohnston-asf]

TLDR: I don't see a need to pin jsonschema

ASF's ingest workflow for GUNWs enforces a schema for the metadata file sent by the data provider:

• ASF's copy: https://github.com/asfadmin/grfn-ingest/blob/test/verify/src/metadata_schema.json
• RAiDER's copy: https://github.com/dbekaert/RAiDER/blob/dev/test/gunw_test_data/gunw_schema.json

RAiDER's test_GUNW.py::test_GUNW_hyp3_metadata_update uses jsonschema to verify the metadata file still matches the required schema after updating the weather_model attribute. Since it's only used in testing, it can be an optional requirement.

I don't see any reason to pin to 3.2.0 specifically; ASF is using the latest and greatest 4.23.0 to do the same check.

[asjohnston-asf]

3.2.0 is what grfn-ingest happened to be pinned to (and well out of date) when Charlie added it to Raider in Apr 2023; I'll assume the pin was copy/pasted. ASF jumped ahead to the then-current 4.17.3 in grfn-ingest later that month in some long overdue housekeeping.