Skip to content

Reworking how ingest_spectrum works using the ORM#4

Closed
dr-rodriguez wants to merge 3 commits intokelle:pyspextool-ingestfrom
dr-rodriguez:rework_ingest_spectrum
Closed

Reworking how ingest_spectrum works using the ORM#4
dr-rodriguez wants to merge 3 commits intokelle:pyspextool-ingestfrom
dr-rodriguez:rework_ingest_spectrum

Conversation

@dr-rodriguez
Copy link

This is attempting to rework how ingest_spectrum functions by utilizing the ORM and removing extra checks.

Some of the tests were failing since there are explicit strings that were being checked- they "bad" examples still fail, they just do so for other reasons or the string output is different. Some test cleanup may be needed.

We may also want to consider expanding the cleanup and/or revisit the use of flags

@dr-rodriguez
Copy link
Author

dr-rodriguez commented May 14, 2024

Could also set it to merge into SIMPLE-AstroDB:main but if you wanted to use this for your branch first, this may be one way to do it.

As a note, this does pass our tests but the automated pipeline will likely only run if merging against SIMPLE-AstroDB.

@kelle
Copy link
Owner

kelle commented May 15, 2024

Love this! I was working on it last night and ended up almost in the same place for catching missing values (eg, regime is required). :)

Question: how do we validate
the foreign key constraints? Eg, that the provided regime is in the Regimes table? Unfortunately, the error thrown is a generic Foreign Key constraint error and doesn't say which field is the culprit

dr-rodriguez and others added 2 commits June 12, 2024 09:33
* Create requirements.txt file

* Removing old files and updating documentation

* Updating tests to use requirements.txt

* add explicit python vs command line

* fix numbering.

---------

Co-authored-by: Kelle Cruz <kellecruz@gmail.com>
@dr-rodriguez
Copy link
Author

Withdrawn in favor of SIMPLE-AstroDB#501

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants