Skip to content

[BI-2055] - Remove missingValueString tablesaw values#438

Closed
HMS17 wants to merge 5 commits intodevelopfrom
bug/BI-2055
Closed

[BI-2055] - Remove missingValueString tablesaw values#438
HMS17 wants to merge 5 commits intodevelopfrom
bug/BI-2055

Conversation

@HMS17
Copy link
Contributor

@HMS17 HMS17 commented Dec 19, 2024

Description

Story: BI-2055 - Remove missingValueString tablesaw values

Default tablesaw behavior silently converts certain values to an empty string when processing tables, which can lead to unexpected behavior when importing files in DeltaBreed. This follows up on work implemented in BI-1993 to also remove this silent conversion for N/A, NaN, *, and null values and update associated tests. Since before this card any of the aforementioned values would be converted to null, this revealed some unexpected behavior in downstream workflows processing said values, which this part of the card addressed.

Dependencies

tablesaw: bug/BI-2055 (should be merged into master before this card is tested to avoid a great deal of pain)

Testing

For both the new experiment and append/overwrite workflows

  • Upload a file that has the following values (N/A, NaN, *, null) for each ontology term scale class
    • Confirm that appropriate error appears for numerical, date, ordinal, and nominal scale classes when N/A, NaN, *, and null are observation inputs
    • Confirm that no error appears for cells with free text values with N/A, NaN, and *
    • Confirm that "'Null' is not a valid value" error appears for cells with free text value of null
  • Upload a file with just N/A, NaN, and * values for a free text ontology term
    • Confirm that import preview loads and displays correct values for free text terms
    • Complete upload and ensure that free text terms display in experiment and observations table

Smoke test other upload workflows as a sanity measure

Checklist:

  • I have performed a self-review of my own code
  • I have tested my code and ensured it meets the acceptance criteria of the story
  • I have tested that my code works with both the brapi-java-server and BreedBase
  • I have create/modified unit tests to cover this change
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to documentation
  • I have run TAF: _<please include a link to TAF run>_

@github-actions github-actions bot added the bug Something isn't working label Dec 19, 2024
@HMS17 HMS17 requested review from a team, davedrp and mlm483 and removed request for a team January 10, 2025 20:32
@HMS17 HMS17 marked this pull request as ready for review January 10, 2025 21:33
Copy link
Contributor

@mlm483 mlm483 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested, working.

I left one suggested change to clean up a comment.

HMS17 and others added 2 commits January 15, 2025 17:08
Co-authored-by: mlm483 <128052931+mlm483@users.noreply.github.com>
@HMS17
Copy link
Contributor Author

HMS17 commented Feb 11, 2025

Closing due to change in requirements for card no longer including null among the values to remove from missingValueString

@HMS17 HMS17 closed this Feb 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants