Find alternative data sources beyond NOAA#79
Merged
Conversation
Implemented comprehensive multi-source data architecture to reduce dependence on NOAA/USA sources and increase resilience. New Features: - MultiSourceSpaceWeatherFetcher class with automatic fallback - Support for international authoritative sources: * SIDC/SILSO (Belgium) - Official sunspot number source * GFZ Potsdam (Germany) - Official Kp/A-index source * NOAA SWPC (USA) - Backup for all parameters * Future: IMAGE Network, INTERMAGNET, Nobeyama Data Sources by Parameter: - Solar Flux (F10.7): NOAA SWPC → LISIRD → Space Weather Canada - Sunspot Number: SIDC/SILSO → NOAA SWPC - Kp Index: GFZ Potsdam → NOAA SWPC - A-Index: GFZ Potsdam → NOAA SWPC Architecture: - Hierarchical fallback: tries primary authoritative source first - Source tracking: records which source provided each value - Error handling: graceful degradation to defaults if all fail - Easy extension: simple to add new data sources Files: - src/dvoacap/space_weather_sources.py: Core multi-source fetcher - Dashboard/generate_predictions.py: Updated to use multi-source fetcher - MULTI_SOURCE_DATA.md: Comprehensive documentation Benefits: - Geopolitical resilience: not relying solely on US sources - Increased reliability: automatic failover between sources - Data diversity: multiple authoritative international sources - Future-proof: protected against single-source discontinuation Testing: - All fetchers tested and working - Fallback logic verified - Integration with generate_predictions.py confirmed Related to concerns about increasing unreliability of NOAA/USA sources.
skyelaird
pushed a commit
that referenced
this pull request
Nov 15, 2025
This commit updates project documentation to reflect recent enhancements: Changes: - Update NEXT_STEPS.md: Current branch, date (2025-11-15), and status - Document space weather features: PRs #78 and #79 (NOAA SWPC + multi-source fallback) - Update README.md: Enhanced dashboard feature description for live space weather data - Add MULTI_SOURCE_DATA.md to key resources Documentation maintenance: - Following DOCUMENTATION_CHECKLIST.md workflow - Ensuring docs stay current to avoid context loss - All documentation now reflects current state as of 2025-11-15
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Implemented comprehensive multi-source data architecture to reduce dependence on NOAA/USA sources and increase resilience.
New Features:
Data Sources by Parameter:
Architecture:
Files:
Benefits:
Testing:
Related to concerns about increasing unreliability of NOAA/USA sources.