You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Split Repo.collect() for pipelines usage and stage gathering:
Data related commands don't care about orderings of pipeline stages, whereas for pipelines,
things are more complex than collect() can handle.
This will also remove duplicated warnings currently on reproduce. Workaround on tag: getting rid of it #3699 for now
Why is there schema/serialization/deserialization in 3 places? Yeah, true.
Parallel logics of loading/transforming/dumping of Output, Dependency and Stages for single stage and pipeline stages (Requires further investigation)
StageLoader is too dynamic.
Messed with OutputDuplicationsError: Make sure it's safe to remove current stage from error message.
Tracking things to cleanup after #3676 is merged, in addition to suggestions in the PR:
tags(will make life simpler) tag: getting rid of it #3699Repo.collect()for pipelines usage and stage gathering:Data related commands don't care about orderings of pipeline stages, whereas for pipelines,
things are more complex than
collect()can handle.This will also remove duplicated warnings currently on
reproduce.Workaround on tag: getting rid of it #3699 for now
Output,DependencyandStagesfor single stage and pipeline stages (Requires further investigation)StageLoaderis too dynamic.OutputDuplicationsError: Make sure it's safe to remove current stage from error message.dump()ordered (Only for Python==3.5).StageParamsandOutputParamsOf course, we need lots of tests and UI issues fixes, but this meta issue is only regarding code cleanups.