Jupyter notebook based pipelining using DVC?

[kurianbenoy]

How can DVC be used in a jupyter notebook based system for pipelining each stages? Where assuming all stages for data processing, feature engineering to even model tuning. We use just one single jupyter notebook system?

[shcheklein]

from the top of my head - system with Python decorators @danfischetti implemented for his team comes to my mind as a solution for this (it's not publicly available yet).

[casperdcl]

NB would probably be useful to change from tqdm import tqdm to from tqdm.auto import tqdm to get nice notebook progress bars

[efiop]

@casperdcl Oh, it will make it detect if it is running from a notebook? Neat!

[casperdcl]

Yes