Only one person can rebuild the production model, by running a long notebook by hand in the right order. What is the main fix?
Options
- Add comments to the notebook
- Turn the steps (load data, validate, train, evaluate, register) into an automated, versioned pipeline that anyone can run (Correct option)
- Ask the person to stay in the team
- Retrain the model less often
Answer
Turn the steps (load data, validate, train, evaluate, register) into an automated, versioned pipeline that anyone can run
Why
Manual notebooks hide knowledge in one person's memory and cannot be scheduled, tested or audited.
A pipeline makes each step a defined, repeatable unit with explicit inputs and outputs, so a run can be triggered by a schedule, by new data or by a code change.
Notebooks are still fine for exploration; the pipeline is for what goes to production.
Remember
Automate the steps in a pipeline.