Hidden Technical Debt in Machine Learning Systems(opens in a new tab)
The maintenance costs an ML system builds up outside its model code: entangled features (changing anything changes everything), hidden feedback loops, undeclared consumers of predictions, unstable data dependencies, glue code, pipeline jungles and configuration. Its best-known figure draws the model code as a small box inside the serving, data and monitoring infrastructure around it.