Enable Automatic Roll Backs for Production Models

March, 2023 • Alex Serban, Koen van der Blom, Joost Visser

32 / 46 • Deployment •

This practice was ranked as medium.
Click to read more. •

This practice helps to increase
the team's agility.
Click to read more.

Intent

Avoid sub-optimal models in production.

Motivation

Similar to deployment, rolling back models can be a tedious process. Instead of manually performing this task, it is recommended to define an automatic process for it.

Applicability

Automatic rollbacks should be implemented in any production-level ML application.

Description

If, due to changes in the input data or undetected skew, a deployed model performs sub-optimal, it should be rolled back to an earlier, better performing version.

Designing a process for automatic roll-back minimizes the time a deployed model with sub-optimal performance is kept in production.

Adoption