MLOps Deployment and Life Cycling

This chapter gives a high-level overview of MLOps principles and framework components important for deployment and life cycling.

This chapter is dedicated to all the considerations we need to make already in the development phase, in order to ensure a smooth ride when we reach the operations.Our ultimate goal is to explain how to train the model using MLOps best practices and build a model package that enables smooth deployment, reproducibility and post-deployment monitoring.

This chapter deals with critical model operations questions such as:

• What are the different ways in which we can serve our models?
• What is an API, and what are its key functionalities?
• How do we thoroughly test our service before making it available to the end users?
• How do we update models in production without service disturbance?

You will learn about batch prediction, real-time prediction, input and output data validation, unit testing, integration testing, canary deployment, and much more.

This final chapter is dedicated to monitoring and maintaining ML services after they are deployed, as well as to model governance.You will cover crucial concepts such as verification latency, covariate shift, concept drift, human-in-the-loop systems, and more.