data production package model configuration management code versioning, infrastructure-as-code, api versioning data & data dictionary management, model & platform versioning, api versioning continuous integration constantly validating behavior of code against tests constantly validating model against scenarios and data continuous delivery always ready to deploy to production and smart devices (ios / android) always ready to deploy to production and smart devices (edge) observability / care and feeding instrument code, monitoring & alerting infrastructure collect model accuracy, continuous model training - data feeds back into training thanks to 勇张