Serving

All interview questions related to Serving

1 Questions

1 Categories

1 Advanced

Design an ML Model Serving Platform

Advanced

Design a platform to serve ML models at scale with versioning, monitoring, A/B testing, and GPU utilization.

45 min•System-Design