Free live cohort on Google Meet — register your interest →
← ML Engineering on AWS

A/B Testing

Buildable now. The repo, the spec and the deployment steps are live — the written walkthrough for this one is still being drafted.

Deploy two model variants behind one SageMaker endpoint, shift traffic between them, and pick the winner on real results. This runs two instances at once (about $0.11/hour combined) — tear it down right after testing. Same endpoint pattern as the previous project, now split to answer a question no offline metric can: which model actually wins with real traffic.

Running a real two-variant traffic split on SageMaker is a direct, hands-on answer to 'how would you safely roll out a new model' — a near-universal ML systems interview question.