Shopify's AI Proxy Survives Any Model Shutdown

Shopify built an LLM proxy that routes engineers through multiple AI providers simultaneously, enabling automatic failover when any model goes down, changes, or disappears. The system purchases tokens in bulk and connects all users through a single layer, providing seamless switching between providers like Anthropic and OpenAI. When Claude Fable 5 shut down, Shopify engineers experienced no disruption as the proxy automatically shifted them to alternative models. Head of engineering Farhan Thawar says the setup allows the team to spread usage across providers, with built-in reporting and availability management baked in.