Model routing
Definition
Automatically selecting which AI model should handle a particular task.
Put simply
An organisation does not necessarily need to send every job to the same AI.
What boards and leaders should understand
Different models can be better suited to different work.
A straightforward high-volume task might be routed to a cheaper model while a more capable reasoning model is reserved for difficult or high-value problems.
Routing can therefore affect both performance and economics, while also reducing dependency on a single provider.
Questions to consider
- Are we building enough flexibility into our AI architecture to change or combine models when there is a strong business reason to do so?
