Skip to main content

​
Routers and ensembles

Some teams will take a routing-based approach, starting with a small model, and escalating to larger and more powerful models if needed. Others will use ensembles - a variety of different models all performing the same task, and then using some kind of majority voting logic to decide on a final answer. While these approaches can be viable, we recommend choosing one strong model for the task at hand. In some cases the right answer here may be a mixture-of-experts (MoE) type model, which already uses router/ensemble logic as part of its architecture.