Mixtral MoE Trade-Offs: Throughput, Quality, and Routing Behavior

How sparse mixture-of-experts architectures change serving economics and model behavior.