From Dev.to
Building a local-first decision engine that only calls the big model when it's worth it
Every AI agent I've built eventually hits the same wall: calling a big model on every request is too expensive, but a small local model is too dumb on the hard cases. Most teams pick one side and live...