From Dev.to
Should this prompt leave the device? Let a 449 MB model decide first
Most apps with an LLM in them make the same decision on every request, and they make it without looking: send it to the cloud. "Fix the typo in this sentence" goes to the same frontier model as "refac...