From Dev.to
Local coding LLM on a 24GB GPU: Qwen2.5-Coder 32B vs Qwen3-Coder 30B-A3B (it's all about context)
If you want a local coding model on an RTX 4090 / 3090 / 7900 XTX, the question isn't only "does it load", it's "does it load with enough context to read my files". Build 4K 8K 16K 32K GGUF Q4_...