From Dev.to
Two DGX Spark-class boxes, one model: a copy on each beat splitting it
For seven weeks our local language model ran split across two NVIDIA GB10 machines with tensor parallelism. On 22 October we replaced that with a full copy of the model on each machine and a least-con...