AI·llama.cpp build b9966 fixes regex recompilations for -sm tensor mode, caching patterns per tensor to reduce CPU overhead on decode threads.
Search
What are you looking for?
2 results for “tensor”
AI·A user shares benchmarks of dual RTX 3090 and Titan RTX cards running llama.cpp with Qwen3.6-27B at 180k context, comparing tensor and pipeline parallel modes for PCIe transfer efficiency.