What are you looking for?

next best jump from qwen 3.6 27b

AI·Community discusses upgrades from Qwen3.6-27B, recommending options like DeepSeek V4 Flash or GLM-5.2 requiring 100-250GB VRAM for noticeable performance gains.

I feel like I'm not using my hardware efficiently

AI·User with RTX 4090, 3090Ti, and 128GB RAM struggles to run larger models like 122B due to VRAM limits while Qwen3.6-27B runs efficiently without using system RAM.

Running Qwen3 30B A3B at 50 tok/s on RTX 5060 Ti

AI·Achieves 50-54 tok/s for Qwen3 30B A3B float8 on 16GB RTX 5060 Ti using custom CUDA/C++.

Ultra budget 20GB vram with 448GB/s for $100 bucks.

AI·A $100 setup using three NVIDIA P102 cards delivers 20 GB VRAM and 448 GB/s memory bandwidth, sufficient for three concurrent LLM users with high context and better speeds than costlier lower-VRAM cards.

Dual 3060 MoE loading issue.

AI·Identifies dual 3060 MoE loading limit at 12 layers VRAM for Qwen3 35B/122B with CPU offload.

Is it possible to run Qwen 122B in 64GB ram + 24gb vram ? If so, how ?

AI·Discusses feasibility of running Qwen 122B on 64GB RAM + 24GB VRAM and suitable settings.

Upgrading from 2x 3090 - what should I add? (2x A6000/5090/48GB 4090?)

AI·User upgrading from dual RTX 3090 asks for advice on adding cards for 100-110 GB model support, weighing 2x modded 48 GB 4090, 2x A6000, or 2x 5090 in hybrid setup.