Local models are actually good now - playing with Qwen3.8-27B
A 4-bit Qwen3.8-27B built a cellular automata workbench locally on my M4 Pro, while 6-bit finished and 8-bit hit OOM.
tag archive
apple-silicon
Posts tagged apple-silicon on billiem.
tag archive
Posts tagged apple-silicon on billiem.
A 4-bit Qwen3.8-27B built a cellular automata workbench locally on my M4 Pro, while 6-bit finished and 8-bit hit OOM.