llama-modchip

Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs).

Loading community details…
Loading project owner…
Loading launchers…
Loading check-ins…

Community

Create post
Ask or share about llama-modchip…
Loading...