Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

ik_llama.cpp was about 2x faster for CPU inference of Qwen3.5 versus mainline until yesterday. Mainline landed a PR that greatly increased speed for Qwen3.5, so now ik_llama.cpp is only 10% faster on token generation.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: