> as little memory latency as possible Should be "as much memory bandwidth as po... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		rfoo on May 13, 2024 \| parent \| context \| favorite \| on: GPUs Go Brrr > as little memory latency as possible Should be "as much memory bandwidth as possible". GPUs are designed to be (relatively) more insensitive to memory latency than CPU.

muyuu on May 13, 2024 [–]

yep that's true, although AI compute modules do get significant benefit from low latency cache as well

Consider applying for YC's Summer 2026 batch! Applications are open till May 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact