Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

It was a 1.5B parameter model. It was still impressive for 2019, but yeah, it was nothing to worry about.


1.5B and insanely under-trained. Size didn't mean much before the scaling laws papers came out.




Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: