Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

same, but you need more then 100k of hw to run something like kimi k2.6 for a bigger team. on the other hand there is a ds4 flash that you can run on a macbook with 128gb ram. an that one is perfectly usable for a lot of tasks.

https://github.com/antirez/ds4



I think the quote came out to $107k. 4 AMD MI300A's. Around 60k tokens per second, 512GB of GPU memory.

https://www.gigabyte.com/Enterprise/GPU-Server/G383-R80-AAP1


Which model are you running ?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: