Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
disiplus
4 months ago
|
parent
|
context
|
favorite
| on:
I think Anthropic and OpenAI have found product-ma...
same, but you need more then 100k of hw to run something like kimi k2.6 for a bigger team. on the other hand there is a ds4 flash that you can run on a macbook with 128gb ram. an that one is perfectly usable for a lot of tasks.
https://github.com/antirez/ds4
FuriouslyAdrift
3 months ago
[–]
I think the quote came out to $107k. 4 AMD MI300A's. Around 60k tokens per second, 512GB of GPU memory.
https://www.gigabyte.com/Enterprise/GPU-Server/G383-R80-AAP1
disiplus
3 months ago
|
parent
[–]
Which model are you running ?
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
https://github.com/antirez/ds4