Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
tome
on Feb 19, 2024
|
parent
|
context
|
favorite
| on:
Groq runs Mixtral 8x7B-32k with 500 T/s
We connect hundreds of chips across several racks with fast interconnect.
AhtiK
on Feb 19, 2024
[–]
How fast is the memory bandwidth of that fast interconnect?
tome
on Feb 19, 2024
|
parent
[–]
Have a look at section 2.3 of our paper. Between any two chips we get 100 Gbps. The overall bandwidth depends on the connection topology used. I don't know if we make that public.
https://wow.groq.com/wp-content/uploads/2023/05/GroqISCAPape...
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
