Cerebras hands prefill to AMD GPUs to get 5x more tokens per megawatt
The production system puts AMD Instinct GPUs on prompt processing and Cerebras CS-3 systems on decode, first on Cerebras Inference Cloud and then in partner data centers.
Reported so far by one publisher.
Summary from RuntimeWire.
Reporting1
RuntimeWire Cerebras hands prefill to AMD GPUs to get 5x more tokens per megawatt · Ryan Merket
Related
Topics AMD