Cerebras hands prefill to AMD GPUs to get 5x more tokens per megawatt

First reported by RuntimeWire at · Updated · 1 source

The production system puts AMD Instinct GPUs on prompt processing and Cerebras CS-3 systems on decode, first on Cerebras Inference Cloud and then in partner data centers.

Reported so far by one publisher.

Summary from RuntimeWire.

Reporting1

Related

Topics AMD