batch size by Q4 will be solid double digits (cerebras employee) | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		jwan584 on Aug 27, 2024 \| parent \| context \| favorite \| on: Cerebras Inference: AI at Instant Speed batch size by Q4 will be solid double digits (cerebras employee)

moconnor on Aug 28, 2024 [–]

Is that e.g. batch 16/32 for each operation e.g. 16-row matmuls in a pipeline? Or a pipeline of vector-math ops that has 16/32 stages? Is the pipeline also double digits deep?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact