Llama3 Performance Cost Benchmark | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Llama3 Performance Cost Benchmark (parseur.com)
		2 points by joss82 on April 25, 2024 \| hide \| past \| favorite \| 1 comment

joss82 on April 25, 2024 [–]

I spent the last few days testing Llama3 on different GPUs, to find the cheapest cost per token. Spoiler: it's the Nvidia L4, surprisingly.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact