LLMs: Speeding up ALiBi by 3-5x with a hardware-efficient implementation | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		LLMs: Speeding up ALiBi by 3-5x with a hardware-efficient implementation (princeton.edu)
		2 points by eitanturok on Feb 7, 2024 \| hide \| past \| favorite \| 1 comment

eitanturok on Feb 7, 2024 [–]

ALiBi or RoPE?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact