Hacker Newsnew | past | comments | ask | show | jobs | submit | fromlogin
Llama 2 70B on M2 Max at 7 tokens/sec (twitter.com/junrushao)
42 points by tikkun on Sept 1, 2023 | past | 6 comments
MLC LLM: 70B Llama-2-4bit on MacBook at 50%-80% speed of A100 (twitter.com/junrushao)
12 points by junrushao1994 on July 20, 2023 | past | 3 comments

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: