Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
kiratp
on March 10, 2023
|
parent
|
context
|
favorite
| on:
Llama.cpp: Port of Facebook's LLaMA model in C/C++...
Apple Silicon uses unified memory so laptops have up to 64GB of VRAM and the Max sitio can have up to 128 GB.
That makes them uniquely “powerful” for inference with large models.
lynguist
on March 11, 2023
[–]
Nowadays up to 96GB on the laptops.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
That makes them uniquely “powerful” for inference with large models.