Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
am17an
4 months ago
|
parent
|
context
|
favorite
| on:
Can I run AI locally?
You can still run larger MoE models using expert weight off-loading to the CPU for token generation. They are by and large useable, I get ~50 toks/second on a kimi linear 48B (3B active) model on a potato PC + a 3090
Consider applying for YC's Fall 2026 batch!
Applications
are open till July 27.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: