Faster Local LLMs with iPhone Offloading | Hacker News - But Better

Faster Local LLMs with iPhone Offloading github.com

Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable - StayLameBro/backburner

1 points•oezi•about 3 hours ago•1 comment•

#iphone #faster #local #offloading #llms #local llms #faster local #iphone offloading

1 comment

oeziabout 3 hours ago

Posted on reddit: https://www.reddit.com/r/LocalLLaMA/comments/1wvz1ex/i_made_...

Read the full thread on Hacker News →

Related stories

Can John Ternus find Apple’s next big thing?theverge.com
The Verge · 0 points · 12 days ago
Review: The iPhone 18 Pro is Apple's coolest smartphone (but only literally)arstechnica.com
Ars Technica · 0 points · 8 days ago
iPhone owners can now submit claims in Apple’s $250 million Siri AI settlementtheverge.com
The Verge · 0 points · 12 days ago
Show HN: Ox – A local agent that uses the internet for youopenox.ai
Hacker News · 2 points · 10 days ago
VRAM for local LLMs: why memory bandwidth sets your tokens per seconddev.to
DEV Community · 2 points · 3 days ago
Show HN: StarSkirmish, an arena where LLMs create StarCraft Brood War botsstarskirmish.com
Hacker News · 3 points · 7 days ago