Show HN: We made our own inference engine for Apple Silicon
Hacker News (score: 60)
Found: July 15, 2025
ID: 317
Description
Other
Show HN: We made our own inference engine for Apple Silicon
We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases. Your feedback is very welcomed. Written from scratch with idea that you can add support of any kernel and platform.
More from Hacker
The Chan-Zuckerbergs stopped funding social causes
The Chan-Zuckerbergs stopped funding social causes
No other tools from this source yet.