Skip to content

Open source / #711

Open source

jundot/omlx

GitHub · jundot · 7 months ago · 43 points

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Source adapter
github-search
Source weight
2
Points
43
Age
5210.1 h
Stored score
0.00001
Current score
0.00001
First seen
2026-08-12T05:24:31.913Z

Newsletter

Get practical AI engineering notes

Receive source-checked analysis of models, agents, evaluation, retrieval, and production reliability. Sent only when there is useful work to share.