omlx

github.com/jundot/omlxUpdated 5mo ago

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Loading community details…
Loading project owner…
Loading launchers…
Loading check-ins…

Community

Create post
Ask or share about omlx…
Loading...
omlx on Pinokio