HomeLanguagesAwesome Rust › AlexsJones/llmserve

AlexsJones/llmserve

github.com ↗

[llmserve] - Interactive TUI to serve local LLM models with auto-detected backends (llama-server, KoboldCpp, LocalAI, MLX, Ollama, vLLM, LM Studio). Features source tree navigation, per-backend presets, live logs, and vision model support. [](https://github.com/AlexsJones/llmserve/actions/workflows/ci.yml)

↵ to searchesc to close
awesomelist.dev