GPUStack

github.com ↗

An open-source GPU cluster manager for running LLMs