MLServer

github.com ↗

- An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more.