Triton Inference Server

- Triton is a high performance open source serving software to deploy AI models from any framework on GPU & CPU while maximizing utilization.