PPowerInfer
github.com ↗- PowerInfer is a CPU/GPU LLM inference engine leveraging activation locality for your device.
READMEView on GitHub ↗
PP- PowerInfer is a CPU/GPU LLM inference engine leveraging activation locality for your device.