MNN-LLM

github.com ↗

- A Device-Inference framework, including LLM Inference on device(Mobile Phone/PC/IOT)