LiteRT LM Framework with Rockchip NPU (RKNN 3588)

reddit-localllama · www.reddit.com ·1 pts ·11h

Im searching for build version of LiteRT LM framework can use and utilize the NPU of the RKNN 3588. It would be great since I can run gemma 4 e2b model using this framework on the machine, because I wont have to migrate my codebase from li…

llamagemma

open →

← back to top