TinyGPU on Apple Silicon + RTX 5070 Ti: my real Qwen benchmarks vs Ollama/Metal

reddit-localllama · www.reddit.com ·3 replies ↗ ·1d

I spent time setting up TinyGPU on an Apple Silicon Mac and comparing it against Ollama already installed locally. Short version: TinyGPU does work.

ollamaqwen

open →

← back to top