Gave Claude a local LLM as assistant on my Mac (www.reddit.com)
model roundup
Qwen 2.5
-
Hi there! I was playing around with Ollama and LMstudio, testing local models and had the idea of letting Claude evaluate a few models on their actual capabilities rather than doing it myself.
-
After doing a little bit of digging (well, perusing reddit and asking other models), I'm leaning toward the following: - Default chat: qwen3:30b / qwen3:30b-instruct - Default coding: qwen3-coder:30b - Local reasoning: gpt-oss:20b - Fast c…
-
Local Autonomous Security Agent-QWEN2.5-7B+MCP Agent Loop (huggingface.co via hn)
Hugging Face Models Datasets Spaces Buckets new Docs Enterprise Pricing Log In Sign Up 1 1 Christopher Sheridan automajicly Follow 0 followers · 1 following AI & ML interests LLM'S , Open AI, Experimentation Recent Activity updated a model…
-
How difficult is distilling? (www.reddit.com)
I remember a year or so ago when DeepSeek R1 came out and it was pretty quickly distilled into Llama 3 8b and Qwen 2.5 (?) 7b. Why don’t we see more distilled models?