Running Qwen 3 27B on 3090 or Mac or whatever? (www.reddit.com via reddit)
model roundup
Qwen 3
-
SOO im seeing soo much hype on this model and im seeing everyone be running it on anything, im very curious. I would like to try to run in but in all honestly i know there's like soo many quantized version...
-
Teaching a local LLM to reason about a new domain through continued pretraining (www.teachmecoolstuff.com via hn)
<p>As an interesting experiment I wanted to learn how to teach a tiny local llm a new domain by doing Continued Pretraining (CPT) on domain specific data. This article is a write-up of my experiences from using Unsloth to train qwen 3 4B t…
-
Show HN: Ollama served my 40k-context model at 4k, silently (github.com via hn)
A model that advertises 40,960 tokens was being served 4,096 I've been running knowledge distillation experiments on consumer hardware: one RTX 5080 (16GB VRAM), 32GB of system RAM, an 850W supply, and Qwen3 at 1.7B, 4B, 8B, and 14B, all Q…
-
Hi HN! Minna is a new tool geared towards people who have a knowledge base so big they forget where things are.
-
Translating C code into safe, idiomatic Rust is a longstanding software-engineering goal because it can eliminate entire classes of memory-safety vulnerabilities while preserving the functional behavior of legacy systems. Large language mo…
-
Local+privacy+focus on cache AI CLI and llama.cpp branch + Qwen3.x (github.com via hn)
privibe CLI coding agent for private, local-first development. privibe is a fork of Mistral Vibe reworked to not do any call back home of any kind and then run against local models first, I want to be able to use it and know it will not be…
-
Show HN: Shoehorn, a library to quantize an LLM to fit your Mac's VRAM (github.com via hn)
I made this after seeing someone posit the idea online yesterday over lunch then spent some time refining it. So far it's pretty impressive IMO!