Qwen3-0.6B

recent items

• Neural Nova – GPU optimization benchmarks for LLM workloads (www.neural-nova.com via hn) +1 9d

  Performance Benchmarks Explore Optimized AI models recipes across GPUs, frameworks, and deployment configurations. BENCHMARKED MODELS REASONING vLLM · 8× NVIDIA H100-80GB Qwen3-235B-A22B +138.7% token/s +58% Cost Savings Qwen3-235B-A22B ·…

  ↯ Vllm↯ Qwen 3vllm

• Show HN: News observability site tracks coverage by party lean/distraction/etc. (pressaudit.org via hn) +1 9d

  Heya HN! I'm helping launch this site which uses Qwen 3-32b to process thousands of news articles and analyze them by region, public interest, partisan lean, etc.

  ↯ Qwen 3qwen

• Show HN: An open-weight LLM whose answer/stop decision can be flipped internally (github.com via hn) +1 10d

  Continuation control 40/40 GO→EOS 40/40 EOS→GO 640/640 controls unchanged Prompt, weights, and generated reasoning prefix held fixed during intervention. Rayan Pal getswiftapi.com Independent Researcher Thinking-enabled PCCG-Qwen3-4B with…

  ↯ Qwen 3

• FastE: Readout-Triggered Token Compression for LLM Embedding Inference (arxiv.org) 10d

  In this study, we identify depth-dependent prefix redundancy in final-readout LLM embedding models, notably across representative backbones including Qwen3-Embedding and Qwen3-VL-Embedding. We find that removing prefix states is substantia…

  ↯ Qwen 3

• Show HN: Zero downtime embedding model upgrades (github.com via hn) +1 11d

  People use embedding models all the time for rag/semantic retrieval. However, when a newer, more desireable model comes out, there is an expensive (both in time and computational) cost of re-embedding every document in the database.

  ↯ Qwen 3rag

• I used local Qwen 27b to build a harness and replace OpenCode (www.reddit.comhttps) 3w

  Sharing my harness for running local LLMs that I built using Qwen 3.x 27B (> 90% locally built) under my supervision - not vibe-coded. Its free, no telemetry, and open-source (AGPL).

  ↯ Llama↯ Qwen 3↯ Qwen 3↯ Qwen 3↯ Qwen 3↯ Qwen 3↯ Qwen 3llamaqwen

• Can We Read the Mind of an Audio LLM? A Verbalizable, Multilingual Middle-Layer Workspace (arxiv.org) 3w

  An audio language model is a black box in a specific way: we see what it says, never what it works out on the way there, and chain-of-thought monitoring helps only if the model writes its reasoning down. Reading a base Qwen3-Omni with a lo…

  ↯ Qwen 3↯ Qwen 3↯ Qwen 3↯ Qwen 3↯ Qwen 3↯ Qwen 3

• Sped up Qwen3-ASR 1.7B to beat deepgram (www.reddit.com via reddit) 3w

  Guys I solved a bunch of problems and was able to improve the Latency of Qwen to match that of deepgram, for streaming voice calls. Since Qwen is an more of an audio LLM ASR model, it has the smartness that ASR needs.

  ↯ Qwen 3↯ Qwen 3qwen

• Does it Exist: A Leaderboard for Speech Recognition / STT / Transcribing? (www.reddit.com via reddit) 3w

  My last post said I'm integrating simplex with dsh, and I'm working on a voice to text feature for it. Dsh implement it with a fallback if local whispercpp fails.

  ↯ Qwen 3↯ Qwen 3qwen

• Running Qwen 3 27B on 3090 or Mac or whatever? (www.reddit.com via reddit) 4w

  SOO im seeing soo much hype on this model and im seeing everyone be running it on anything, im very curious. I would like to try to run in but in all honestly i know there's like soo many quantized version...

  ↯ Qwen 3↯ Qwen 3↯ Qwen 3qwencodex

• Teaching a local LLM to reason about a new domain through continued pretraining (www.teachmecoolstuff.com via hn) +1 4w

  <p>As an interesting experiment I wanted to learn how to teach a tiny local llm a new domain by doing Continued Pretraining (CPT) on domain specific data. This article is a write-up of my experiences from using Unsloth to train qwen 3 4B t…

  ↯ Qwen 3↯ Qwen 3qwen

• Show HN: Ollama served my 40k-context model at 4k, silently (github.com via hn) +1 4w

  A model that advertises 40,960 tokens was being served 4,096 I've been running knowledge distillation experiments on consumer hardware: one RTX 5080 (16GB VRAM), 32GB of system RAM, an 850W supply, and Qwen3 at 1.7B, 4B, 8B, and 14B, all Q…

  ↯ Ollama↯ Qwen 3↯ Qwen 3ollama

• Show HN: Minna – On-device semantic search across your own documents (macOS) (github.com via hn) +1 4w

  Hi HN! Minna is a new tool geared towards people who have a knowledge base so big they forget where things are.

  ↯ Qwen 3

• Fine-Tuning Qwen3-27B for C-to-Rust Code Translation: A Three-Stage Curriculum of Pretraining, Debugging-Aware SFT, and Task-Specific SFT (arxiv.org) 4w

  Translating C code into safe, idiomatic Rust is a longstanding software-engineering goal because it can eliminate entire classes of memory-safety vulnerabilities while preserving the functional behavior of legacy systems. Large language mo…

  ↯ Fine Tuning↯ Qwen 3fine-tuning

• Local+privacy+focus on cache AI CLI and llama.cpp branch + Qwen3.x (github.com via hn) +11 5w

  privibe CLI coding agent for private, local-first development. privibe is a fork of Mistral Vibe reworked to not do any call back home of any kind and then run against local models first, I want to be able to use it and know it will not be…

  ↯ Llama↯ Mistral↯ Qwen 3mistralllama

• Show HN: Shoehorn, a library to quantize an LLM to fit your Mac's VRAM (github.com via hn) +5 5w

  I made this after seeing someone posit the idea online yesterday over lunch then spent some time refining it. So far it's pretty impressive IMO!

  ↯ Qwen 3

• Ask HN: What are you go to LLM models for the following (news.ycombinator.com) +1 11w

  1. Coding 2.

  ↯ Gemma↯ Qwen 3gemma

• Fine-Tuning General-Purpose Large Language Models for Agricultural Applications:A Reproducible Framework and Evaluation Protocol Based on Qwen3-8B (arxiv.org) 11w

  General-purpose large language models (LLMs) have demonstrated strong abilities in opendomain question answering, information extraction, and text generation. Agricultural applications, however, are domain-specific, region-dependent, time-…

  ↯ Fine Tuning↯ Qwen 3↯ Qwen 3fine-tuning

• Using Claude Pro and Local Models? (www.reddit.com via reddit) 11w

  I currently host a local MCP server with ollama and a qwen3-coder 30b model. I have a Claude pro subscription I'd like to be able to call the qwen3-coder model the same way I call a haiku, and also allow it to be spun up as a sub agent.

  ↯ Haiku↯ Ollama↯ Qwen 3↯ Qwen 3haikuollamasonnet+3

• Show HN: Apex-1-flash, 4B LLM finetuned on RTX 5070 (huggingface.co via hn) +2 12w

  The goal was to create a highly efficient, small-scale model that can perform reasoning tasks while remaining lightweight enough to run easily on consumer hardware. Technical Stack: Base: Qwen3:4B Training: Fine-tuned using Unsloth for mem…

  ↯ Qwen 3

• Show HN: Selora – local model for Home Assistant (github.com via hn) +42 13w

  Selora AI Local is an open-source, Qwen-based model for Home Assistant. Specs: Qwen3 1.7B base model (Q6 quantized~1.6GB) Four Home Assistant-specific LoRA adapters: - Answers - Clarifications - Automations - Commands ~3.5 GB total downloa…

  ↯ Llama↯ Qwen 3llamaqwen

• Show HN: FlashQwen – A from-scratch CUDA inference engine for Qwen3 (github.com via hn) +2 13w

  We read every piece of feedback, and take your input very seriously. To see all available qualifiers, see our documentation.

  ↯ Qwen 3

• Code Correctness Signals in LLM Hidden States: Pre-Generation Probing and Repair Geometry (arxiv.org) 13w

  Large language models encode rich information in their hidden states. This work asks whether code correctness is legible in the hidden states of Qwen3-4B-Instruct-2507, before it generates and as it repairs a failed attempt, studied on 444…

  ↯ Qwen 3

• Local LLM good for OCR of handwriting? (www.reddit.com via reddit) 14w

  I am using qwen3-vl:8b and ollama for doing OCR on scans of handwritten letters and it is doing a decent job. Any other models I should know about for this kind of OCR?

  ↯ Ollama↯ Qwen 3↯ Qwen 3↯ Qwen 3↯ Qwen 3ollama

• Been testing agent skills frameworks for a week - the /spec before code rule is the actual game changer (www.reddit.com via reddit) 14w

  I've been trying out the agent-skills pattern that's trending on GitHub (addyosmani/agent-skills, obra/superpowers) and what surprised me most isn't the slash commands or the auto-routing. It's the /spec before code rule.

  ↯ Qwen 3↯ Qwen 3↯ Qwen 3↯ Qwen 3

• Levi: Run AlphaEvolve on your local QWEN 30B (www.reddit.com via reddit) 14w

  Hi r/LocalLLaMA, Wanted to share something I'm excited about. I've been fascinated by AlphaEvolve and its results for more than a year now, but running the open source frameworks gets expensive fast.

  ↯ Qwen 3gpt-5qwencodex+2

• Looking for a local "NotebookLM for lawyers" setup – what am I doing wrong? (www.reddit.com via reddit) 14w

  Hello everyone I am totally new to LocalLLMs and only used chatGPT/Claude/NotebookLM before. So bear with me 😃 I'm an attorney and would like to analyze and summarize case files locally for privacy/confidentiality reasons.

  ↯ Qwen 3ragqwenchatgpt

• Initial testing with llama-bench and 3 different Qwen3 models for my R9700 32GB (www.reddit.com via reddit) 15w

  In a recent build I did I used dual R9700 32GB cards but I wanted to see how a single R9700 stacked up against other hardware I had access to. I created a simple benchmark with llama-bench and ran it on a few different setups.

  ↯ Llama↯ Qwen 3llama

• Tuning CPU-only Qwen3-30B inference with an IBM Quantum sampling loop (github.com via hn) +1 16w

  Qwen Air QPU/MCP Lab Quantum-enhanced autoresearch for high-performance, CPU-only Mixture-of-Experts LLM inference on legacy hardware. This repository contains the benchmark harness, MCP-style tool boundary, experiment logs, paper draft, a…

  ↯ Qwen 3qwenmcp