According to https://x.com/firesidealpha/status/2108930562794864912 They said frontier labs have a goal of releasing phones with this much power in 2028. Better start saving your pennies.
model
Qwen3-0.6B
huggingface.co/Qwen/Qwen3-0.6B ↗
15189206 downloads1189 likestext-generationtransformers
from the model card
Qwen3-0.6B Qwen3 Highlights Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models. Built upon extensive training, Qwen3 delivers groundbreaking advancements in reasoning, instruction-following, agent capabilities, and multilingual support, with the following key features: Uniquely support of seamless switching between thinking mode (for complex logical reasoning, math, and coding) and non-thinking mode (for efficient, general-purpose dialogue) within single model, ensuring optimal performance across various scenarios. Significantly enhancement in its reasoning capabilities, surpassing previous QwQ (in thinking mode) and Qwen2.5 instruct models (in non-thinking mode) on mathematics, code generation, and commonsense logical reasoning. Superior human preference alignment, excelling in creative writing, role-playing, multi-turn dialogues, and instruction following, to deliver a more natural, engaging, and immersive conversational experience. Expertise in agent capabilities, enabling precise integration with external tools in both thinking and unthinking modes and achieving leading performance among open-source models in complex agent-based tasks. Support of 100+ languages and dialects with strong capabilities for multilingual instruction following and translation. Model Overview Qwen3-0.6B…
discussions
- Claude Local Model Release 5 2026-10-06 – 2026-10-14
- Qwen 3 5 2026-09-07 – 2026-09-12
- Qwen 3 5 2026-08-25 – 2026-08-29
- Qwen 3 6 2026-08-22 – 2026-08-27
- Qwen 3 9 2026-08-14 – 2026-08-24
- Qwen 3 4 2026-06-30 – 2026-07-05
- Qwen 3 4 2026-06-26 – 2026-07-02
- Qwen 3 3 2026-06-15 – 2026-06-19
- Qwen 3 6 2026-06-05 – 2026-06-12
- Qwen 3 7 2026-05-22 – 2026-06-01
- Qwen 3 10 2026-05-19 – 2026-05-24
- Qwen 3 9 2026-05-09 – 2026-05-21
- Qwen 3 20 2026-04-25 – 2026-05-09
- Qwen 3 6 2026-04-19 – 2026-04-25
- Qwen 3 13 2026-04-13 – 2026-04-21
recent items
Poll: when do you think you'll be able to run a model as smart as Qwen 3 27b on your phone at goodspeed? (www.reddit.com via reddit) Open-sourcing Finsight, based on Qwen3-14B for financial reasoning (news.ycombinator.com) We are open-sourcing an earlier version of Finsight, based on Qwen3-14B, adapted for financial reasoning. One interesting result was the trade-off: - FinQA accuracy improved from 1.9% to 12.6% - Six-benchmark average declined from 0.441 to…
I built a Claude Code skill that takes AI text from 45% to 0% in Grammarly, GPTZero and ZeroGPT, with a local base model. Here's what controlled experiments taught me about detectors (www.reddit.com via reddit) TL;DR: detectors mostly catch chat training, not "AI". A base model paraphrasing reads human.
Hey guys newbie here (www.reddit.com via reddit) This is my first time trying to locally host an ai but i want to find a good model that can fit on my rtx 4050 laptop gpu that has 6gb vram and my laptop has 24gb ddr5 ram (4800mt/s) so can you suggest me a model that can code websites or…
Neural Nova – GPU optimization benchmarks for LLM workloads (www.neural-nova.com via hn) Performance Benchmarks Explore Optimized AI models recipes across GPUs, frameworks, and deployment configurations. BENCHMARKED MODELS REASONING vLLM · 8× NVIDIA H100-80GB Qwen3-235B-A22B +138.7% token/s +58% Cost Savings Qwen3-235B-A22B ·…
Show HN: News observability site tracks coverage by party lean/distraction/etc. (pressaudit.org via hn) Heya HN! I'm helping launch this site which uses Qwen 3-32b to process thousands of news articles and analyze them by region, public interest, partisan lean, etc.
Show HN: An open-weight LLM whose answer/stop decision can be flipped internally (github.com via hn) Continuation control 40/40 GO→EOS 40/40 EOS→GO 640/640 controls unchanged Prompt, weights, and generated reasoning prefix held fixed during intervention. Rayan Pal getswiftapi.com Independent Researcher Thinking-enabled PCCG-Qwen3-4B with…
FastE: Readout-Triggered Token Compression for LLM Embedding Inference (arxiv.org) In this study, we identify depth-dependent prefix redundancy in final-readout LLM embedding models, notably across representative backbones including Qwen3-Embedding and Qwen3-VL-Embedding. We find that removing prefix states is substantia…
Show HN: Zero downtime embedding model upgrades (github.com via hn) People use embedding models all the time for rag/semantic retrieval. However, when a newer, more desireable model comes out, there is an expensive (both in time and computational) cost of re-embedding every document in the database.
I used local Qwen 27b to build a harness and replace OpenCode (www.reddit.comhttps) Sharing my harness for running local LLMs that I built using Qwen 3.x 27B (> 90% locally built) under my supervision - not vibe-coded. Its free, no telemetry, and open-source (AGPL).
↯ Llama↯ Qwen 3↯ Qwen 3↯ Qwen 3↯ Qwen 3↯ Qwen 3↯ Qwen 3llamaqwen
Can We Read the Mind of an Audio LLM? A Verbalizable, Multilingual Middle-Layer Workspace (arxiv.org) An audio language model is a black box in a specific way: we see what it says, never what it works out on the way there, and chain-of-thought monitoring helps only if the model writes its reasoning down. Reading a base Qwen3-Omni with a lo…
Sped up Qwen3-ASR 1.7B to beat deepgram (www.reddit.com via reddit) Guys I solved a bunch of problems and was able to improve the Latency of Qwen to match that of deepgram, for streaming voice calls. Since Qwen is an more of an audio LLM ASR model, it has the smartness that ASR needs.
Does it Exist: A Leaderboard for Speech Recognition / STT / Transcribing? (www.reddit.com via reddit) My last post said I'm integrating simplex with dsh, and I'm working on a voice to text feature for it. Dsh implement it with a fallback if local whispercpp fails.
Running Qwen 3 27B on 3090 or Mac or whatever? (www.reddit.com via reddit) SOO im seeing soo much hype on this model and im seeing everyone be running it on anything, im very curious. I would like to try to run in but in all honestly i know there's like soo many quantized version...
Teaching a local LLM to reason about a new domain through continued pretraining (www.teachmecoolstuff.com via hn) <p>As an interesting experiment I wanted to learn how to teach a tiny local llm a new domain by doing Continued Pretraining (CPT) on domain specific data. This article is a write-up of my experiences from using Unsloth to train qwen 3 4B t…
Show HN: Ollama served my 40k-context model at 4k, silently (github.com via hn) A model that advertises 40,960 tokens was being served 4,096 I've been running knowledge distillation experiments on consumer hardware: one RTX 5080 (16GB VRAM), 32GB of system RAM, an 850W supply, and Qwen3 at 1.7B, 4B, 8B, and 14B, all Q…
Show HN: Minna – On-device semantic search across your own documents (macOS) (github.com via hn) Hi HN! Minna is a new tool geared towards people who have a knowledge base so big they forget where things are.
Fine-Tuning Qwen3-27B for C-to-Rust Code Translation: A Three-Stage Curriculum of Pretraining, Debugging-Aware SFT, and Task-Specific SFT (arxiv.org) Translating C code into safe, idiomatic Rust is a longstanding software-engineering goal because it can eliminate entire classes of memory-safety vulnerabilities while preserving the functional behavior of legacy systems. Large language mo…
Local+privacy+focus on cache AI CLI and llama.cpp branch + Qwen3.x (github.com via hn) privibe CLI coding agent for private, local-first development. privibe is a fork of Mistral Vibe reworked to not do any call back home of any kind and then run against local models first, I want to be able to use it and know it will not be…
Show HN: Shoehorn, a library to quantize an LLM to fit your Mac's VRAM (github.com via hn) I made this after seeing someone posit the idea online yesterday over lunch then spent some time refining it. So far it's pretty impressive IMO!
Fine-Tuning General-Purpose Large Language Models for Agricultural Applications:A Reproducible Framework and Evaluation Protocol Based on Qwen3-8B (arxiv.org) General-purpose large language models (LLMs) have demonstrated strong abilities in opendomain question answering, information extraction, and text generation. Agricultural applications, however, are domain-specific, region-dependent, time-…
Show HN: Apex-1-flash, 4B LLM finetuned on RTX 5070 (huggingface.co via hn) The goal was to create a highly efficient, small-scale model that can perform reasoning tasks while remaining lightweight enough to run easily on consumer hardware. Technical Stack: Base: Qwen3:4B Training: Fine-tuned using Unsloth for mem…
Show HN: Selora – local model for Home Assistant (github.com via hn) Selora AI Local is an open-source, Qwen-based model for Home Assistant. Specs: Qwen3 1.7B base model (Q6 quantized~1.6GB) Four Home Assistant-specific LoRA adapters: - Answers - Clarifications - Automations - Commands ~3.5 GB total downloa…
Show HN: FlashQwen – A from-scratch CUDA inference engine for Qwen3 (github.com via hn) We read every piece of feedback, and take your input very seriously. To see all available qualifiers, see our documentation.
Code Correctness Signals in LLM Hidden States: Pre-Generation Probing and Repair Geometry (arxiv.org) Large language models encode rich information in their hidden states. This work asks whether code correctness is legible in the hidden states of Qwen3-4B-Instruct-2507, before it generates and as it repairs a failed attempt, studied on 444…
Local LLM good for OCR of handwriting? (www.reddit.com via reddit) I am using qwen3-vl:8b and ollama for doing OCR on scans of handwritten letters and it is doing a decent job. Any other models I should know about for this kind of OCR?