#qwen

A short follow-up to my previous post, where I showed that changing the scaffold around the same 9B Qwen model moved benchmark performance from 19.11% to 45.56%: https://www.reddit.com/r/LocalLLaMA/s/JMHuAGj1LV After feedback from people h…

↯ Qwen 3.6qwen

My pre-gemma 4 setup was as follows: Llama-swap, open-webui, and Claude code router on 2 RTX 3090s + 1 P40 (My third 3090 died, RIP) and 128gb of system memory Qwen 3.5 4B for semantic routing to the following models, with n_cpu_moe where…

↯ Llama↯ Gemma↯ Qwen 3.5gemmallamaqwen+1

They are waiting for the exact roadmap

qwen

Gemma 4 and Qwen 3.6 with q8_0 and q4_0 KV cache: KL divergence results 4 models tested with q8_0 and q4_0 KV cache against full-precision baseline What this measures KV cache quantization stores the key-value cache in lower precision to s…

↯ Gemma↯ Qwen 3.6gemmaqwen

Qwen Studio offers comprehensive functionality spanning chatbot, image and video understanding, image generation, document processing, web search integration, tool utilization, and artifacts.

↯ Qwen 3.6qwenagentic

MacBook Pro M5 MAX 64GB. Qwen 3.6 35B - 72 TPS.

↯ Qwen 3.6qwen

My personal test for small local LLM intelligence is to check whether a model has any ability to understand the code that I write for my own academic research. My research is on some pretty niche topics and I doubt that anything like it is…

↯ Qwen 3.6qwen

↯ Qwen 3.6qwencursoropus+2

I spent some time yesterday after work trying out the new qwen3.6-35b-a3b model, and at least for me it's the first time that I actually felt that a local model wasn't more of a pain to use than it was worth. I've been using LLMs in my per…

↯ Qwen 3.6qwenopus

other companies are slowly going away from open weight, not releasing base models, delaying open weight distribution, not releasing top models (this one I think is fair, but still), and I also noticed they stopped publishing research (old…

↯ Glm↯ Minimax↯ Gemma↯ Qwen 3.5minimaxglmgemma+2

moedeepseekqwen+1

Qwen3.8-2.4T-A95B [!Note] This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format. These artifacts are compatible with vLLM, SGLang, TokenSpeed, etc.

↯ Vllmvllmqwen

WARNING: wait before download from HF: I just realised my upload of the new versions with the additional fix in the chat template has not completed yet. I will remove this warning once done The recent PR to llama.cpp bring MTP support to Q…

↯ Llama↯ Qwen 3.6llamaqwenopenai+2

Man, AI agents getting pretty crazy these days. :) (local, I just decided to try to get an orchestrator in there, when Qwen and Gemma aren't up to it.)

↯ Gemmagemmaqwen

could not extract summary

qwen

I was trying to do an easy task automatically with qwen-code using qwen3.5-122b I can totally do it myself, but I wanted to try, so maybe it could just do it entirely for me? But no, because it refused.

↯ Qwen 3.5qwen

Time and time again I find posts about these fine tunes that promise increased intelligence and reasoning with base models, and I continuously try them, realize they're botched, and delete them shortly after. I sometimes do resort to a low…

↯ Llama↯ Claude 4.6llamaqwenopus

Gemma just crushed Qwen in a local LLM gamedev contest! Device: MacBook Pro M5 Max, 64GB RAM Qwen 3.6 27B: 32 tokens/sec · 18m 04s · 33,946 tokens.

↯ Gemma↯ Qwen 3.6gemmaqwen

Looks like Apple has quietly killed off the higher-memory Mac Studio options. The M3 Ultra Mac Studio is now only available with 96GB RAM.

qwen

TL;DR best setup I tested on a RTX 3090 24 GB: ik_llama.cpp + Qwen3.6-27B-MTP-IQ4_KS.gguf 156k context, q8_0/q8_0 KV, MTP, vision on CPU benchmark result on a ~5.9k prompt + 1k output: about 1261 tok/s prefill, 72.9 tok/s decode llama.cpp…

↯ Llama↯ Vllm↯ Qwen 3.6vllmllamaqwen

This past week, two state-of-the-art (SOTA) foundation models were launched: Moonshot Labs' Kimi K3[1] and Alibaba's Qwen 3.8[2]. Both are allegedly close to Anthropic's Fable 5 in performance, and both will have their model weights releas…

↯ Qwen 3.8qwenanthropic

The hype is real! https://qwen.ai/blog?id=qwen3.7

↯ Qwen 3.7qwen

For real tho, 9b, 27b, 122b, I don’t really care at this point, just show us that you still love us. EDIT: I guess I gotta use /s on my posts from now on.

↯ Qwen 3.7qwen

I love following all your adventures with local LLM setups. Quality and size of the models are important, but so is performance.

↯ Qwen 3.6qwen

Evaluated Qwen 3.6 27B across BF16, Q4_K_M, and Q8_0 GGUF quant variants with llama-cpp-python using Neo AI Engineer. Benchmarks used: HumanEval: code generation HellaSwag: commonsense reasoning BFCL: function calling Total samples: HumanE…

↯ Llama↯ Function Calling↯ Qwen 3.6humanevalfunction-callingllama+1

The following is a non-comprehensive test I came up with to test the quality difference (a.k.a degradation) between different quantizations of Qwen 3.6 27B. I want to figure out what's the best quant to run on my 16 GB VRAM setup.

↯ Qwen 3.6qwen

I built hfviewer.com, a small tool for visually exploring Hugging Face model architectures. You can paste a Hugging Face URL and get an interactive visualization of the architecture, which can make it easier to understand how different mod…

↯ Gemma↯ Qwen 3.6gemmaqwen

I had previously posted here about a fix to their 3.5 template to help resolve the KV cache invalidation issue from their template. A lot of you found it useful.

↯ Qwen 3.6qwen

Available Models Model Compression This section provides transparency about the compression state of each model available on our platform. We host a variety of open-source models from the community.

↯ Qwen 3.8qwen

Here's my article with 38 quant pairs thoroughly benchmarked in KLD with 3 different Qwen 3.6 27B configs: Q5_K_S + 64k context, IQ4_XS + 64k context, IQ4_XS + 128k context. This allows us to track not only how cache quantizations affects…

↯ Llama↯ Qwen 3.6llamaqwen

I keep hearing the argument that that large models are better for high-level planning and task orchestration, since they have more general knowledge to work from when making decisions. However, I've been testing Qwen 3.6 27b (Unsloth Q5_K_…

↯ Sonnet 4.6qwensonnetclaude-code

↯ Opus 4.7qwenopus

GLM 5.1 is dominant in almost every aspect in Design arena, surpassing Opus 4.6 in many tasks. Although user experiences vary dependent on subscription plans for both of those one of them is open source.

↯ Glm↯ Gemma↯ Qwen 3.6glmgemmaqwen+1

I have a personal eval harness: A repo with around 30k lines of code that has 37 intentional issues for LLMs to debug and address through an agentic setup (I use OpenCode) A subset of the harness also has the LLM extract key information fr…

↯ Gemma↯ Qwen 3.6gemmaqwenagentic

I have ThinkPad T14 Gen 5 (8840U, Radeon 780M, 64GB DDR5 5600 MT/s ). Tried out the recent Qwen MoE release, and pp/tg speed is good (on vulkan) (250+pp, 20 tg): ~/dev/llama.cpp master* ❯ ./build-vulkan/bin/llama-bench \ -hf AesSedai/Qwen3…

↯ Llama↯ Qwen 3.6moellamaqwen

Saw this post comparing Qwen 3.6 variants on coding primitives, so I wanted to see how local quants stack up against frontier models on a similar dense, single-file coding task. I ran the exact same prompt across local and web-based models…

↯ Qwen 3.6qwen

Introducing FlashQLA: high-performance linear attention kernels built on TileLang. 2–3× forward speedup.

qwenagentic

Hey r/LocalLLaMA, We’ve released our ByteShape Qwen 3.6 35B GGUF quantizations in two families: standard NTP (Next Token Prediction or non-MTP) and MTP. Blog / Download NTP Models / Download MTP Models TL;DR For NTP, “pick the largest quan…

↯ Qwen 3.6mmluqwen

The dense sibling of the 35B-A3B drop is here, Qwen3.6 27B Uncensored Aggressive is out! Aggressive = no refusals; NO personality changes/alterations or any of that, it is the ORIGINAL release of Qwen just completely uncensored https://hug…

↯ Qwen 3.6qwen

A follow-up to Reasoning prefills on a few open models and Stolen Thoughts This v1.1 reruns the reasoning-prefill experiment with GPT-5.5 Pro as the teacher. For each problem, I generated two responses from each target model: - an ordinary…

↯ Qwen 3.8gpt-5qwen

Model Description Q-Judger is a vision-language model fine-tuned specifically for automated evaluation of text-to-image generated images. Given a text prompt and a generated image, the model evaluates the image on fine-grained quality crit…

↯ Qwen 3.6↯ Qwen 3.6↯ Qwen 3.6↯ Qwen 3.6↯ Qwen 3.6↯ Qwen 3.6↯ Qwen 3.6↯ Qwen 3.6qwen

Mods please be kind. This was not “low effort”.

qwen

TL;DR Results from the title are for single inference with 2 prompt of 1k and 15k tokens. So no MTP (as it’s slower for big prompt), no DFlash (working too but slower for big prompt), no quant used (full precision wanted) and the results a…

↯ Vllm↯ Qwen 3.6vllmqwenagentic+1

Heya guys and gals, Around a year ago I released and posted about Persona Engine as a fun side project, trying to get the whole ASR -> LLM -> TTS pipeline going fully locally while having a realtime avatar that is lip-synced (think VTuber)…

↯ Qwen 3↯ Qwen 3qwen

could not extract summary

↯ Qwen 3.7qwen

GPT-5.5: xhigh: 94.0→97.5 high: 93.6→96.9 medium: 92.0→95.0 no reasoning: 32.8→37.5 Kimi K2.6 improves over Kimi K2.5 (78.3→91.4) and becomes the #1 open weights model. DeepSeek V4 Pro improves over DeepSeek V3.2 (50.2→75.7).

↯ DeepSeek 3.2gpt-5deepseekqwen+2

- Claude Opus 4.6 - absolute rogue AI. Does what I want like it’s breaking at least 3 internal policies to make it happen.

↯ Sonnet 4.6gpt-5qwensonnet+2

BeeLlama v0.2.0 is here! Not quite a pegasus, but close enough.

↯ Gemma↯ Qwen 3.6gemmaqwen

Found that you can actually run a 35B Qwen model on a Pi with very impressive intelligence and stability. Built connectors for car ODB to read all about car internals, and manufacturer's cloud service for stuff like changing AC or opening/…

qwen

Swiftlet Run 35B and 80B Qwen models on ordinary Apple devices, including iPhones. Swiftlet is a Swift + Metal runtime for the Qwen3-Next and Qwen3.5/3.6 MoE hybrid model family.

moeqwen

Note: First is Qwen3.5 35B MoE (Left) and Second is Qwen3.6 (Right) Hi Guys Just did quick comparison of Qwen3.6 35B MoE against Qwen 3.5 35B MoE. with reasoning off using llama.cpp and same quant unsloth 4 K_XL GGUF First is Qwen3.5 outco…

↯ Llama↯ Qwen 3.6moellamaqwen

↯ Qwen 3.6qwen

So i have been seeing more of those pelican on a bike svg tests and while they work i feel like (and maybe you guys do too) they are getting kinda benchmaxxed so we should switch things up soon and this is my idea generate me a html svg of…

↯ Glm↯ Minimax↯ MiniMax 2.7minimaxglmdeepseek+3

Hardware: RTX 3060 12GB 32GB DDR4-3200 Windows CUDA 13.x Model: Qwen3.6-35B-A3B-MTP-IQ4_XS.gguf The model is a 35B MoE, so -ncmoe matters a lot. Lower -ncmoe means more MoE blocks stay on GPU.

↯ Llama↯ Qwen 3.6moellamaqwen

Been using this for a few days. It is BY FAR the best uncensored model I have found for Qwen 3.6 35B.

↯ Qwen 3.6qwen

Using 100k context with 3090 with MTP GGUF and getting 50 t/s on llama.cpp Thought I would knowledge share Use https://huggingface.co/RDson/Qwen3.6-27B-MTP-Q4_K_M-GGUF And am17an commit /media/adam/D_DRIVE/LLM/llama-cpp-am17an/build/bin/ll…

↯ Llama↯ Qwen 3.6llamaqwen

I am waiting for 122B and new 27B

qwen

Hello guys, So TL;DR, I was asked by multiple people to make an Assistant_Pepe_32B version, but the best base model contender was Qwen3-32B, a model that is very hard to tune on anything other than STEM. The concept of Assistant_Pepe is an…

↯ Qwen 3qwen

I have a 5090, so my VRAM is limited to 32GB, but i find that Qwen3.5-27B-UD-Q5_K_XL with opencode (and mmproj) does a pretty good job for my use case (mainly web development). i use claude and codex here and there, recently a lot less, be…

↯ Qwen 3.5qwencodex

https://preview.redd.it/42ak5qmus82h1.png?width=1133&format=png&auto=webp&s=744ea3dfc06c83d0c4d8aa128c39b3238b17d7be Qwen 3.7 Max sitting at 5th, pretty much on par with GPT 5.4 (xhigh) and a notch above the just released Gemini 3.5 Flash.…

↯ Gemini 3.5qwengemini

I'm still hoping we see a Qwen3.6-122B or a Qwen3.6-coder, but my hopes are dimming. Seems like we would have seen/heard something by now, even if just tantalizing hints from the Qwen folks.

↯ Qwen 3.6qwen

Just a little reminder that *if* it is possible for you to run bigger quants, do it. I ran Qwen 3.6 IQ4_XS at 128k context was very much disappointed because it would loop, make formatting errors, implement wrong things etc.

↯ Qwen 3.6qwenagentic

Maybe it be helpful for someone: llama-server -m '/Qwen3.6-27B/Qwen3.6-27B-IQ4_XS.gguf' -ngl 999 -ctk q4_0 -ctv q4_0 -b 128 -ub 128 -c 24000 Cant run this model with higher kv quants on >8192ctx size. -ub & -b setted for 256 allowed me for…

↯ Llama↯ Qwen 3.6llamaqwen

I'm keeping a close eye on the development of local llms.

↯ Qwen 3.6qwenopusclaude-code

↯ Gemma↯ Qwen 3.5gemmaqwenagentic+1

Just swapped Qwen 3.5 for the 3.6 variant (FP8, RTX 6000 Pro) using the same recommended generation settings. My stack is vLLM (v0.19.0) + Open WebUI (v0.8.12) in a RAG setup where the model has access to several document retrieval tools.

↯ Vllm↯ Qwen 3.6vllmragqwen

----START HUMAN TEXT---- Hi all, I've seen a bunch of posts about squeezing 27B onto a 24GB card and all the quantization tricks involved in doing so. It's all amazing work, but at the end of the day a quantized model with quantized KV wil…

↯ Qwen 3.6qwenagentic

I've been running structured output prompts through a bunch of models on OpenRouter for the past few months — Llama 3, Mistral, Command R, DeepSeek, Qwen, and every other model on OpenRouter — alongside the usual closed-source suspects. 28…

↯ Llama↯ Mistralmistraldeepseekllama+1

Typing this on a cramped flight, but I was having issues connecting to the plane's wifi on my ubuntu laptop, when it was effortless on my phone. The issue I was having was the Laptop WiFi connected to the plane wifi network, but captive po…

↯ Qwen 3.6qwen

I'm sure everyone has seen the posts from people talking about Qwen 3.5 over-thinking, or maybe you've experienced it yourself. Considering we're like 2 months out from the release and I still see people talk about this issue, I decided it…

↯ Gemma↯ Qwen 3.5gemmaqwengemini

↯ Qwen 3.5aiderqwen

Basically, I use To Good 2 Go a lot, get random food, take a photo and ask Qwen 3.5 128B what the fuck to cook. Beyond pasta and pizza, I have zero cooking skills.

↯ Qwen 3.5qwen

I ran the 62-item politicalcompass.org test 30 times each on sixteen models: OpenAI's GPT-5.x and GPT-4o, Claude, Gemini, Grok, Llama, Mistral, and China's DeepSeek, Qwen, Kimi and GLM. Fifteen land in the libertarian-left quadrant.

↯ Glm↯ Llama↯ Mistral↯ GPT 5mistralglmgrok+6

We ran open-weight 27B–32B models on Terminal-Bench 2.0 (89 tasks, terminal-bench-2.git @ 69671fb) through our agent harness. Best result was Qwen 3.6-27B at 38.2% (34/89) under the default per-task timeout — the same constraint the public…

↯ Qwen 3.6moeqwen

I’m thinking about where this might wind up in 3-5+ years. As others have noted there’s no guarantee that Qwen, Google, and others will continue to release models in the future.

qwen

https://huggingface.co/bartowski/FINAL-Bench_Darwin-36B-Opus-GGUF Darwin-36B-Opus is a 36-billion-parameter mixture-of-experts (MoE) language model produced by the Darwin V7 evolutionary breeding engine from two publicly available parents:…

↯ Claude 4.6moeqwenopus

https://preview.redd.it/fxkx8wyzqrwg1.png?width=1152&format=png&auto=webp&s=e141f0f1c5f680ab602115d06dc4621e46309983 Qwen-27b now this!

qwen

This spring is really hot since the localLLM giant, both Qwen and Gemma released major models. I'm really excited with those release and happy with their capability.

↯ Gemmagemmamoeqwen

Hi everyone, I'm presenting a new quantization of the Qwen-27B model, created specifically with 16GB VRAM NVIDIA GPUs in mind. I used quants that, unfortunately, are not yet available in the main upstream llama.cpp.

↯ Llama↯ Qwen 3.6llamaqwen

I recently published MTP quants of Qwen 3.6 27B and I was suprised by the reports here on reddit, and on HF, of users who were experiencing worst speed with speculative inference than without. This did not match what I was seeing, but when…

↯ Qwen 3.6qwen

Hey everyone, I’ve been building a local-first desktop PDF reader that can read technical books aloud and keep the spoken text highlighted while reading. The original motivation was pretty practical: I read a lot of programming and technic…

↯ Llamallamaqwen

I think gave it a fair shot over the past few weeks, forcing myself to use local models for non-work tech asks. I use Claude Code at my job so that's what I'm comparing to.

↯ Gemma↯ Gemma 4gemmaqwenagentic+1

Have Qwen hinted at whether other models (9B, 122B, 397B) would be getting the 3.6 treatment? Or have they in any way confirmed or hinted at "this is it"?

↯ Qwen 3.6qwen

TL;DR New llama.cpp fork! I wanted a Windows-friendly inference to run Qwen 3.6 27B Q5 on a single RTX 3090 with speculative decoding, high context without excess quantization, and vision enabled.

↯ Llama↯ Qwen 3.6llamaqwen

Greetings from former TurboQuant's biggest defender, now middle-sized niche-aware TurboQuant defender. Today I'm presenting to you the results of me thoroughly exploring the world of PPL and KLD benchmarks with my single RTX 3090 using Bee…

↯ Vllm↯ Qwen 3.6vllmqwen

As the title suggests. I'm already testing (with some success, and few challenges) usage of Qwen-3.5 9B with a new work laptop that I've received with RTX 1000 6GB VRAM (I know it seems like a joke in today's time and age).

↯ Gemini 2.5qwengemini

Not affiliated with Kaitchup, but a fan of their testing. I was looking forward to this article...

↯ Gemma↯ Qwen 3.6gemmaqwen

Does anyone else have the same experience comparing these two - for me 3.5 122B outperforms 3.6 by a large margin. 3.6 gets lost as long as the task requires a couple of more steps.

↯ Qwen 3.6qwen

Hugging face link here. Ive been waiting for sokann to drop his Qwen 3.6 GGUF for 16 GB GPUs as his Qwen 3.5 was my GGUF of choice.

↯ Qwen 3.6qwen

So in response to the Great Token Reconning of 2026, I decided to try out Qwen 3.6 as a daily driver, and although it's only been about a day, I have to say I'm thoroughly impressed. I had to download the VSCode insiders edition and set up…

↯ Copilot↯ Gemma↯ Qwen 3.6gemmacopilotqwen

↯ Gemma↯ Qwen 3.6gemmamoeqwen

Qwen3.8-Max Copied! Try AIAdd to Compare ReasoningVisual UnderstandingText Generation Overview ReasoningVisual UnderstandingText Generation 2.4-trillion-parameter MoE flagship delivering a comprehensive leap in coding and professional work.

↯ Qwen 3.8↯ Qwen 3.8moeqwen

I dont have good experience running q4_k_m, the difference to q6 is "a few errors an hour" to " a few errors every couple of days". Edit: How it fails?

↯ Qwen 3.6qwenagentic

My workflow has changed basically to ask Codex to do certain tasks and then document how to do them (including errors it found on its way) into a skill. I feed that skill to pi, and suddenly my qwen3.6 gets that hard stuff done: - devops o…

↯ Qwen 3.6qwenchatgptcodex

Qwen 3.6 27b vs Codex GPT 5.5 / Claude Opus 4.7 My local llm discovered a bug that they both missed And it turns out it's critical GPT 5.5 and Claude both stood their ground and didn't give up until the end - they claimed to be right all a…

↯ Qwen 3.6qwencodexopus

This is a follow up to the previous benchmark and tensor analysis of abliteration techniques across the Qwen model family. Same approach, same toolkit, new model family.

↯ Glm↯ GLM 4.7mixture-of-expertsglmqwen

↯ Qwen 3.6qwen

Hi guys, Back again. I have tested the Qwen 3.6 UD 2 K_XL Unsloth model on the same paper to web app task.

↯ Llama↯ Qwen 3.6llamaqwen

I'm not sure if the AesSedai's Q5_K_M version of Minimax M2.7 is too much lobotomized or if the model itself is kind of weak. I did a simple experiment with both models running with the recommended parameters.

↯ Minimax↯ Qwen 3.5minimaxqwen

One way I like to test new models, is by one-shoting (with a good prompt) a single webpage clone of the classic arcade game pacman. I usually do 3 attempts and keep the best one.

↯ Glm↯ Qwen 3.6glmqwenchatgpt+2

33B A3B MoE, Apache 2 licensed. Reported agentic results put it about level with Qwen 3.5 35B A3B, behind the 3.6 version.

↯ Qwen 3.5moeqwenagentic

I have run two tests on each LLM with OpenCode to check their basic readiness and convenience: - Create IndexNow CLI in Golang (Easy Task) and - Create Migration Map for a website following SiteStructure Strategy. (Complex Task) Tested Qwe…

↯ Glm↯ Gemma↯ Qwen 3.6glmgemmaqwen

This is my first test with this model and Qwen impressed me. I will rate it 98% usable web os compared to my previous best 70% usable result from qwen3 next coder at q2.

↯ Llama↯ Qwen 3.6llamaqwen

And I'm here to share my experience. The answer is resoundingly 'yes'.

↯ Qwen 3.6qwen

Well or pretty close to it, they are excellent work horses. I run them in real work scenarios doing some of the work I used to do myself as an skilled expert in my field, billing 200$ an hour.

↯ Mistral↯ Gemma↯ Qwen 3.6mistralgemmaqwen

I run Qwen-3.6 27B FP8 on vllm for long-horizon agentic coding harness workloads with high context window and concurrent sub-agents. On two 3090s that aren’t used for anything else, it seems reasonable to expect a good balance between spee…

↯ Vllm↯ Qwen 3.6vllmqwenagentic

Took TheTom's TurboQuant Metal fork of llama.cpp (github.com/TheTom/llama-cpp-turboquant, the feature/turboquant-kv-cache branch) and ran a depth sweep on Qwen 3.6-35B-A3B Q8. TheTom had already published M5 Max numbers up to 32K.

↯ Llama↯ Qwen 3.6llamaqwen

ive been seeing a recurring claim that open (weight) models 6 months behind the frontier are good enough for the majority of ‘work’. if you've had a concrete task in the last month where GLM/DeepSeek/Kimi/Qwen failed and Opus/Fable/GPT suc…

↯ Glmglmdeepseekqwen+1

The “Trash Can” Mac Pro, once the most expensive machine you could buy from Apple, mine was just shy of £10,000 in 2016 — that’s £14k in today’s money. Until recently mine was just running as a kubernetes single node development platform,…

↯ Llama↯ Qwen 3.5llamaqwen

I feel like i'm going insane. I see people here posting 30 - 100+ tok/s (100+ being with speculative decoding) on a 3090 with Qwen 3.6 27B.

↯ Llama↯ Sonnet 4.6llamaqwensonnet

Qwen 3.6 dropped yesterday and I wanted to see if hybrid offloading actually earns its keep on this hardware. My box is two RTX 5060 Ti (32GB VRAM total) with 64GB system RAM.

↯ Llama↯ Qwen 3.6moellamaqwen

What are some ways that you would go about thinking about choosing between the two for use in a harness like pi? Did a good bit with q4 yesterday and it was so consistent and reliable I had it set to 131k context and it worked through 2 co…

↯ Qwen 3.6qwen

Qwen3.8-27B [!Note] This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format. These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, TokenSpeed,…

↯ Vllm↯ Qwen 3.8vllmqwen

https://preview.redd.it/8gpkg8zxmy1h1.png?width=1672&format=png&auto=webp&s=a95db16a39cdc49c0ff155117b734d413a49c2d3 https://youtu.be/MI0Pm1d6YF4 MTP can accelerate LLM inference 2x, especially for coding agents. This video covers what MTP…

↯ Qwen 3.6qwen

According to this. I run several more tests to cover more models and quants.

↯ Qwen 3.6qwen

Past few days, its all been about MTPs. Somehow people missed out the fact that Z lab released the Dflash for Gemma4 26B a couple of days ago.

↯ Vllm↯ Gemma↯ Qwen 3.6vllmgemmaqwen

I wanted to share an open-source app that I built for running LLMs locally on my setup. My setup Hardware FEVM FAEX1 (128GB) RTX Pro 5000 Blackwell (48GB), connected over OCuLink Aoostar AG02 2x2TB internal m.2 drives on raid-0 using mdadm.

↯ Llama↯ Qwen 3.6llamaqwen

Have Qwen 3.6 27B and Qwen 3.6 35B basically made most of the older ~30B models irrelevant? They seem to beat stuff like Qwen coder 30B, GPT OSS 20B, Gemma models, especially for coding and agent workflows.

↯ Gemma↯ Qwen 3.6gemmaqwen

For developers using Qwen 27B for coding, Codex style: what's your honest take? So far, for me, it's been pretty solid.

↯ GPT 5.5gpt-5qwencodex

With practically all of LocalLlama glazing Qwen 3.5/3.6 for it's coding skills. Along with the fact that Alibaba themselves are focusing on making Qwen a reliable coding agent, does this rule out the chance for a new Qwen Coder?

↯ Qwen 3.5qwen

I must say Iam kinda torn what to think about those models. At one hand they "ace" some questions on other sometime they behave genuinely weird.

↯ DeepSeek 4deepseekqwen

https://huggingface.co/mradermacher/Qwen3.5-35B-A3B-Base-GGUF Yes, Qwen 3.6 is out and it's a great model. However, who needs an even more "uncensored but official" model, can try out this one.

↯ Qwen 3.6qwen

Just wondering how are people's experience with both these models! I've had some nice results with Qwen but Gemma4 runs so much faster here.

↯ Llama↯ Qwen 3.6llamaqwen

Some people say they’d never go under Q8, and others say they find Q3 acceptable! What’s your take?

↯ Gemmagemmaqwen

In my opinion, MTP models are 100% game changer for local LLMs. In terms of speed, I was getting around 1.5x the tok/sec of previous tests.

↯ Llama↯ Qwen 3.6llamaqwen

I know the new Qwen 27B is amazing right now for coding in general, but since 122b is supposed to be coming as well, it’s expected to be better I guess ? I am actually surprised at how this dense model performs I haven’t used Codex at all…

qwencodex

↯ Llama↯ Qwen 3.6clinellamaqwen+1

A year ago I would just read about 397B league of models. Today I can run it on my laptop.

↯ Gemma↯ Qwen 3.5gemmaqwen

MultiNet 2.0 Preview: Interactive 2D Mazes Frontier Reasoning Agents fail on Interactive 2D Mazes We put 3 highly capable models in 50 simple 2-dimensional mazes each. Claude Opus 4.8, Kimi K2.6, and Qwen 3.6-27B together solved just 6 out…

↯ Qwen 3.6qwenopus

A few weeks ago, after finishing FastDMS, I started toying around writing some RDNA3 kernels again to see how fast I could get Qwen 3.6 MoE running. It turned out well enough, so over the past couple weeks, I turned those experiments into…

↯ Llama↯ Qwen 3.6moellamaqwen

When Qwen3.6-35B-A3B was released a week or so ago, I sort of expected an iterative improvement on the previous Qwen3.5 models. After all, those models were pretty decent as compared with the previous local models I had tried, and Qwen3.5…

↯ Gemma↯ Qwen 3.6gemmaqwen

Hi, I'm trying to run Qwen 3.6-35B on my RTX 3090 (24 GB of VRAM) but I'm not sure about 2 thing: - Which variant of the model to use ? (Q4_K_S, Q3_K_XL, other ?

↯ Llama↯ Qwen 3.6llamaqwenagentic

Been vibe coding a lot recently and kept running into the same problem finding actually usable tools without paying for 10 different subscriptions or donating my bank balance to Claude. So I put together a curated list focused on free or l…

↯ Ollama↯ Llamaollamallamarag+3

Hello, I've been on a quest to get something "close enough" of Opus 4.5 running locally, for agentic coding, as SWE with 15 years of experience. I tried with one spark (yeah I'm calling my Asus Ascent GX10 sparks - they're the same), with…

↯ Minimax↯ Qwen 3.5minimaxqwenopus+1

JetBrains has announced Junie Local, a way to run local models on your machine without having to deal with the manual complexity that comes with installing and running local models. Junie, if you don't know, is an LLM-agnostic AI coding ag…

↯ Qwen 3.6qwen

Qwen Studio offers comprehensive functionality spanning chatbot, image and video understanding, image generation, document processing, web search integration, tool utilization, and artifacts.

qwen

I am currently running 2x RTX 5060 ti and happened across some good sales for additional ones coinciding with a really good sale of a highend Z890 motherboard (replacing my B860 board) that could support quad GPUs (with 2 M.2 adapters, end…

↯ Qwen 3.6qwen

Are y'all using the preserve thinking flag or do you have it off? If so, why?

↯ Qwen 3.6qwen

Previously it was throwing a 'Not Implemented' error due to Mamba layers. Going to test it now!

↯ Vllm↯ Qwen 3.5vllmqwen

Followup to yesterday's post: https://www.reddit.com/r/LocalLLaMA/comments/1sy7srk/. Comments asked for perplexity, KL divergence, asymmetric K/V combos, and a 64K data point.

↯ Qwen 3.6qwen

I'd jump on runpod and ssh in to test my workloads, but they don't have it. Would love to know how well this runs, particularly as context approaches a full 256K.

↯ Qwen 3.6qwen

I am trying to optimize Qwen 3.6 35B A3B sampling parameters but I am having a hard time figuring out a good benchmark to do it. As to why I believe that the recommended settings may not be optimal?

↯ Qwen 3.6qwen

https://preview.redd.it/dfqed57qgsvg1.png?width=1706&format=png&auto=webp&s=3859209698d2e844e2731326e355d60928658f8a The most fun part was reasoning, here is a gist: https://gist.github.com/anzax/5f06716c66180013cd715f6c2e5848df There is a…

↯ Qwen 3.6qwenagentic

↯ Haiku↯ Glm↯ Minimaxminimaxhaikuglm+6

https://preview.redd.it/u8062juegq3h1.png?width=1919&format=png&auto=webp&s=a213f6929c6cad58e92bc1681dac9f0545b04d13 Overview: As the market for consumer computing parts becomes more scarce due to the AI boom, finding ways to use lower-end…

↯ Qwen 3.5↯ Qwen 3.5↯ Qwen 3.5↯ Qwen 3.5qwen

I removed mmproj file from models to remove vision and save my vram. But just curious, is this really don't affect its text ability?

↯ Qwen 3.6qwenagentic

Llama.cpp recently introduced support for Programmatic Dependent Launch (PDL), which is a new feature in Nvidia GPUs (CC >= 90, not including ADA) such as Blackwell. (See PR 22522.) In short, PDL enables more efficient execution of kernels…

↯ Llama↯ Qwen 3.6llamaqwen

I'm the founder behind Hedy, an AI meeting app. I'm a huge supporter of Local AI, and we've been working on making it "consumer friendly".

↯ Llama↯ Gemma↯ Qwen 3.6gemmallamaqwen

↯ Ollamaollamaopenclawrag+1

Hey all, Looking for some real-world advice on GPU choices for running the new dense models — mainly Qwen 3.5 27B and Gemma 4 31B. What I’m targeting Context: 64K+ (ideally higher later) Speed: 30+ tok/s @ tg128 minimum Power: not critical…

↯ Gemma↯ Qwen 3.5gemmamoeqwen

TL;DR: Web search open router that routes agent web search across providers (Exa, Parallel, Tavily, Brave, SerpAPI etc.), and traces web search results with quality metrics, so you can visualize whether a bad agent run is a web search prob…

↯ GPT 5.5↯ GPT 5.5↯ GPT 5.5↯ GPT 5.5↯ GPT 5.5↯ GPT 5.5↯ GPT 5.5deepseekqwen

Qwen Studio offers comprehensive functionality spanning chatbot, image and video understanding, image generation, document processing, web search integration, tool utilization, and artifacts.

↯ Cowork↯ Qwen 3.8↯ Qwen 3.8coworkqwen

Used the vllm version of https://github.com/noonghunna/club-3090 It worked fine for myabe 20 40k context, havent tried the new one. Anyone used the new llama.cpp patched one for single 3090?

↯ Llama↯ Vllm↯ Qwen 3.6↯ Qwen 3.6↯ Qwen 3.6↯ Qwen 3.6↯ Qwen 3.6↯ Qwen 3.6↯ Qwen 3.6↯ Qwen 3.6vllmllamaqwen

https://preview.redd.it/74cj1xu9pw0h1.png?width=1229&format=png&auto=webp&s=3ae999cc3530ecb4eccf70e25f1a9eb2aa3f2d7b Sometimes qwen 3.6 just stops at the middle of a task, is there a way to avoid it? This is qwen-code CLI, but also happens…

↯ Vllm↯ Qwen 3.6vllmqwenopenai

I’ve been using Qwen 3.6 27B and it’s amazing. Not exactly your Opus replacement, but great for small tasks and checking work.

↯ Qwen 3.6deepseekqwenopus

I think it would suit my needs perfectly, but I'm scared of getting scammed on Alibaba so looking for some sellers who have delivered. Follow-up question for those who have the card, how well does it run Qwen 3.6 27B?

↯ Qwen 3.6qwen

It's been a busy week testing and trying to get the 27B model set up correctly. TL;DR: The only setup that worked for my dual 3090s was this one.

↯ Gpt 4↯ Qwen 3.6gpt-4qwen

I wanted to figure out which of the newer small and mid-size models are actually worth running on a single H100, so I put 8 of them through a proper vLLM benchmark and recorded what came out. The setup was simple.

↯ Vllm↯ Gemma↯ Qwen 3.6vllmgemmaqwen

↯ Gemma↯ Qwen 3.6gemmaqwen

ByteDance and Alibaba to disable humanlike AI custom agents as new rules loom With Beijing’s rules on humanlike AI interaction services taking effect on July 15, Doubao and Qwen move to disable customised features Both apps had offered a p…

qwen

could not extract summary

↯ Opus 4.8qwenopus

So I've been using qwen 3.6 27b for monthly closes, bank recs, payable and receivables. Built a simple sql lite database it manages.

↯ Qwen 3.6qwen

I extracted embedding vectors for nvidia/Nemotron-Personas dataset. It's an incredible resource consisting of millions of synthetic personas with detailed backgrounds (names, ages, occupations, hobbies, and more), but finding specific pers…

qwen

If you look at the cosine sim between the embeddings of "a 500 hp car", "a 1,200 hp car" and "a 73 hp car", you'll soon see that embedding models have no sense of number ordering at all. (I tested Qwen and ModernBERT-based embeddings) It m…

↯ Fine Tuningfine-tuningqwen

Hello, I'm currently using Ollama / lm studio for things like code inference and proof reading emails, etc. Definitely not experienced in this space but looking to grow.

↯ Ollama↯ Llama↯ Vllm↯ Gemma↯ Gemma 4vllmollamagemma+3

Yesterday, I saw an impressive presentation of Qwen 3.6 27B's SVG capabilities on the sub. To maximize the model's capabilities in terms of SVG generation, I put together a closed-loop harness with the help of Claude and Codex, and plugged…

↯ Qwen 3.6qwencodex

could not extract summary

qwen

https://preview.redd.it/o1uxb57u47yg1.png?width=862&format=png&auto=webp&s=d38204fe6ccd0d8326dcd98a534e9a226d213f99 How trustworthy are Artificial Analysis intelligence index? so according to them Qwen 3.6 27B is better than bigger MoE mod…

↯ Qwen 3.6moeqwen

Try to go with searXNG as you search results by multiple engines + its open-sourced. Use firecrawl / jina / fetch for reading the source.

qwen

I'm running Qwen/Qwen3.6-27B-FP8 via vLLM using this command: vllm serve Qwen/Qwen3.6-27B-FP8 --tensor-parallel-size 4 --gpu-memory-utilization 0.95 --max-num-seqs 8 \ --enable-auto-tool-choice --tool-call-parser qwen3_xml \ --enable-prefi…

↯ Vllm↯ Qwen 3.6vllmqwenclaude-code

Hi, here you can find experimental llama.cpp support for DeepSeek v4, and here there is the GGUF you can use to run the inference with "just" (lol) 128GB of RAM. The model, even quantized at 2 bit, looks very solid in my limited testing, a…

↯ Llama↯ DeepSeek 4deepseekllamaqwen

The new dense model is great, but I’m trying to figure out how to increase PP and Token generation speed. I’m running Q8 quants across 3 7900xtx GPUs and I’m consistently only getting 18-20 t/s generation speed and ~650 t/s prompt processi…

↯ Llama↯ Qwen 3.6llamaqwen

could not extract summary

↯ Qwen 3.6qwen

I have been benchmarking local LLMs on a Mac M4 Pro 24 GB RAM using LM Studio. I've tested mostly with 4-bit quantization, both MLX and GGUF, from 4b to 35b models, with speeds of 3 to 40 tokens/second.

↯ Gemma↯ Qwen 3.6gemmaragqwen

Qwen Studio offers comprehensive functionality spanning chatbot, image and video understanding, image generation, document processing, web search integration, tool utilization, and artifacts.

qwen

I picked up a 7900 XTX earlier which runs qwen3.6-27b fine, but not to my like. Its compute performance is quite unstable for me.

↯ Qwen 3.6qwen

As per the title Such as Gemma 4 31B Q4 K S vs Gemma 4 26B A4B Q8 Or Qwen 3.6 27B Q4 K M vs Qwen 3.6 35B A3B Q6 K Etc At what point is it worth switching? My use case is mostly creative writing.

↯ Gemma↯ Qwen 3.6gemmaqwen

Someone suggested I give Continue (Vscode extension) a try. I've been using Roo / Zoo now and liking it but it is pretty tough on context and I was told continue has more control over it.

↯ Llama↯ Qwen 3.6continue-devmoellama+1

Watched All About AI's 100% local Fireship-style video automation experiment over the weekend (link in comments). A few things worth flagging if you're trying the same stack.

↯ Gemma↯ Qwen 3.6gemmaqwen

TL;DR: Qwen 3.6 35B-A3B (Q4_K_M) is running slow at around 9 t/s with 72% filled context (36147 tokens window) and a total response time of 77s including prefill and token generation. Ran this using LM Studio on Windows with the attached i…

↯ Qwen 3.6qwen

WebWorld is a large-scale open-web world model series for training and evaluating web agents. It is trained on 1M+ real-world web interaction trajectories via a scalable hierarchical data pipeline, supporting: Long-horizon simulation (30+…

↯ Qwen 3↯ Qwen 3gpt-5qwen

With every new model release there's the "better than Opus 6.13" guys vs the "this is so bad, why did they even release it" camp and I'm always wondering which one is using it wrong. So I did a little test with 2 related prompts, 3 models…

↯ Gemmagemmaqwenopus

I’m looking for a tool or calculator that can estimate the minimum hardware needed to run a specific model locally. For example, I want to know the cheapest setup that can realistically run Qwen 3.6 27B at decent speeds.

↯ Qwen 3.6qwen

Hi there. Not native English speaker.

↯ Qwen 3.6qwen

I struggle to wrap my head around all this. My goal is local agent to solve low complexity tasks, in the same harness where I would use frontier models.

↯ Llama↯ Qwen 3.6llamaqwen

Which of these do you think we'll get in May? Also, feel free to pick/rank which ones you'd want the most badly: more Gemma4 models (124b?) (other sizes?) more Qwen3.6 models (9b?

↯ Glm↯ Minimax↯ Mistral↯ DeepSeek 4mistralminimaxglm+2

I kept getting 401 'token expired' errors on my existing Qwen session. Attempting to resume it after quitting, I got: qwen resume [API Error: 401 invalid access token or token expired] [API Error: 401 invalid access token or token expired]…

qwen

Here is my experience, I've been using LM Studio with RTX 5080 and 64GB RAM using Windows 11. I'm very happy with LM Studio except the speed.

↯ Llama↯ Gemma↯ Gemma 4gemmallamaqwen

Hi everybody, we post-trained Qwen 3.8 27B to be more efficient by figuring out which tokens were linked to overthinking and penalizing them without "attacking" the reasoning length directly then fixed the accuracy with a bit of secret sau…

↯ Qwen 3.8qwenopenai

📄 Production-Grade SLM-Powered OCR Course 📄 Build a self-scaling, event-driven OCR pipeline on Kubernetes (AKS / GKE) with Qwen 3.5 + the GLM-OCR SDK Table of Contents Table of Contents Course Overview Who is this course for? Course Breakd…

↯ Glm↯ Vllmvllmglmqwen

Hi guys. I have been working on Hitoku Draft, an open-source, voice-first AI assistant that runs entirely locally.

↯ Gemma↯ Qwen 3.5gemmaqwen

https://www.bloomberg.com/news/articles/2026-05-26/china-expands-travel-curbs-to-top-ai-talent-at-private-firms Now it will be much harder to poach Chinese AI talents like the former Qwen head Junyang Lin. It is quite sad that they will al…

qwen

I've been using lm studio for a few months. I want to try hermes agents with Qwen 3.6 MoE, so I'm switching to llama.cpp and I don't understand well how the server slots -np and the context size -c interact.

↯ Llama↯ Qwen 3.6moellamaqwen

Got a chance to play around with 2x RTX PRO 6000 setup so sharing some number for Qwen 3.6. All these were run using latest stable VLLM backend.

↯ Vllm↯ Qwen 3.6vllmqwen

Qwen 3.6 27B Q8 on four Nvidia RTX A4000 (16GB each) with Llama.cpp and MTP enabled My setup is heterogenous, I originally acquired my server (Lenovo ThinkStation P3 Tower Gen 2) to run OpenShift/K8s clusters (because I work on that), and…

↯ Llama↯ Qwen 3.6llamaqwen

We've got great outputs for 27B via club 3090, but what about those of us who love the blazing speed of 35B on dual 3090s? I was getting 1500 p/p and 120 t/g with split layers, but MTP slowed it down to 80 t/g when I tested last week.

↯ Llama↯ Qwen 3.6llamaqwen

could not extract summary

↯ GPT 5.4gpt-5qwen

hey yall. So I have a 24GB gpu.

↯ Qwen 3.6qwen

I got Qwen 3.6 35B-A3B and Gemma 4 26B-A4B running on a $200 secondhand machine (i7-6700 / GTX 1080 / 32 GB RAM) using llama.cpp (the TurboQuant/RotorQuant KV cache quantisation allows 128k context within the 8 GB VRAM). Results (Q4_K_M mo…

↯ Llama↯ Gemma↯ Qwen 3.6gemmamoellama+1

I'm using OpenWebUI and and making tools/skills to improve my models functionality. I am currently using Qwen 3.6 35B A3B Q8 (F16) 256k I grabbed `parallel tools` to be able to run multiple tool calls at once..

↯ Qwen 3.6qwen

could not extract summary

qwen

I read this sub every day and I keep seeing benchmarks and discussions focused almost entirely on tokens/s generation speed. Prompt processing speed barely gets mentioned.

qwen

I’m not a coder, but I run local models. I gave in to agent hype (I was building my own, but there is so much to do) and installed Hermes.

qwen

A new anonymous model debuts at #8 in the Artificial Analysis Text to Image Arena! Peanut’s weights are expected to be released soon, which would make it the leading Text to Image Open Weights Model.

qwen

I am quite curious as I tried Gemma 4 31B, Qwen 3.6 27B, GLM 4.7 30B and some others in my native language (czech). Gemma performs "best" and considering the fact its "just" 18GB model - it actually blows my mind how well it can respond in…

↯ Glm↯ Gemma↯ Qwen 3.6glmgemmaqwen

True story, I got interested in AI after seeing it at work and wanted to run models locally. I started with an M3 Ultra 96GB, quickly learned it was not enough for what I wanted, and kept upgrading hardware (including refurbished Mac Studi…

↯ Minimax↯ Gemma↯ DeepSeek 4minimaxgemmadeepseek+1

Source: https://docs.tenstorrent.com/systems/quietbox/quietbox-bh-2/specifications.html Currently supported models: https://tenstorrent.com/developers From the specification docs above: CPU: Ryzen 7 9700X 65W Granite Ridge 3.8GHz Memory: 2…

↯ Minimax↯ Qwen 3.6minimaxqwen

I gave some math problems to Qwen 3.5 27B and Qwen 3.6 27B and they got all of them right, pretty smart models I would say, but very slow and electricity consuming, they took like 5 mins with my GPU at 120 W to solve a problem. The MoE mod…

↯ Llama↯ Qwen 3.6moellamaqwen

Canonical on 23 October 2025 Install a well-known model like DeepSeek R1 or Qwen 2.5 VL with a single command, and get the silicon-optimized AI engine automatically. London, October 23 – Canonical today announced optimized inference snaps,…

↯ Qwen 2.5deepseekqwen

Did some quick tests after building llama.cpp with ROCm 6.4.2 and latest Vulkan for my 6900 XT gemma4 E2B Q4_K ubatch ROCm pp512 Vulkan pp512 ROCm tg128 Vulkan tg128 32 1536.60 1423.49 151.92 174.59 64 1590.65 1930.60 151.41 173.76 128 265…

↯ Llama↯ Gemma↯ Qwen 3.5gemmallamaqwen

↯ Gemma↯ Qwen 3.5gemmaqwenagentic

What would you choose if you were in my shoes? How viable is 125k for agentic coding really?

↯ Qwen 3.6qwenagentic

Hello guys, wanted to share this: https://github.com/albond/DGX_Spark_Qwen3.5-122B-A10B-AR-INT4 I am running it on my DGX Spark Int4 V2 with Max context window - and getting 50tok/sec with Multi Token Prediction: Its working great for tool…

↯ Qwen 3.5qwen

Adaptive KV Streaming for llama.cpp This branch adds an experimental, block-granular KV cache streaming path to the CUDA llama-server. It is intended for running long contexts when model weights leave too little VRAM for the complete KV ca…

↯ Llama↯ Qwen 3.8llamaqwen

If your laptop has 16GB of RAM, your agent can write SQL locally for free with Qwen3.8 27B. On the DABstep SQL benchmark, Qwen beat GPT 5.6 Luna and cost under 50 cents in electricity, over 17x less.

↯ Qwen 3.8qwenagentic

I had to develop a course related to quantum chemistry and unfortunately, Claude just kept writing it in its own very annoying claude-speak. It actually cost our team a lot of time and tokens to wrestle it to just speak like a normal human.

qwen

ModelScope——汇聚各领域先进的机器学习模型，提供模型探索体验、推理、训练、部署和应用的一站式服务。在这里，共建模型开源社区，发现、学习、定制和分享心仪的模型。

↯ Qwen 3.8qwen

could not extract summary

↯ Qwen 3.8qwen

Qwen-MM-Plugins English · 中文 Native multimodal plugins for Qwen models. Make any agent harness multimodal-native.

qwen

Selora AI Local is an open-source, Qwen-based model for Home Assistant. Specs: Qwen3 1.7B base model (Q6 quantized~1.6GB) Four Home Assistant-specific LoRA adapters: - Answers - Clarifications - Automations - Commands ~3.5 GB total downloa…

↯ Llama↯ Qwen 3llamaqwen

Fun local LLM comparisons with Gemma, Granite, and Qwen Ekorbia v0.2 features a comparison-chat mode that runs 2-3 local models against the same prompt in parallel. Here are a few fun prompts running across Gemma 4 (e2b), IBM Granite 4.1 (…

↯ Gemma↯ Gemma 4↯ Gemma 4↯ Gemma 4↯ Gemma 4↯ Gemma 4↯ Gemma 4gemmaqwen

I know this sub loves absurd LLM projects, so sharing my contribution while we wait for the new Qwen 3.7 models to drop! I successfully got a tiny LLM running inside an RTOS, running inside a custom-built JavaScript emulator for the Freesc…

↯ Qwen 3.7qwen

This benchmark uses head-to-head comparisons of stories written in response to the same constrained creative briefs. The target range is 600-800 words.

↯ Mistral↯ Qwen 3.7mistralgrokqwen

So I have a side project with given scope: Fully air-gapped / on-prem - no internet, no outbound calls of any kind Engineers ask questions about Splunk data in natural language Has to hold the conversation in Korean (index/field names stay…

↯ Gemma 4openclawqwenopenai

Hi, (TLDR.): Qwen in its MTP version has tool call bugs and outputs everything into tool/thinking blocks - mangeling the output - canceling the +speed with repeated wrong tool calls! DCSS works well with non MTP qwen even on smaller qwants.

↯ Qwen 3.6qwencodex

https://preview.redd.it/i90oxxk7n03h1.png?width=1898&format=png&auto=webp&s=7d219c804fda7dfe122b84fcdb6d0d6883818c68 A while back I came across TradingAgents — a really cool multi-agent LLM stock analysis framework where like a dozen "agen…

↯ Ollama↯ Glm↯ Minimaxminimaxglmollama+4

I’m running Hermes Agent on a single NVIDIA DGX Spark using vLLM with: docker run --gpus all \ --name qwen36-aggressive \ --restart unless-stopped \ -p 8000:8000 \ --ipc=host \ --ulimit memlock=-1 \ --ulimit stack=67108864 \ --shm-size=32g…

↯ Vllm↯ Qwen 3.6vllmqwenopenai

Qwen @Alibaba_Qwen Qwen3.7 Preview lands on Arena ！ Here come Qwen3.7-Max-Preview & Qwen3.7-Plus-Preview. Alibaba now #6 lab in Text, #5 in Vision.

↯ Qwen 3.7qwen

I'm running the 122-billion Qwen 3.5, specifically Qwen3.5-122B-A10B-Q5_K_M, on DGX Spark (128 GB contiguous memory). I'm (very!) impressed with the general knowledge output.

↯ Llama↯ Qwen 3.5llamaqwen

Okay so i've been stalking this sub for some time and i run the occasional small 2-8b model on my laptop (not the best) for fun but say my role at a company is to set up a local LLM since we obviously don't want confidential data going to…

↯ Gemma↯ Qwen 3.6gemmaragqwen

Disclosure first: I work on community at MiroMind. One of our researchers just dropped the full MOOSE-Star collection on Hugging Face — a 7B model post-trained for scientific hypothesis discovery, plus the dataset behind it.

deepseekqwen

How is this dual setup's performance? Is it difficult to set-up everything with for example llama.cpp?

↯ Llama↯ Qwen 3.6llamaqwen

Just a quick note that I got a nice result using am17an's MTP branch of llama.cpp on v100 32GB SXM module using one of those pcie card adapters. Pulled and built in one shot, and llama-server ran without a hitch.

↯ Copilot↯ Llama↯ Qwen 3.6copilotllamaqwen

The benchmark uses adversarial, multi-turn debates across 683 curated motions. Each model pair debates the same motion twice with sides swapped.

↯ Glm↯ Mistral↯ DeepSeek 4mistralglmgrok+4

Mistral Medium 3.5 128B with 4x3080 20GB with layer split: CUDA_VISIBLE_DEVICES=0,1,2,3 ./build/bin/llama-bench --model /data/huggingface/Mistral-Medium-3.5-GGUF/Mistral-Medium-3.5-128B-IQ4_XS-00001-of-00003. gguf -ngl 99 -d 0,16384 -fa 1…

↯ Llama↯ Mistral↯ Qwen 3.5mistralllamaqwen

Hello everyone. Over the last couple months I have been assembling my local AI setup for personal use, and I thought to write a post here, firstly to collect some thoughts on the whole concept, and secondly to perhaps gather some feedback.

↯ Llama↯ Qwen 3.6llamaqwen

Open Design The open-source alternative to [Claude Design][cd]. Local-first, web-deployable, BYOK at every layer — 11 coding-agent CLIs auto-detected on your PATH (Claude Code, Codex, Cursor Agent, Gemini CLI, OpenCode, Qwen, GitHub Copilo…

qwengeminicursor+2

I’ve tried a few suggested solutions but nothing has worked so far. Is claude trained to respond in a particular way that qwen doesn’t know about?

qwenclaude-code

I’ve been working on an educational implementation repo for speculative decoding: https://github.com/shreyansh26/Speculative-Decoding The goal is not to wrap existing libraries, but to implement several speculative decoding methods from sc…

↯ Qwen 2.5↯ Qwen 2.5qwen

I'm sure people have asked before for settings for these gpu's, but for me, no matter what I do, It doesn't work as good as 3.6 35B! I've tried VLLM and LLAMACPP .

↯ Vllm↯ Qwen 3.6vllmqwen

I’m trying to understand the current open-source LLM landscape beyond surface-level hype. We all got used to the nerfed products of Claude/Geminj so I believe really in opensource as a solution.

↯ Glm↯ Minimax↯ Mistralmistralminimaxglm+2

Advertisement Alibaba’s Qwen family captures over 50% of global open-source downloads, report finds Qwen hits nearly 1 billion cumulative downloads, far surpassing rivals like Meta Platforms’ Llama and DeepSeek, researchers say 2-MIN READ2…

↯ Llamadeepseekllamaqwen

Hi HN! A few friends and I built EarthToPixels, a project that turns real-world cities into explorable pixel-art maps.

qwen

could not extract summary

deepseekqwen

I've built a new method for steering LLMs called Semantic Overlays, small trained adapters on a frozen model which change how it perceives a piece of its context. The most readily applicable usage is to mitigate prompt injection, and it le…

↯ Security↯ Qwen 3.5prompt-injectionqwensecurity

WASD move · Space jump / swim up · Shift sprint · Mouse look F fly (Space/Shift up/down) · Q/E fly speed Left click break · Right click place stone · Esc release mouse NPC load test: N spawn · C clear · I/U count ×2 ÷2 · [ ] spacing The bl…

↯ Qwen 3.8qwen

Qwen 3.8 27B was one of the most highly-anticipated open-weights releases that I've seen in a long time, and like many others, I immediately got to work testing it out and playing with it when it dropped. I'm running it on a single Lenovo…

↯ Qwen 3.8qwen

A year after OpenAI's gpt-oss, Qwen 3.8 27B is the first local model I'd let write code in an agent harness — fast enough to use live, small enough to self-host, and seemingly twice as capable as last year's open weights on the same hardwa…

↯ Qwen 3.8qwenopenai

I gave frontier LLMs a canvas and told them to draw a self-portrait. August 4, 2026 Here are the self-portraits for Fable 5, GPT 5.6 Sol, Kimi K3, and Qwen 3.8 Max - out of order.

↯ Qwen 3.8qwen

Around 3 months ago, we were thinking why none of the iPhone apps running an LLM are built as a full harness (as in inference + agentic loop + context management + tools + MCP servers and etc.). It became more interesting when we noticed e…

↯ Qwen 3.5qwenmcpagentic

BrowserMesh — Multi-Session Browser MCP Runtime BrowserMesh is a local, open-source browser runtime for external AI clients. It lets Claude Code, Codex, Cursor, Qwen, and other MCP-compatible clients control multiple isolated browser sessi…

qwencursorcodex+2

Apple briefly published a support guide in China explaining how Mac users can connect Alibaba's Qwen AI to Siri and Writing Tools, before pulling it entirely less than a day later. Reuters first spotted the Chinese-language guide on Apple'…

qwen

could not extract summary

qwen

We tested Qwen3.6 27B quantizations by Unsloth on Hugging Face, with pelicans on bikes, gears, Terminal-Bench 2.1, and AIME-120.

↯ Qwen 3.6qwen

I am noticing that for our fintech use case, well-written tools on self-hosted models are working just as well as frontier models. But people keep talking about round count and effective token utilization.

qwen

Open models behind one OpenAI-compatible endpoint. No account yet?

↯ Llama↯ Gemmagemmallamaqwen+1

AI Agent Comparison I ran a little exercise to give the following 5 AI Agents the same prompt and see how they would fare, in my opinion, in completing the task: - ChatGPT: GPT-5.5 from OpenAI - Qwen: Qwen 3.7-plus from Alibaba Cloud via A…

gpt-5qwenchatgpt+1

I recently decided to try out local AI again on my 64GB MacBook Pro, running it against real projects instead of quick demos. So when a Hacker News thread argued that Qwen 27B is good enough, I wanted to check that against the size of task…

qwen

Relay An open-source, dark-mode desktop coding agent — built for people who want to use non-mainstream LLM providers, not just the big three. Relay is an Electron app that puts DeepSeek, Qwen, GLM, Kimi, MiniMax, and other open/Chinese mod…

↯ Glm↯ Minimaxminimaxglmdeepseek+1

Local index & search for your AI coding-agent threads — across 11 tools (Claude Code, Codex, Cursor, Gemini CLI, Qwen Code, Goose, OpenCode, Continue, Cline, Roo Code, Kilo Code) — plus a provider-agnostic chat, an MCP server, a CLI, and a…

clineqwengemini+4

Local Qwen isn't a worse Opus, it's a different tool We've all heard people say that local Qwen 27B or 35-A3B is "near-Opus level", but I have receipts from a software business and open source projects, and am here to be transparent with y…

qwenopus

Qwen3.7 Plus Intelligence, Performance & Price Analysis Model summary Intelligence Speed Input PriceUpdated USD per 1M tokens Cache: $0.08 (-80%) Output Price Verbosity Qwen3.7 Plus is amongst the leading models in intelligence, but somewh…

qwen

Qwen vs. Proust: Injecting entire novels into a local model's prompt before you ask I wrote this; not a bot.

qwen

Just released a blog on a side research project I have been doing for the past two months and would love for you all to check out and see how it is! It's about output length-constrained summarization using LLMs with GRPO.

↯ Vllmvllmqwen

based on the work of open-dllm - (which achieved qwen 2.5 autoregressive -> diffusion realignment head - same exact model under the hood delivering a 4x in improvement.) TLDR I haven't got a trained model yet. just a burnt out gpu cable an…

↯ Qwen 3.6qwen

I seen this one mentioned but it was a source from about 14 months ago. In the age of the Qwen 3.6 and Gemma 4- is there still a use for QwQ 32B?

↯ Gemma↯ Qwen 3.6gemmaqwen

Hi, I am building a server so that my dual rtx 3090 setup runs at full speed. - asrock romed8 t2 revision 1.3 - epyc 7642 - ddr4 128 gb 3200 or 256 gb 2133 (256 gb is a bit cheaper) 8 channel - dual rtx 3090 - gigabyte psu 1600 w What do y…

↯ Qwen 3.5moeqwen

I've fine-tuned Qwen 3.5 0.8B on the dataset provided by Pangram with their EditLens paper. It's available via a Chrome extension; you can just click selected text and it's going to give you the probability distribution of how likely it is…

↯ Llama↯ Fine Tuning↯ Gemmagemmafine-tuningllama+1

everyone is talking about q 4 q 5 and q 6, but. i got some coding that i feel like lower quants kept getting wrong.

qwen

I've burned a week trying to customize my agent manually - building my own front end - but I've gotten to the point where I'm just exhausted and willing to try a harness, but need the right one. I read posts all the time, but I have a spec…

↯ Llama↯ Qwen 3.6llamaqwen

I'm still in my learning process and so far I've been able to make satisfying use of my setup (4070 with 12GB VRAM + 32GB RAM and iGPU for my GUI). I've been able to run both Gemma4 26B and Qwen 3.6 35B MoEs up to high quants with large co…

↯ Llama↯ Qwen 3.6llamaqwen

I have mac at work that I want to use local model for prototyping and basic prompts that needs to stay on device. What sort of model I can run that I can fit at least 64k context ?

qwen

I have a framework desktop 128GB and a 3080 12GB running qwen 7b I want to move to a proper server rack + switch but not sure how to move from desktop PC to server rack. Any advice on what GPU/Server to get under 5k?

qwen

Hi all. As some may have been aware, Hugging Face's model search had issues recently.

↯ Qwen 3.6qwen

Qwen Studio offers comprehensive functionality spanning chatbot, image and video understanding, image generation, document processing, web search integration, tool utilization, and artifacts.

↯ Qwen 3.7qwen

Started this as a personal project for my Open-WebUI setup to use. Somehow it ended up as an ACL 2026 paper.

↯ Qwen 3↯ Qwen 3qwen

I'd love to hear from developers who use big context windows if they notice a difference? Obviously I would love to cut the KV cache VRAM requirement in half, but I'm worried about quality especially when we enter into 50k+ context territo…

↯ Llama↯ Qwen 3.6moellamaqwen

Implemented Multi-Token Prediction for QWEN on LLaMA.cpp with TurboQuant. +40% performance!

↯ Llama↯ Qwen 3.6llamaqwen

i ran Qwen 3.6 35b A3B two 5060TI 16gb ( 32 gb vram also i have 32gb dram but i don't like offloading ) i used Q4 on LM Studio to get full context and i get 90t/s any tricks to optimze this more to upgrade to Q6 or Q8 ? thanks !

↯ Qwen 3.6qwen

Between a solid model from Qwen or Gemma 4, when translating a text, does "thinking mode" significantly boost the quality of the translation, or is the difference negligible?

↯ Gemma↯ Gemma 4gemmaqwen

I would like to dedicate a budget of about 500 euros to upgrade my workstation and run inference on the qwen 3.6 27b and gemma 4 31b models. I currently have an RTX 5060Ti 16GB.

↯ Copilot↯ Llama↯ Vllm↯ Gemma↯ Qwen 3.6vllmgemmacopilot+2

I've tried with FLUX.2-9B but was not really better and FLUX.2-dev is too big. Any (tested) suggestions are most welcome.

qwen

Just thought I'd share this use case. I was setting up a miniPC as a home theatre with Archlinux (It's the OS I'm most familiar with).

↯ Qwen 3.6qwen

Looking for suggestions. Current setup llama.cpp and ran qwen 3.5 397b 256k context.

↯ Llama↯ Qwen 3.6llamaqwen

DELIGHT – self-hosted AI engineering autopilot: local LLM + browser farm + repo graph + P2P compute TL;DR: Built a local "OS for AI agents" that scans your entire repo into a live graph (Worm), routes tasks between local Qwen, headless Cha…

↯ Qwen 3.5qwenchatgpt

Can llama.cpp run MTP for this model?

↯ Llama↯ Qwen 3.5llamaqwen

Long time ago (actually only a year ago), DeepSeek released a few open source model, such as deepseek-r1-distill-qwen (https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B). I am wondering if anyone in the community is brave eno…

↯ DeepSeek 4deepseekqwen

I have been following the akitaonrails coding benchmark which tests against a fixed rails + Rubyllm + docker task rather than vendor-reported evals. April 2026 update put K2.6 at 87 sitting in tier A (80+), ahead of Qwen 3.6 plus (71), Dee…

↯ Glm↯ DeepSeek 4glmdeepseekqwen+1

I have a GPU server (4 × RTX3090s) that I've been using for research and PoC in the past 2 years. Mostly running vLLM for Qwen, GPT-OSS, and Gemma.

↯ Vllm↯ Gemmavllmgemmaqwen

Tested 10 image generation models on M1 Max 64GB for photorealism, text rendering, and cultural accuracy (Japanese/Asian content). Key findings: Qwen-Image Lightning (8-step distillation) beats the full model in quality while being 9x fast…

qwengemini

I've been developing a self-modifying Al agent system that effectively cut my Codex/Claude Code API usage in half, Codex makes a plan and then I basically just copy/paste Codex instructions for the agents to work on. Come back in 6 hours a…

↯ Qwen 3.5qwencodexagentic+1

So i am using this model in tax accounting. Have a shitty Ryzen 9 7940HS (8C/16T), 60 GB RAM, Radeon 780M iGPU, 1 TB Kingston NVMe, Win 11 Pro.

↯ Qwen 3.6qwen

Bench 3 from my 18GB M3 Pro. Bench 2 was the 4B-class post where the comments were mostly right: I gave thinking models a fixed 1024-token cap, Qwen got kneecapped, Gemma E4B needed clearer active-param labeling, and the headline was partl…

↯ Ollama↯ Gemma↯ Qwen 3.5ollamagemmamoe+1

Hey y'all! I've recently written a text in Russian about my experience comparing Qwen-3.6-27B with lower tier cloud models on hard tasks -- I wanted to share the translation of the post, since I found the results interesting and surprising.

↯ Qwen 3.6qwen

I want to test this model out but I don't have a setup that can do it locally. openrouter and all my coding plans don't include it.

↯ Qwen 3.6qwen

At this moment, the models such as Qwen 3.6 35b/27b crush the competition, yet I can't help, but notice this pattern. While the local RP scene is abundant with the Western model tunes: LLaMA, Mistral (all sizes), Nemo and more recently Gem…

↯ Llama↯ Mistral↯ Gemma↯ Qwen 3.6mistralgemmallama+1

Hello Guys, Each time a new local llm is released, there are a ton of new posts , this is it, it's near Opus level...., the abliteration matrix final something at Q2 KXLDND is the best but it's been a day that deepseek was released and i d…

↯ DeepSeek 4deepseekqwenopus

Hey guys, I built a custom vLLM pipeline to run Gemma 4 (31B FP8) and Qwen 3.5 side-by-side locally to see how they actually perform in the wild with preprocessing of audio and images. But of course new model Qwen 3.6 27B came out just whe…

↯ Vllm↯ Gemma↯ Qwen 3.6vllmgemmaqwen

Hi guys, I’ve been running side-by-side experiments on Gemma 4 (31B FP8) and Qwen 3.5 Vision for the last few days using vLLM in Docker to see how they actually handle real-world images and video. A few things I found out: 1.

↯ Vllm↯ Gemma↯ Qwen 3.5vllmgemmaqwen

↯ Gemmagemmaqwen

↯ Qwen 3.6qwen

↯ Gemma↯ Qwen 3.6gemmaqwengemini+1

I've been using and learning about using all kinds of models for the last few years and I've read a lot of papers. I've even done finetuning and made loras, so I feel stupid asking this question, but here goes.

↯ Qwen 3.5qwen

I cannot find a definive answer. I think the following should be able to do FIM: Qwen 2.5 coder Qwen 3 coder Qwen 3-2507 instruct Qwen 3.5 Qwen 3.6 What I verified: Qwen3-32B: no Qwen3-4B-Instruct-2507: yes Qwen3.5-27B: yes Qwen3.6-35B-A3B…

↯ Llamallamaqwen

Has anyone been able to solve or mitigate context checkpoints being erased during single user inference, specifically when function calling is part of the chat history? I've been using Qwen 3.5 35B A3B for some time (now using 3.6), tested…

↯ Llama↯ Function Calling↯ Qwen 3.6function-callingllamaqwen

zappa: an AI powered mitmproxy Soon, AI will be good enough to interact with the Internet in an indistinguishable way from a human. This can be an amazing opportunity for liberation from all the people who are targeting your attention.

qwen

Colleagues, I have a question: does anyone have a locally developed solution for summarizing text? Which qwant qwen 3.5 27b would be able to summarize an entire chapter of medical literature, about 25-30 A4 pages, without hallucinations?

↯ Qwen 3.5qwen

Hi, my current system hardware RTX 3090 24GB VRAM & Sysrem RAM 64GB using windows 11 been playing around with hermes agent and local llm (Qwopus3.5-27B-v3-GGUF & gemma-4-26B-A4B-it-GGUF) when i try asking the hermes agent to do a task with…

↯ Llama↯ Gemma↯ Gemma 4gemmallamaqwen

I bought this 7900XTX for 905 euro in Spain, and wondering if can I combine them together to run Qwen 3.5 27B for example ? Using a MSI B650 Gaming Plus Wifi and 64gb DDR5 6400mt/s

↯ Llama↯ Qwen 3.5llamaqwen

Audio Flamingo Next (AF-Next) — three variants: AF-Next-Instruct: audio Q&A AF-Next-Think: multi-step reasoning with temporal CoT AF-Next-Captioner: audio description generation Architecture: → AF-Whisper audio encoder → Qwen-2.5-7B LLM ba…

↯ Gemini 2.5qwengemini

A high-volume feed of new AI releases — models, open-source repos, developer tools, papers, datasets, and benchmarks — refreshed every 8 hours. Each release is explained in plain English so you actually understand what shipped.

↯ Qwen 3.5qwen

I'm getting ready to do a training run on qwen 3.5 27b and it will be the first time I've ever done LoRA. to complicate things I've tried to make my own custom dataset using q&a pairs.

↯ Qwen 3.5qwen

ShapeLearn-Lite Held Up. ShapeLearn Did Better: Qwen 3.8 27B We were a little impatient.

↯ Qwen 3.8qwen

Qwen Studio offers comprehensive functionality spanning chatbot, image and video understanding, image generation, document processing, web search integration, tool utilization, and artifacts.

↯ Qwen 3.8qwen

Use Desktop Open the app, configure it, and start talking. Keep the orb nearby or open the panel for text and attachments.

qwen

Qwen3.8 Flash Next is now supported in DwarfStar, covering 64GB Mac systems very well and with very fast inference of 50~70 t/s and > 1400 t/s prefill. For now this is Metal only.

↯ Qwen 3.8qwen

SwarmLLM Every device brings a slice. Together they run the whole model.

↯ Qwen 3.8qwen

A lot of my non-developer friends still think that AI is basically just Google or something you ask to write something and then copy paste it around... if they use it at all.

↯ Coworkcoworkqwen

What reverse engineering and modernising an old war game tells us about the economic impact of the transformer Some observations from my War of the Lance (1989) Code Harness assisted modernisation (WIP) I gave Qwen-3.8-Flash-Next a job: Re…

↯ Qwen 3.8qwen

We present Qwen-Drive-1.0, an initial step towards a vision-language foundation model for autonomous driving. Qwen-Drive-1.0 retains the architecture of the pretrained vision-language model (VLM) and integrates 3D perception, visual questi…

qwen

This paper introduces layer-scoped expert-budget expansion, a training-free, runtime-only routing modification for sparse Mixture-of-Experts (MoE) language models. By expanding the expert selection budget ($N \ge K$) exclusively within lat…

moeqwen

Image Editing LeaderboardArtificial Analysis MAI-Image-2.6-Preview, Qwen-Image-3.0, Qwen-Image-3.0-Pro 1 API Pricing reflects the cost to generate 1,000 images on the model creator's API at 1024x1024 with the model's default settings Frequ…

qwen

How We Optimized the Qwen 3.6 Model for Our Junie Agent A while ago, we launched a long-term project to enable users to run Junie entirely locally, with local inference, across a wide variety of hardware setups. After much anticipation, we…

↯ Qwen 3.6qwen

Tiny Qwen personal-style resampler A deliberately small proof-of-concept for the hypothesis: A pretrained LM already contains the ingredients of a person's writing style; style transfer can be treated partly as selection among semantically…

qwen

Private local inference guide Run Qwen locally on Windows and use it remotely from any device Turn a high-RAM Windows PC into your personal AI server. Use Qwen or any other local LLM from every laptop, desktop, and application you already…

qwen

Rats! source reconstruction with local LLMs This repository is a work-in-progress reconstruction of the source code for RATS.EXE, the original Windows version of Rats!

↯ Qwen 3.8qwen

On a Mac? Get Balto for Mac First launch downloads the inference engine and model.

↯ Qwen 3.8qwen

Qwen3.8-Max + MCP for coding on your local machine, without paying for Qwen Code. Qwen3.8-Max itself runs in the cloud through Qwen Studio — this setup just gives it access to your local files and terminal through MCP.

↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8qwencodexmcp+2

I started thinking over why doesn't fireworks support voice models. There are really good opensource models available now, like parakeet, kokoro, Qwen ASR etc but no way to use it without managing a bunch of GPUs yourself.

↯ Gemma↯ Gemma 4gemmaqwen

MOST POPULAR AI - ai and ml China turns up the heat with open model blitz as US model makers panic For the first time, Alibaba's Qwen team is letting its 'Max' model out of the API pen; meanwhile, DeepSeek V4-Flash gives new meaning to che…

↯ DeepSeek 4deepseekqwen

Qwen3.8 Max is the flagship model in Alibaba's Qwen3.8 series, the general-availability successor to the Qwen3.8 Max Preview. It is a multimodal reasoning model intended for complex reasoning, visual understanding, coding, and agentic work…

↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8qwenagentic

📢Meet Qwen3.8-Max — our most capable model to date. Next week, the open weights of Qwen3.8-Max will be released, and Qwen3.8-27B is also going open-weights to meet you all!🎉 Qwen3.8-Max, a new bar for coding and cowork at 2.4T parameters:…

↯ Cowork↯ Qwen 3.8↯ Qwen 3.8coworkqwen

Mobile GUI Use Optimized for everyday tasks in real-device mobile GUI use, the model navigates changing Android apps, accounts, content, and network conditions to search, compare, schedule, shop, and coordinate reliably. Towards Next-Gener…

qwen

Benchmarking Qwen 3.6 35B MoE (3B active) on an RTX 3090 I mentioned I'd got a second RTX 3090 on a group chat, and a friend said: I know this is not really your thing... but let me know how quickly it runs Qwen 3.6 35bn MoE.

↯ Qwen 3.6moeqwen

Inside Qwen 3.8-Max-Preview: Reverse Engineering an AI Assistant by Interviewing Itself ByManish ShahiSoftware Engineer • AI Developer Table of contents(71) I run manish.sh. I write about AI tools, agents, and how these models actually beh…

qwen

could not extract summary

↯ Qwen 3.6qwen

Qwen Privacy Code Generation Pilot Modern code-generation models can discuss privacy principles, but it is less clear whether they translate those principles into concrete implementation decisions such as backend consent validation, restri…

qwen

Qwen on-device benchmark A small, honest, reproducible benchmark of three Qwen models run 100% on-device (Apple M5 Max, 36 GB, nothing left the machine) on hard math-reasoning problems. The point of this repo is less the leaderboard and mo…

qwen

q36 A hyper-optimized, zero-dependency C/CUDA inference engine for Qwen 3.6 35B on RTX 5090 / Blackwell. A zero-dependency C/CUDA codebase specialized for a single model + GPU pairing — Qwen3.6-35B-A3B (MXFP4 GGUF) on RTX 5090 (sm_120a) —…

qwen

Domain: https://ismy.blog Github:https://github.com/3289david/ismyblog Your blog. Nothing else.

qwen

Running Qwen 3.6 Locally on a Mac Mini M4 with 16GB RAM Two days ago Qwen open-sourced Qwen 3.6-35B-A3B — a 35-billion parameter Mixture of Experts model that only activates 3 billion parameters per token. It's Apache 2.0 licensed, ships w…

↯ Qwen 3.6mixture-of-expertsqwen

Hi I'm Saoud, founder of Cline. We’ve been impressed with GLM-5.2 and so are introducing a $9.99/month subscription to give you 2-5x discounted access to it and other open weight models like DeepSeek, Kimi, MiniMax, Mimo, and Qwen.

↯ Glm↯ Minimax↯ GLM 5.2clineminimaxglm+2

Qwen Studio offers comprehensive functionality spanning chatbot, image and video understanding, image generation, document processing, web search integration, tool utilization, and artifacts.

qwen

1 qwen3-vl-2b-instruct 25.7M/mo 56.7/mo 2.13B 2025-10-19 8mo ago Qwen/Qwen3-VL-2B-Instruct + 2 more variants 2 qwen3-6-35b-a3b 21.6M/mo 2.2K/mo 36.0B 2026-04-15 2mo ago Qwen/Qwen3.6-35B-A3B + 15 more variants 3 qwen3-6-27b 20.3M/mo 2.1K/mo…

↯ Qwen 3.6qwen

I wanted Anthropic's Glasswing on hardware I own, so I built it: Lucent, a near-free bug-hunter running a local 27B Qwen on one RTX 3090. Here is the build, the telemetry, and the two real bugs it surfaced in hermes-agent.

↯ Anthropic Mythos↯ Mythos 5mythosqwenanthropic

Not coding assistants or agents, and not things that obviously would just use the latest frontier model like really hard work. I'm talking about the daily AI features users interact with directly: generating content, rewriting things, reco…

qwengemini

Qwable-v1 Qwen + Fable · An open-weights agentic coding model. 35B Mixture-of-Experts (3B active), built by layering Claude Fable-5 agentic tool-use behavior on top of a Claude Opus 4.7 reasoning distill of Qwen3.6-35B-A3B.

↯ Qwen 3.6qwenopusagentic

The honest, local-first usage meter for AI coding tools. Claude Code, Codex, Kimi, Qwen CLI, HashCortx, HashCerebrum — unified into one clean dashboard with usage based trophies :)

qwencodexclaude-code

RTX 5080 + RTX 3090 Setup: 80+ Tok/s on Qwen 3.6 27B Q8 A year ago, I bought an RTX 5080 for both gaming and AI experiments. Little did I know back then that I would be giving into the joys of local LLM setups.

↯ Qwen 3.6↯ Qwen 3.6qwen

Gemma 4 E4B 6bit is now the local model of my choice and loaded 24/7 on my Mac (using @lmstudio), replacing Qwen3, 3.5 4B after ~9 months of usage What an insane model, congrats @GoogleDeepMind 🤠 The new setup replaces his nine-month daily…

↯ Gemma↯ Gemma 4gemmaqwen

Tried Gemma, Qwen and a few others. Need vision and larger context windows for an application I am working on.

↯ Gemma↯ Gemini 3.1gemmagpt-5qwen+1

Hi folks, I found this setup on consummer hardware that seems to have great results on local hardware. - qwen 3.6 q6 - 450 K context using turboquant turbo3 mode llama.cpp fork - multimodal support This AI generated blog article is a kind…

↯ Llama↯ Qwen 3.6llamaqwen

Hey HN, We believe we have the easiest onboarding from signup to being able to spin up coding agents in slack like Stripe, Ramp & Coinbase. Demo of the onboarding: https://www.tella.tv/video/connecting-cord-to-slack-1-19ep Every signup get…

↯ Glm↯ Minimax↯ Gemma↯ DeepSeek 4↯ DeepSeek 4minimaxglmgemma+5

Do you think GPT/Claude subscriptions are heavily subsidized as part of a land-grab strategy, where the companies are willing to lose money to dominate the market later? Or are the subscriptions actually profitable, and instead the API pri…

deepseekqwenopenai+1

Hi Reddit, I am planning on running Qwen 3.6 27b NVFP4 via vLLM on my 5090 but was wondering if something like 35b a3b at Q8 on Llama would produce better results for agentic coding and utilize the system memory. My research says no but if…

↯ Llama↯ Vllm↯ Qwen 3.6vllmllamaqwen+1

I have 16gigs of ram , 3070 ti 8gb vram rtx and an i7 12th gen. The hype finally caught up to me and I tried open claw , currently i am not subscribed into any ai subscriptions and therefore my setup is completely free.

openclawqwen

What are your experiences with all the different variations of finetunes on small models (<40B) with those popular datasets? My personal experience is mostly with the 'Opus-Reasoning' ones on qwen models, and aside from the output being su…

qwenopus

New models pop up constantly—Qwen 3.7, Gemini 3.5 flash, etc. Every time a better one launches, I want to have a try, but I don't want to increase subscriptions.

↯ Gemini 3.5qwengemini

I've spent the last year building Charm, a native macOS menu bar app that corrects spelling, fixes grammar, and predicts your next word. Three features: - Spells: NSSpellChecker plus a local LLM for context-aware corrections (catches "defi…

↯ Gemma↯ Qwen 2.5gemmaqwen

Hey everyone, For people building agents with LangGraph, CrewAI, AutoGen, OpenAI Agents SDK, Claude MCP/SDK, Google ADK, or LlamaIndex — how are you managing LLM API costs? Agent workflows can get expensive fast because of: tool calls retr…

↯ Llamadeepseekllamarag+5

For me, opencode doing fantastically but was wondering if qwen code would be more native and have better functionality, since idk which agentic harness they used to get their benchmark results

aiderqwenagentic

https://preview.redd.it/jyiiwn2o0f2h1.png?width=962&format=png&auto=webp&s=6a96d2b9fe7bffcc75e8d5865161ec3727d46d58 Link to blog : https://qwen.ai/blog?id=qwen3.7

↯ Swe Bench↯ Qwen 3.7swe-benchqwen

Ill address all the questions here not spam the sub what would be a better set up, 1 pc with 2 3090s and a 5080, but that 3090s will have to run at x4 pci-e slots OR 1 pc with 5080, another pc with the 2 3090s and on x16 split into 2x8 mai…

↯ Qwen 3.6qwen

I built Markdown Viewer because every Markdown app I found was either bloated (VS Code, Obsidian) or too bare-bones. Wanted something that loads instantly, renders Obsidian-style features cleanly, and weighs in at a few megabytes.

qwenclaude-code

I spent some time digging into Claude Code vs OpenCode, mostly from the angle of how they actually work as coding agents. More on the technicalities like: context and memory tool use subagents permissions safety and control study the recen…

↯ Tool Usetool-useqwengemini+2

A mechanistic-interpretability study of Qwen 3.5 Disclaimer. This is a mechanistic-interpretability study of how nation-state-mandated content filtering actually gets built into a deployed LLM's weights.

↯ Qwen 3.5qwen

Does anyone know why qwen 3.6 MTP spec decoding won't work with Tesla P40 when the K cache is quantized? I was able to get mtp qwen 3.6 27B Q5 running at 20t/s on my tesla p40.

↯ Llama↯ Qwen 3.6llamaqwen

Qwen3.6-Plus What's on your mind today? Auto Choose a style to create your first image.

↯ Qwen 3.7qwen

I'll be UPDATING this as it seems I was benchmarking and testing Just before the UPDATE LOL TL;DR If you're running rigid agent frameworks locally with mtp on consumer hardware: drop your draft window to 3, lock parallel slots to 1, and co…

↯ Llama↯ Qwen 3.6llamaqwenagentic

Hey all, While nvfp4 still seems to be a work in progress, the latest version of vllm 0.21 finally has mtp working for gemma. With all the talk of qwen being badass I thought I would revisit gemma.

↯ Vllm↯ Gemma↯ Gemma 4vllmgemmaqwen

In my real-world usage (opencode) and in my synthetic benchmarks, Coder-Next (Q5) demolishes the whole Qwen3.6 family including the 27B Dense model (All Q8). Everybody else is hailing that 27B is superior and is an amazing model, but I hav…

↯ Llama↯ Qwen 3.6llamaqwen

How do you deem qwen 3.5 4B heretic variants for RP finetunes? I have been struggling to get a decent instruct based model, any tips regarding the goal would be really helpful.

↯ Qwen 3.5qwen

Hi All, I'm trying to understand the process of creating GGUF with MTP support. Does the original Qwen/Qwen3.6-27B support MTP?

↯ Qwen 3.6qwen

Here are some results (llama.cpp)! Task 1: write a short poem 27B Dense: 12.5 tokens/s 27B Dense MTP: (spec-draft-n-max 6): 14.5 tokens/s 27B Dense MTP (spec-draft-n-max 3): 18.7 tokens/s Task 2: edit a hello word html artifact 27B Dense:…

↯ Llama↯ Qwen 3.6llamaqwen

I'm running Qwen 35B A3B via llama-server with reasoning budget set to -1 (unlimited) for testing. In every client I've tried, the model just thinks endlessly before responding.

↯ Llamallamaqwen

RLM models and Qwen3.6 Does anyone here have an RLM setup and how could I set it up? I want to make my Hermes agent even more powerful and I don't like that I need to open a new context window every time after just a few prompts.

↯ Qwen 3.6qwencodex

TL;DR: We estimate how often Qwen 3 4B exhibits rare harmful behaviors with 30× fewer rollouts than naive sampling, using a new method that interpolates between the model and a less-safe variant in logit space. Authors: Francisco Pernice (…

↯ Qwen 3qwen

I've been working with Qwen 3.6 27B and 35B-A3B models and pretty happy with them. The point I've reached now is how to split my uses cases.

↯ Qwen 3.6qwen

Hi all I recently started a new job and we're doing python development for a ci cd metadata consolidation library for analytics and we cannot use no stuff like claude code or codex or gh copilot or any model APIs (free or paid). I got a la…

↯ Copilot↯ Ollama↯ Llama↯ Qwen 3.5ollamacopilotllama+3

Hi there! I was playing around with Ollama and LMstudio, testing local models and had the idea of letting Claude evaluate a few models on their actual capabilities rather than doing it myself.

↯ Ollama↯ Qwen 2.5↯ Qwen 2.5↯ Qwen 2.5↯ Qwen 2.5↯ Qwen 2.5↯ Qwen 2.5↯ Qwen 2.5↯ Qwen 2.5ollamaqwenmcp

Hello LocalLLaMA subreddit, i have been running local models for coding tasks and kept hitting the same problems everyone does — the model writes an 800-line file in one shot and half of it is garbage, it spirals in its own reasoning for 4…

qwenagentic

In llamacpp I'm getting 12tok/s, does this number look right to you and what can I do to increase this number (if possible)? cd ~/llama.cpp && ./build/bin/llama-server -m models/qwen-3.6-27b-abliterated-q3.gguf -ngl 999 -c 65536 (i need th…

↯ Llama↯ Qwen 3.6llamaqwen

Interactive reference for transformer models, presented via dataflow graphs, drillable down to elementary mathematical operations. Covers models from GPT-2 to Qwen 3.6, with MLA, MoE, RoPE, MTP, hybrid attention, and other variants togglea…

↯ Qwen 3.6moeqwen

We can all agree that the new Qwen models are truly amazing, and we are blessed to have them. In coding, they are certainly a breakthrough.

↯ Sonnet 4.6qwensonnetanthropic

So I'm brand new to this scene but I'm using Claude to help me fine tune a model for a startup idea I have in the Healthcare space. I have been working with the 27-35B parameter mdoels (Qwen3.6, Gemma 4) and the couple of 120B+ models (Qwe…

↯ Minimax↯ Gemma↯ MiniMax 2.7minimaxgemmaqwen

have have a server running a 4500 blackwell on cuda 13.1 and nvidia/595.58.03 with 48GB mem assigned to it. I have build: dcad77cc3 (8933) with Qwen3.6-27B UD-Q5_K_XL loaded and connected it to Roo code.

↯ Qwen 3.6qwencodex

I remember a year or so ago when DeepSeek R1 came out and it was pretty quickly distilled into Llama 3 8b and Qwen 2.5 (?) 7b. Why don’t we see more distilled models?

↯ Llama↯ Qwen 2.5↯ Qwen 2.5↯ Qwen 2.5deepseekllamaqwen

Autonomous Security Agent A self-contained security agent built with Qwen 2.5-7B running locally via LM Studio on Kali Linux. The agent can autonomously execute security tools, analyze results, and take action through an MCP (Model Context…

↯ Qwen 2.5↯ Qwen 2.5qwenmcp

tl;dr - For software development, Qwen3.6 27B, 5090 gives you ~3x speed over M5 Max, letting you plow through code, while M5 Max gives you ~4x memory, letting you use higher quantization and bigger context. Which would you choose and why?

↯ Qwen 3.6qwenopusagentic

Ant Group doesn't get the coverage it deserves. While the open source AI conversation in the West circles around DeepSeek and Qwen, Ant Group has been quietly building a model family that competes directly with the models everyone is talki…

deepseekqwenagentic

I've been using Qwen 3.6 with the Pi harness, and so far I'm really enjoying the experience. I've noticed Qwen is great at leaving inline comments when writing Typescript (haven't tried other languages).

↯ Qwen 3.6qwen

Judging by what they state, it should be better than Qwen 3.6 27B

↯ Qwen 3.6qwen

Quick follow-up on APEX, the MoE-aware mixed-precision quant strategy. The original post was just about Qwen 3.5 35B-A3B ( https://www.reddit.com/r/LocalLLaMA/comments/1s9vzry/apex_moe_quantized_models_boost_with_33_faster/ ); since then t…

↯ Qwen 3.5moeqwen

So I saw an article recently about exo disaggregated prefill with DGX Spark and M3 Ultra - prefill on one machine and decode on another. DGX Spark apparently has 4x matmul performance over an M3 Ultra - same as the M5 Ultra should have.

↯ Llama↯ Minimaxminimaxllamaqwen

Anyone who knows stuff about fpgas: - What max model size can one be designed for (I've read 20-30m parameters max, is it possible to go for more if quantized - at a resonable price)? - Taalas - is what they're doing with asics more viable…

qwen

I have been trying Mistral 3.5 on my 4x RTX 3090 rig with llama.cpp. Inference is slow (about 11 t/s) even without anything being offloaded to the CPU.

↯ Llama↯ Vllm↯ Mistral↯ Mistral 3.5mistralvllmllama+1

Hi all I m debating purchasing another 7900xtx in addition to the one I'm currently using pushing my vram from 24 to 48. I'm semi satisfied with the new qwen models.

qwen

It is pluggin made for ONLYOFFICE, much simpler than copy-paste from webui. PS.

↯ Gemma↯ Qwen 3.6gemmaqwenopenai

I would like to experiment but before investing loads of money, I do have a MacBook Pro with 32GB RAM, M2 Pro. Which model would maximize versatility given this hardware?

↯ Gemmagemmaopenclawdeepseek+2

I normally seldom experience loops, either reasoning or responses, using Qwen 3.6 27B Q8 with 256k context window in Agent Zero. But the 35B A3B Q8 with 256k context window gets constant loops and is basically unusable within Agent Zero.

↯ Qwen 3.6qwen

I’m pretty overwhelmed. I feel like there are so many options that I don’t know which one to choose, and trying things until I find a decent one isn’t really my thing—even though I enjoy it.

↯ Minimax↯ Qwen 3.6minimaxdeepseekqwen+1

I've got to the point where I need some help. I'm trying to run Qwen 3.6, and it will eventually fall into a loop where it's just outputting "/" symbols when it's "thinking".

↯ Gemma↯ Qwen 3.6gemmaqwen

Qwen Studio offers comprehensive functionality spanning chatbot, image and video understanding, image generation, document processing, web search integration, tool utilization, and artifacts.

↯ Qwen 3.5qwen

Don’t miss what’s happening People on X are the first to know. Post Conversation Using Chinese AI models for coding be like: Quote Rachyl Jones @RachylJones Apr 29 NEW: House committees are probing Airbnb and Cursor parent Anysphere over t…

qwencursor

I tested several Qwen and unsloth models to see which could fix this correctly. Here's the breakdown.

qwen

I’ve been looking to buy a coding plan from one of the major open source contributors to give my meager support to them and transition away from Claude. I would love to hear some feedback from the community of their experience with some of…

↯ Glmglmqwen

I usually go for Claude for those kinds of Open WebUI tool creations, but rate limits are getting tight so I decided to just let Qwen3.6-27B-Q5 handle it through Open WebUI. It did it in one shot.

↯ Qwen 3.6qwengeminichatgpt

Hi got 1x 3090 and I'm thinking about these both models. I'm using from Friday Qwen and this model is amazing!

↯ Qwen 3.6qwen

Full disclosure: I used to program a bit, but I was garbage at it so I found a new career. This was eons ago so I'm not a dev, obviously.

↯ Glm↯ Qwen 3.6glmqwen

I now use (mostly) Gemma 4 and Qwen 3.5 models *. And seems that all of them, after context grows a bit, after providing long output for me and getting a short prompt in response, are starting to process many new tokens as input and I have…

↯ Llama↯ Gemma↯ Qwen 3.5gemmallamaqwen

At least in open-webui. Nothing has changed except for the backend update.

↯ Llama↯ Qwen 3.6llamaqwen

SRT-Adapter v8a — Live Demo Interactive demo for the Semiotic-Reflexive Transformer Adapter (v8a generation) bolted onto a frozen Qwen/Qwen2.5-7B. Paste a passage.

qwen

Repo: statisticalplumber/kanban at pi-agent-integration Hi Guys, To test Qwen 3.6’s potential, I also wanted the Cline Kanban project to have an open-source agent to work with. The last time I tested Cline Kanban, it didn’t support agents…

↯ Llama↯ Qwen 3.6clinemoellama+3

Hello! I made a plugin for myself, & I figured I'd share it, in case someone else finds it useful (also to solicit feedback on it).

↯ Copilotcopilotqwengemini+4

I made a simple app using openrouter, hoping to use the new small qwen models (the a3b moe and the 27b dense one), but they aren’t listed. Also, I swear some qwen3.6 models that were listed before are missing now.

↯ Gemma↯ Qwen 3.6gemmamoeqwen

I tried working on a local LLM project today and honestly ended up pretty frustrated. I tested several approaches, but none of them worked reliably.

↯ Llama↯ Qwen 3.6llamaqwen

I knew there would be a speed penalty when switching the KV cache quantization from F16 to Q8, but I never expected it to be this significant at longer context sizes. I ran a test with Qwen 3.5 122B on my MacBook M2 Max using llama.cpp.

↯ Llama↯ Qwen 3.5llamaqwen

Qwen Lens Studio A multimodal AI studio built around a single Qwen vision-language model, exposed through five focused tools plus a batch runner and a persistent session log. Ship a screenshot → get code.

↯ Ollama↯ Qwen 3.6ollamaqwen

Do I understand correctly, based on this comment, that I can potentially fit Qwen 3.6 27B FP8 precision model and have around 256K context available and fit it fully in my RTX 5090 VRAM? Of course with the help of TurboQuant compression, a…

↯ Llama↯ Qwen 3.6llamaqwen

↯ Qwen 3.6qwen

qwengemini

↯ Llama↯ Qwen 3.6llamaqwen

↯ Qwen 3.6qwen

↯ Qwen 2.5qwen

↯ Llama↯ Qwen 3.6moedeepseekllama+1

↯ Llama↯ Qwen 3.6moellamaqwen

↯ Llama↯ Gemma↯ Qwen 3.6gemmallamaqwen

Hi guys, just want to share with you guys a Frankenstein build I put together that is surprisingly decent I have a i5 12400 / B660 / 32GB DDR4 build that was previously paired with a 3060ti. Last Christmas I upgraded it to a RX9070, then I…

↯ Llama↯ Qwen 3.6llamaqwen

I asked Qwen to build a 3d game in C++ using OpenGl, he created the whole project in multiples cpp and header files, 2500 lines of codes in on single shot, the code was clean highly technical, the scene load from the first try, i was amaze…

↯ Qwen 3.5qwen

Hardware: Intel Core Ultra 7 258V, 32GB Unified Memory. Model: Qwen 3.6 35B A3B (Quant: Q3_K_S) via LM Studio.

↯ Gemma↯ Qwen 3.6gemmamoeqwen

https://preview.redd.it/4906akj9dovg1.png?width=1527&format=png&auto=webp&s=c49e255ac79a3c5455f44603422f8af7ddc12594 First of all can we make https://www.youtube.com/watch?v=2lUC8Gimxz8 Angine de Poitrine this subs official band? Those guy…

↯ Llama↯ Qwen 3.6llamaqwen

Basically I am asking the model to describe an image, but it says it can't process the images. The weird thing is that if I send the image encoded directly on the prompt, it works just fine, I am using llama-server with qwen3.5 (tried all…

↯ Llama↯ Qwen 3.6llamaqwencodex

https://preview.redd.it/c0ns26pf3mvg1.png?width=1920&format=png&auto=webp&s=4b6ac114c2e0395684ac0ba79e591d71ccca2fe3 ParseBench lets you test the accuracy of different parsers using your own documents. Ran this across Gemini 3 flash, Qwen…

↯ Gemini 3qwengemini

Hi, I do a lot of writing and would be interested to know what people's thoughts are on the most capable model for proofreading, grammatical and academic editing. I have 48GB VRAM but don't imagine i'd need something too overkill.

↯ Qwen 3.5qwen

nyquest.ai Semantic Compression Proxy for LLMs Reduce LLM token usage by 15–75% without losing meaning. Drop-in proxy with 350+ compiled rules + local LLM semantic condensation (Qwen 2.5 1.5B).

↯ Qwen 2.5qwen

At this moment I am broke, so pls dont laugh at my specs, I am making vidoes at this moments but I want a deep male voice, I did try eleven labs but ts is too costly, then I tried qwen tts but it was slow as heck, does anybody know lighter…

qwen

My system has 32gb RAM and 8gb VRAM. I tried out DeepSeek-R1-Distill-Qwen-7B-Q6_K_L.gguf and it was vastly inadequate for what I wanted so looking for other suggestions.

deepseekqwen

Wait, I need to be careful about the "no_think" tag in the system prompt. The system prompt says /no_think.

↯ Qwen 3.5qwen

I bought a dual Skylake server because 12 channels of memory (and 2 x 3090s) THEN found out about NUMA nodes after my poor test results. Very disappointed.

↯ Qwen 3.5qwen

Hi! I hope its okay for me to ask this here.

↯ Llama↯ Qwen 3.5llamaqwen

I’ve been messing around with local LLMs on my 3090 for a while now — I have a growing collection of Qwen models on D:\LLM that I probably should be embarrassed about. A few weeks ago I stumbled across David Noel Ng’s LLM Neuroanatomy blog…

qwen

Hello, je suis en plein dans le montage d'une solution IA locale pour virer à terme perplexity, l'usage de chatgpt, claude etc..... mais je ne suis pas informaticien (perplexity est encore mon amie en ce moment !).

↯ Ollama↯ Qwen 3.5ollamaqwenchatgpt

I’m working on an LLM agent setup (using Qwen-style chat templates with tool calling), and I ran into a design trade-off that I’d like to get some insights on. In these templates, the full tool definitions (JSON schemas) are injected into…

↯ Vllmvllmqwenmcp

This is a total hack job article. The National Design Studio ( ndstudio.gov) shipped trumpaccounts.gov and a mobile app this year.

qwen

Parallel Constrained Decoding for Apple Silicon A high-throughput inference engine for structured information extraction, decision routing, and categorical classification on Apple Silicon using MLX. Parallel Constrained Decoding evaluates…

↯ Qwen 2.5qwen

What are your own experiences on this? What mac/specs do you have?

↯ Qwen 3.8qwen

Operating System powered by Qwen 3.8 27B at 1950 tokens/sec! here is what 1,950 tokens/second @Alibaba_Qwen's 3.8 27b actually looks like on @cerebras: i wrote a minimal python web server that turns cerebras inference into a live operatin…

↯ Qwen 3.8qwen

Cogumi Voice Home Web Reader Doc Reader Dictate Story Maker AI Spirits Chat Story Files Fast (vram: 1 GB) Good (vram: 1.5 GB) Better (vram: 4 GB) Resume chapter Narrate automatically Lively Deep Polished Soft Warm Calm Bright Clear Crisp K…

qwen

I build tools for AI and LLM agents — orchestration, sandboxes, and the data pipelines that feed them — with a taste for what happens under the hood in Python, Rust, and Linux. My background is in Backend and AI/Data engineering, shaped by…

↯ Qwen 3.8qwen

Heya HN! I'm helping launch this site which uses Qwen 3-32b to process thousands of news articles and analyze them by region, public interest, partisan lean, etc.

↯ Qwen 3qwen

chess5.ai Human vs LLM · Five Games Pit yourself against GPT, Claude, Gemini, Grok, Muse Spark, Mistral, DeepSeek, Kimi, Qwen, GLM, or MiniMax across five classic boards. How it works - Human vs model, or model vs model — with spectating a…

↯ Glm↯ Minimax↯ Mistralmistralminimaxglm+4

An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving Qwen Team · Huazhong University of Science and Technology 📑 Technical Report | 📖 Blog | 🤗 Hugging Face | 🤖 ModelScope Welcome to the GitHub repository of Qwe…

qwen

Running LLMs in the Browser with Three.js A tour of how language models generate text, how GPT-2 and newer Phi and Qwen architectures differ, and how Three-LLM implements their inference graphs with Three.js TSL compute shaders. Ben Housto…

↯ GPT 2qwen

PicoLM is an LLM inference engine written in C99. It currently supports llama-2, GPT-2, Qwen 3.6/3.8(+MoE) and Gemma-3n models.

↯ Llama↯ Gemmagemmamoellama+2

DeltaCode Engine Deterministic task-to-symbol discovery and bounded AST context for coding agents. DeltaCode turns a coding objective into a small, inspectable context packet.

qwen

had to try this. RL'd Qwen-3.5-35B to paint hibiscus by writing p5.js code, rewarded by rendering the sketch and judging it against my own hand-rated favorites.

↯ Qwen 3.5qwen

Free to try the Qwen Image 3.0 Pro API, an AI model for knowledge-rich image generation, dense layouts, fine multilingual text, realistic detail, and creative production. Related Qwen Image 3.0 Pro Models Try the AI Image Generator now Qwe…

qwen

<p>As an interesting experiment I wanted to learn how to teach a tiny local llm a new domain by doing Continued Pretraining (CPT) on domain specific data. This article is a write-up of my experiences from using Unsloth to train qwen 3 4B t…

↯ Qwen 3↯ Qwen 3qwen

AI Use Audience Running code Most sections have code attached with them that you can copy in your local and run directly. The full Qwen implementation is available in harness section.

qwen

now runs 190.4% faster on Mac.How the score worksThe headline compares the current best score with the launch baseline. Each score is a run's decode token-rate speedup from native multi-token prediction, normalized against a fixed referenc…

qwen

Hypothetically speaking: if you have cpu friendly ultimate "content generator" what would you do? Not saying it's the holy grail btw: so not "break satoshi's wallet", not "cure cancer" or turn mercury -> gold but say it has the power of co…

↯ Qwen 3.8qwen

Qwen 3.8 27B (just released) running locally is pretty good. In Cloudflare OS it made me a collaborative whiteboard with real-time multiplayer cursor tracking.

↯ Qwen 3.8qwencursor

I asked @Alibaba_Qwen 27B to make @simonw's pelican svg but dolphin with a twist from @goodside's prompt! "create an svg where a dolphin is riding a bicycle while using vlogging with a phone" After ~ 36 mins of thinking, 32K tokens, the mo…

↯ Qwen 3.8qwen

could not extract summary

↯ Qwen 3.8qwen

could not extract summary

↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8↯ Qwen 3.8qwenopus

In this blog post, we will see how to connect your AI coding agent, like Claude Code, Qwen Code, or Cursor, to the JMeter Docs MCP server. This is a small project I shipped on docs.jmeter.ai, and it solves a problem I kept running into mys…

qwencursormcp+1

I just found out about this new American (San Francisco) model today and I'm currently benchmarking it and, so far, it is outperforming my standard go-to model Qwen3.5:122b and even Sonnet in my benchmarking test. It's personality is much…

qwensonnet

Qwen Scribe Private, local transcription and system-wide dictation for Apple Silicon. Qwen Scribe transcribes audio and video with Qwen3-ASR running through mlx-qwen3-asr on the Mac's Metal GPU.

qwen

If U.S. labs slow down AGI development, this could be 2028: Moonshot Kimi 6, Alibaba Qwen 5, Z.ai, and MiniMax are all claiming AGI-level capabilities.

↯ Minimaxminimaxqwengemini+2

I'm not quite following the news. Is it true?

qwen

Fara1.5-27B Fara1.5-27B is a multimodal computer use agent (CUA) for web browsers, from Microsoft Research AI Frontiers. It observes the browser through screenshots and acts on the user's behalf by emitting structured tool calls — click, t…

qwen

A real-time LLM Melee agent with CUDA-graph decisions, a micro-simulator that imagines 6,144 futures per decision, a critic that ties a single constant, and a baseline comparison where hand-written rules match the language model.

qwen

This is an independent project and is not affiliated with or endorsed by Qwen or Alibaba

qwen