Oct 23, 2026 · 9 min read ThinkingCap: Gemma-4-26B-A4B — up to 69% and on average 39% less thinking, at unchanged accuracy TL;DR This is the fifth model in the ThinkingCap series. We reduced how much Google's gemma-4-26B-A4B-it thinks, wit…
model
gemma-4-26B-A4B-it
huggingface.co/google/gemma-4-26B-A4B-it ↗
11696495 downloads1064 likesimage-text-to-texttransformers
from the model card
Hugging Face | GitHub | Launch Blog | Documentation License: Apache 2.0 | Authors: Google DeepMind Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on small models) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages. Featuring both Dense and Mixture-of-Experts (MoE) architectures, Gemma 4 is well-suited for tasks like text generation, coding, and reasoning. The models are available in four distinct sizes: E2B, E4B, 26B A4B, and 31B. Their diverse sizes make them deployable in environments ranging from high-end phones to laptops and servers, democratizing access to state-of-the-art AI. Gemma 4 introduces key capability and architectural advancements: Reasoning – All models in the family are designed as highly capable reasoners, with configurable thinking modes. Extended Multimodalities – Processes Text, Image with variable aspect ratio and resolution support (all models), Video, and Audio (featured natively on the E2B and E4B models). Diverse & Efficient Architectures – Offers Dense and Mixture-of-Experts (MoE) variants of different sizes for scalable deployment. Optimized for On-Device – Smaller models are …
discussions
- LLM Fine-Tuning Announcement 5 2026-10-18 – 2026-10-25
- AI Model Release 2 2026-10-15 – 2026-10-20
- Gemma 4 Botanic Collaboration 2 2026-10-06 – 2026-10-12
- Gemma Model Update 5 2026-09-28 – 2026-10-03
- Gemma 4 10 2026-08-20 – 2026-08-30
- Gemma 4 2 2026-08-10 – 2026-08-15
- Gemma 4 7 2026-07-25 – 2026-08-02
- Gemma 4 6 2026-07-12 – 2026-07-19
- Gemma 4 6 2026-07-07 – 2026-07-10
- Gemma 4 9 2026-06-29 – 2026-07-06
- Gemma 4 4 2026-06-24 – 2026-06-28
- Gemma 4 3 2026-06-17 – 2026-06-20
- Gemma 4 75 2026-06-01 – 2026-06-16
recent items
Gemma-4-26B-A4B with 39-69% less thinking at same accuracy (bottlecapai.com via hn) How Far Can the Gemma 4 Speech Encoder Go Without Changing Its Weights? Saudi and Gulf Arabic Speech Recognition with a Frozen and an Adapter-Augmented Encoder (arxiv.org) We study the 305M-parameter audio encoder shared by Gemma 4 and EmbeddingGemma 2 (identical except for its final projection) for Saudi and Gulf Arabic speech recognition, without changing any of its weights. A frozen system trains only a 2…
Show HN: Reverse engineering the ANE to run Gemma 4 26B at 100 Tok/s (github.com via hn) After checking out Turbo Fieldfare (a very interesting project that streamed experts from SSD on Apple Silicon Macs to run Gemma 4 26B with very little RAM usage), I tried to make this project much faster and succeeded! This project gets u…
Safeguard Flag on ML/Kaggle Workflow outside of claudes outputs. (www.reddit.comhttps) I’m a machine learning engineer competing in the Gemma 4 fine-tuning challenge on Kaggle. I’m building a small synthetic software engineering dataset with a training/holdout split to fine-tune a small model.
↯ Gemma↯ Fine Tuning↯ LLM Fine-Tuning Announcement↯ AI Model Releasegemmafine-tuning
Google Gemma 4 Open Models (gemma.ai via hn) Skip to content Gemma Documentation Google Gemma 4 Open Models Search Home Get started Models Run Fine-tune Learn Resources Gemma Documentation Home Get started Get started Quickstart Best practices Text Text Inference Reasoning Tool calli…
Living Models pairs Gemma 4 with BOTANIC-1 to help decode plant DNA (deepmind.google via hn) Living Models pairs Gemma 4 with BOTANIC-1 to help decode plant DNA By combining Gemma 4 with BOTANIC-1, a foundation model trained specifically on plant genomes, researchers could compress years of traditional crop genetics into hours of…
Designing a local model harness optimized for MCP use (portlandaiworks.com via hn) Article · September 24, 2026 Three days and about forty scripted runs of Gemma 4 and Qwen3 against an ERP over MCP. The pass rate went from 1 of 4 to 4 of 4 without changing the model.
Show HN: I made a computer vision tool for evaluating deadlift form (github.com via hn) I've shared a few deadlift demos in the past. This new demo includes some new models, accessed through the VLM Run Gateway: - SAM 3.1 to segment the barbell weight plate - ViTPose+ Large to measure the hip hinge angle, which serves as a ba…
640tok/s on Gemma 4 with a megakernel (withhopper.com via hn) A worklog on megakernels for Gemma 4 on TPU v5e: 640 tok/s per user on the 26B-A4B MoE model versus 173 on an H100 with vLLM, why the dense 31B model gains only 1.2x, and when a megakernel is worth building.
Gevva0 – a Jev like decision engine on Gemma 26B via direct logit scoring (github.com via hn) Gevva0: Calibrated Local Decision Gateway -00f2fe) []() A high-speed, local decision gateway running on Gemma 4 (llama.cpp / CUDA) that replaces flaky autoregressive JSON generation with direct token logit scoring, mathematical cyclic debi…
Words Speak Louder Than Order: A Behavioral Evaluation of Gemma 4 (arxiv.org) When a language model receives two conflicting documents as input, how does it decide which one to prioritize? Does it rely on how the sources are framed or the presentation order of the documents?
I implemented a modern LLM in 700 lines of C (www.reddit.comhttps) I’ve been working on a small project called gemma4.c. The idea is pretty simple: you can download a modern language model, compile one 700-line C file, and have it generate text on an ordinary CPU.
Gemma 4 E2B inference in 700 lines of C (github.com via hn) gemma4.c Gemma 4 E2B CPU inference in 700 lines of pure C. An educational project made to understand how LLM inference works.
12 abliterated Gemma 4 12B variants, one base, 165 GPU hours - Abliterlitics (www.reddit.com via reddit) I ran 11 uncensored variants of Gemma 4 12B that I grabbed from huggingface, sorting by downloads. 10 full abliterations plus 2 LoRA adapters which were requested to be added in the comparison, against the official base.
What it takes to run Gemma 4 E4B on an iPhone (amoli.app via hn) I spent the last several months building a photo journal that runs a full multimodal LLM — Gemma 4 E4B — entirely on an iPhone. No cloud inference, no accounts, no analytics, full privacy; the App Store privacy label is "Data Not Collected…
Best model for 16gb ram Mac (www.reddit.com via reddit) Hi everybody! Every now and then these days, we’re seeing really huge open-weight models popping up.
Ling Tiny, King of Speed (www.reddit.comhttps) Ling Tiny has now replaced Gemma4-12B in my rig as an auxiliary model doing hindsight operations. This is on a 4060Ti, which is a reasonable GPU available out there, and the speed is phenomenal.
I fine tuned Gemma 4 12B for a 2.7x improvement on tool calling because I can't fit anything else comfortably into my 16 GBs of Vram (huggingface.co via reddit) Gemma 12B is obviously a very well trained model, I always thought the fine tuning they did on it wasn't really cut out for agentic coding. From my own experiences it struggles to use the tools it's given from Github Copilot and is also ve…
↯ Gemma↯ Copilot↯ Llama↯ Ollama↯ Gemma 4ollamagemmacopilot+2
Your own GGUF (www.reddit.com via reddit) Hello, I have a few questions that I can't seem to find a clear answer to. Does it make sense to make your own GGUF?
Gemma (github.com via hn) Gemma is Google DeepMind's family of lightweight, state-of-the-art open models. Contents Start Here Models Core Models Variants Inference Local Hosted Fine-Tune Tutorials Demos and Applications Gemma 4 Good Challenge Gemma in Space Researc…
Apertura A from-scratch Objective-C++ / MLX rebuild of Gemma-4 for Apple Silicon (github.com via hn) Apertura A from-scratch Objective-C++ / MLX rebuild of Google's Gemma-4 for Apple Silicon — built to be inspected, observed, and experimented with. Most language models are run behind glass: you send a prompt and get an answer, with no way…
Ask HN: Are third party gguf/mmproj safe on Llama in production env (news.ycombinator.com) So i had been building a side project screenmind ,sort of local ai desktop assistant, and hit a confusing multimodel failure... texts worked,but vision and image failed no crash just returning <unsused49>.
Claude Code plugin for translating from Claudish to English (www.reddit.comhttps) I (like thousands of other engineers) got tired of trying to understand Claude's writing. ASD-STE100 instructions didn't change much, so I decided to approach the problem in the 2026 style: use an LLM.
Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac (github.com via hn) Hi HN, I built a specialized inference engine for running 4-bit Gemma 4 26B-A4B-IT on any M-series Mac using about 2 GB of RAM. It is called TurboFieldfare and is written in Swift and Metal.
Show HN: Gemma 4 26B A4B running on an iPhone 17 Pro via model paging (noemaai.com via hn) I wanted to share a use case for Noema Overfit, a model-paging system available today in the Noema app. For disclosure, I founded Noema and I am part of the team that has helped develop the system.
Benchmarking Fine-tuning and Retrieval Strategies for a Multimodal Language Model on the NRC Reactor Operator Licensing Examination (arxiv.org) The integration of large language models (LLMs) into the nuclear power industry requires outputs grounded in domain-specific knowledge. This study evaluates a 31-billion-parameter open-weight multimodal model (Gemma 4 31B-IT) on its capaci…
Command-hook compliance gate: Cursor rules + Ollama, no cloud judge (www.reddit.com via reddit) Cursor type: "prompt" hooks always use Cursor’s own model. No model / baseUrl — you can’t point them at Ollama.
Show HN: Cuts Long Horizon Inference Costs by 50% via external KV Cache Offload (github.com via hn) Hey HN, we’re the developers of OpenLake, an open source storage engine for offloading LLM KV caches from GPU memory into a shared tier of RAM and NVMe. We built OpenLake because KV caches are outgrowing GPU memory.
F*ck it, Vox is now free and the source code is public (www.reddit.com via reddit) I'm making Vox (a voice-to-text app for macOS and Windows that I built with Claude) free for everyone, and the repo is now open. You hold a hotkey, talk, release, and the transcribed + polished text lands in your clipboard (or gets pasted…
Running Gemma 4 26B at 5 tokens/SEC on a 13-year-old Xeon with no GPU (www.neomindlabs.com via hn) June 8, 2026 · By Ryan Findley Running Gemma 4 26B at 5 tokens/sec on a 13-year-old Xeon with no GPU There’s a server in my basement that has no business running a modern language model. It’s a repurposed HP StoreVirtual storage box, rough…