Gemma 4

1. Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac (github.com via hn)

   +21653 7w gemma

   Hi HN, I built a specialized inference engine for running 4-bit Gemma 4 26B-A4B-IT on any M-series Mac using about 2 GB of RAM. It is called TurboFieldfare and is written in Swift and Metal.

2. Show HN: Gemma 4 26B A4B running on an iPhone 17 Pro via model paging (noemaai.com via hn)

   +2 7w gemma

   I wanted to share a use case for Noema Overfit, a model-paging system available today in the Noema app. For disclosure, I founded Noema and I am part of the team that has helped develop the system.

3. Benchmarking Fine-tuning and Retrieval Strategies for a Multimodal Language Model on the NRC Reactor Operator Licensing Examination (arxiv.org)

   7w operatorgemmafine-tuning

   The integration of large language models (LLMs) into the nuclear power industry requires outputs grounded in domain-specific knowledge. This study evaluates a 31-billion-parameter open-weight multimodal model (Gemma 4 31B-IT) on its capaci…

4. Command-hook compliance gate: Cursor rules + Ollama, no cloud judge (www.reddit.com via reddit)

   7w ollamacursor

   Cursor type: "prompt" hooks always use Cursor’s own model. No model / baseUrl — you can’t point them at Ollama.

5. Show HN: Cuts Long Horizon Inference Costs by 50% via external KV Cache Offload (github.com via hn)

   +20 7w gemma

   Hey HN, we’re the developers of OpenLake, an open source storage engine for offloading LLM KV caches from GPU memory into a shared tier of RAM and NVMe. We built OpenLake because KV caches are outgrowing GPU memory.

← all threads