Gemma 4

1. I implemented a modern LLM in 700 lines of C (www.reddit.comhttps)

   3w gemma

   I’ve been working on a small project called gemma4.c. The idea is pretty simple: you can download a modern language model, compile one 700-line C file, and have it generate text on an ordinary CPU.

2. Gemma 4 E2B inference in 700 lines of C (github.com via hn)

   +4 3w gemma

   gemma4.c Gemma 4 E2B CPU inference in 700 lines of pure C. An educational project made to understand how LLM inference works.

3. 12 abliterated Gemma 4 12B variants, one base, 165 GPU hours - Abliterlitics (www.reddit.com via reddit)

   3w gemma

   I ran 11 uncensored variants of Gemma 4 12B that I grabbed from huggingface, sorting by downloads. 10 full abliterations plus 2 LoRA adapters which were requested to be added in the comparison, against the official base.

4. What it takes to run Gemma 4 E4B on an iPhone (amoli.app via hn)

   +1 3w gemma

   I spent the last several months building a photo journal that runs a full multimodal LLM — Gemma 4 E4B — entirely on an iPhone. No cloud inference, no accounts, no analytics, full privacy; the App Store privacy label is "Data Not Collected…

5. Best model for 16gb ram Mac (www.reddit.com via reddit)

   3w gemmallama

   Hi everybody! Every now and then these days, we’re seeing really huge open-weight models popping up.

6. Ling Tiny, King of Speed (www.reddit.comhttps)

   3w vllm

   Ling Tiny has now replaced Gemma4-12B in my rig as an auxiliary model doing hindsight operations. This is on a 4060Ti, which is a reasonable GPU available out there, and the speed is phenomenal.

7. I fine tuned Gemma 4 12B for a 2.7x improvement on tool calling because I can't fit anything else comfortably into my 16 GBs of Vram (huggingface.co via reddit)

   3w ollamagemmacopilot+2

   Gemma 12B is obviously a very well trained model, I always thought the fine tuning they did on it wasn't really cut out for agentic coding. From my own experiences it struggles to use the tools it's given from Github Copilot and is also ve…

8. Your own GGUF (www.reddit.com via reddit)

   4w gemmallama

   Hello, I have a few questions that I can't seem to find a clear answer to. Does it make sense to make your own GGUF?

9. Gemma (github.com via hn)

   +2 4w deepmindgemma

   Gemma is Google DeepMind's family of lightweight, state-of-the-art open models. Contents Start Here Models Core Models Variants Inference Local Hosted Fine-Tune Tutorials Demos and Applications Gemma 4 Good Challenge Gemma in Space Researc…

10. Apertura A from-scratch Objective-C++ / MLX rebuild of Gemma-4 for Apple Silicon (github.com via hn)

    +11 4w gemma

    Apertura A from-scratch Objective-C++ / MLX rebuild of Google's Gemma-4 for Apple Silicon — built to be inspected, observed, and experimented with. Most language models are run behind glass: you send a prompt and get an answer, with no way…

← all threads