Gemma 3

1. Running llama.cpp on Snapdragon Hexagon NPU seems promising (www.reddit.com)

   +82 3h gemmallama

   https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/README.md I have an Oneplus 12 with Snapdragon 8 Gen 3. I followed the above README to cross-compile llama.cpp on Ubuntu and then copy to the Termux directory on the…

2. Creation OS: local σ-gated LLM runtime — BitNet/Qwen/Gemma, abstention, conformal gate, MCP, no cloud (www.reddit.com)

   +1 1d gemmaqwenmcp

   I’ve been building a local-first AI runtime that wraps local LLMs with a σ-gate — a measurement layer that decides ACCEPT, RETHINK, or ABSTAIN before an answer reaches you. The idea: local models should be able to say “I don’t know” instea…

3. I've created a LoRA for Gemma 3 270M making it probably the smallest thinking model? (www.reddit.com)

   +84 2d gemma

   https://huggingface.co/firstbober/gemma-3-270M-it-smol-thinker Here is an example of the output: ``` ==================== THINKING ==================== Here is the thinking process: This is a large community with a wide range of interests…

4. Good LLM to generate ascii art? (www.reddit.com)

   3 4d gemmaqwen

   I tried with Qwen but it sucked, Gemma3/4 was better but not good enough. From Gemma: https://pastebin.com/raw/Qr5iMgYj Still looks like a bloody car accident though.

← all threads