Gus

Gemma Product Manager @google DeepMind - Gemma 💎 - Google AI ⚙️🧠

Articles & links

What would happen if we tried the diffusion generation on LLMs? We get Diffusion Gemma! 4x speed up! ⚡⚡⚡💎 blog.google/innovation-a...

DiffusionGemma: 4x faster text generation blog.google
AI Weekly's analysis
  • DiffusionGemma generates 256 tokens per forward pass using bidirectional attention, reaching 1,000+ tokens/sec on a single H100 GPU.
  • With only 3.8B active parameters during inference and an 18GB VRAM footprint when quantized, it runs on consumer hardware without server-grade resources.
  • Google recommends DiffusionGemma only for speed-critical workloads like in-line editing and code infilling, not for applications requiring maximum quality.
Read full analysis →
View on Bluesky · ♥ 24 ↻ 3 ↩ 1 · 6 from the directory shared this · 7d ago

Gemma 4 12B is live! 🚀 An encoder-free multimodal model (text/img/audio) for local 16GB laptops. Elite reasoning nearing 26B MoE in half the size, fast, and open (Apache 2.0). This is the main reason I was not posting much!! Glad it is launched!! blog.google/innovation-a...

Introducing Gemma 4 12B: a unified, encoder-free multimodal model blog.google
AI Weekly's analysis
  • The 35M-parameter vision embedder replaces 27 vision transformer layers, keeping the full model inside 16GB with complete image and audio understanding.
  • Audio projects from raw 16 kHz waveforms in 40ms frames directly to the LLM backbone, bypassing any separate ASR encoder used in competing designs.
  • Single-pass LoRA fine-tuning updates vision, audio, and text weights simultaneously, eliminating the engineering overhead of co-tuning frozen encoders.
Read full analysis →
View on Bluesky · ♥ 111 ↻ 16 ↩ 8 · 2 from the directory shared this · 15d ago

great post about AI trends specifically mentioning the Gemma 4 success!! 🤩 www.interconnects.ai/p/some-ideas...

interconnects.ai
View on Bluesky · ♥ 1 ↻ 0 ↩ 0 · 3 from the directory shared this · 23d ago

In Gus's orbit

Center = Gus. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.