Groq’s Secret to Faster LLMs (MIT Alum John Barrus)

Friday, November 8
12:00 pm - 1:00 pm

Haus Room (36-428) Food Served

Details

  • Date: Friday, November 8
  • Time: 12:00 pm - 1:00 pm
  • Location: Haus Room (36-428) Food Served
Additional Location Details:
RSVP Here

Groq’s Secret to 10x Faster LLMs: A Dive into Custom Language Processing Hardware

Discover how Groq’s cutting-edge technology is revolutionizing the performance of Large Language Models (LLMs). With the innovative use of SRAM, high-performance chip-to-chip communication, and deterministic execution, Groq achieves speeds that are 10 times faster than traditional GPU-based systems. Join us to explore exciting applications from natural language processing to AI-driven decision-making enabled by Groq’s pioneering technology.

BioJohn Barrus (MIT ’84, Ph.D. ’93, Course 2), Head of Product at GroqCloud. A renowned tech entrepreneur, John has shaped the future of cloud-based AI, embedded systems, and IoT, previously leading Cloud TPU and GPU deployments at Google Cloud.

Host