Run Google's Gemini LLMs right on your Mac with the new AI Edge Gallery – AppleInsider

AAPL: 311.23 (0.97)
Copyright © 2026 Quiller Media, Inc. All rights reserved.
Thu Jun 04 2026, 08:16 AM EDT · 2 minute read
Google's AI Edge Gallery just launched on the Mac
Google has released its AI Edge Gallery app on the Mac for the first time, allowing AI fans to run its Gemma large language models (LLMs) locally, without the need for an internet connection.
While the AI Edge Gallery has been available for the iPhone for a while, the Mac has lagged behind. That changed today when Google made the AI Edge Gallery app available as a direct download from its website.
Running an LLM locally has multiple benefits, not just the fact that it can work offline. There is an added privacy benefit, and a local LLM is often faster than sending requests to a cloud server and waiting for a response.
Alongside the new app, Google also released the Gemma 4 12B model as well as a new AI-powered smart on-device dictation tool.
Heavy LLM users have long been able to run Google’s LLMs locally on their devices, including the Mac. But this is the first time that Google’s own tool has been available for Mac owners.
Those downloading the new AI Edge Gallery tool will be able to run the Gemma 4 12B model. The model joins existing Gemma 4 models as well as existing Gemma 3n models.
The new Gemma 4 12 B model will offer “agentic multimodal intelligence” that is designed to be run “directly” on laptops.
Google says that the new model is small enough to run locally on computers with at least 16GB of VRAM or unified memory. That means that all modern Apple laptops are good to go, with the notable exception of the MacBook Neo.
Google also announced AI Edge Eloquent, an AI-powered dictation and editing tool. It runs entirely on-device, so no internet connection is required.
AI Edge Eloquent works across all Mac apps and can be launched via a keyboard shortcut. This is an app that was previously available for the iPhone, making its way to the Mac for the first time.
Users will be able to choose their preferred writing style and add custom words, creating a custom vocabulary. At launch, AI Edge Eloquent is only available in English, but more languages are on the way.
Google AI Edge Eloquent is a free download for Mac and iPhone.
Update June 4, 11:02 AM ET According to Google, Gemma is a family of lightweight, state-of-the-art open models built from the same research and technology used to create the Gemini models. This has been clarified in the head and text.
Oliver has more than a decade of experience discussing Apple and Apple-adjacent companies and covers news, opinion, reviews, and more here at AppleInsider.
AI Edge Gallery does NOT allow you to run Gemini models on your device. It allows you to run Gemma models on your device. There is a difference. The Gemini models are private/proprietary and run exclusively within Google infrastructure, while Gemma models are open source and portable. There is no crossover and these two offerings should not be lazily conflated.

ranson said:

AI Edge Gallery does NOT allow you to run Gemini models on your device. It allows you to run Gemma models on your device. There is a difference. The Gemini models are private/proprietary and run exclusively within Google infrastructure, while Gemma models are open source and portable. There is no crossover and these two offerings should not be lazily conflated.

I’m looking into semantics of the piece, but, directly from Google:

Mike Wuerthele said:

I’m looking into semantics of the piece, but, directly from Google:

“Gemma is a family of lightweight, state-of-the-art open models built from the same research and technology used to create the Gemini models.”

That sentence alone distinguishes that Gemma models and Gemini models are different offerings. Chevy’s Ultium chassis technology was used for the Blazer, Hummer and even Cadillacs. But you don’t call a Blazer a Hummer.
If you've got a medium to large-sized yard that needs mowing regularly, the Mova LiDAX Ultra robot lawn mower can make mowing an afterthought.
The two points Apple has brought to the Supreme Court could undo the entire remainder of the case, so of course Epic Games has filed to suggest Apple is totally wrong here.
The Poke app will give Siri even more competition, as it lets you send emails, set reminders, generate images, and more, right from the Apple Messages app.
After multiple high-profile recalls, battery packs are starting to switch to new, safer solid-state technology. We've rounded up the best solid-state MagSafe battery packs for your iPhone to help you pick one.
A new research report has Apple's first MacBook Pro with OLED shipping weeks or months sooner than other, more reliable leakers have been claiming for months, if not years.
AI apps led App Store growth in 2025, with the entire ecosystem garnering $1.4 trillion in payouts. Apple's take of that is only 10%, assuming you agree with how they count.
Despite being released only two months ago, AirPods Max 2 are on sale for $499, which is the lowest price to date. And score delivery as early as today.
Apple Card Savings customers are earning less again as the account's annual percentage yield falls to a new low of 3.4%, extending a series of rate cuts that have reduced returns for savers.

source