Google on Thursday introduced a feature in its Gemini app for Mac that can carry out multi-step tasks by clicking, typing and filling out forms for the user. The company calls the feature computer use.
According to Google, users describe a task in plain language, and Gemini works through it across local files, desktop apps and websites. The company said the feature is meant to save time on repetitive work that normally takes dozens of clicks. The announcement was written by Michael Friedman, a group product manager for the Gemini app.
Google said Gemini works in an isolated window in the background, with a live preview shown in the chat. The company said this leaves the user’s main screen and cursor free, so the user can keep working or take calls.
Google described several controls. Users choose which apps Gemini can access, can watch each step as it happens, and can pause at any time. Gemini asks for approval before key actions, the company said.
The announcement gave four example uses. These were batch color-grading photos in design software or setting up 3D scenes, and pulling weights, dimensions and addresses from local PDFs to fill out shipping quote forms. They also included collecting metrics and screenshots from live dashboards to build a Google Slides presentation, and analyzing clothing photos in a local folder, researching prices and preparing listings on resale platforms.
The feature is rolling out in English in the United States, Google said. It requires an Apple Silicon Mac running macOS Sequoia 15.0 or later. According to the announcement, it is available for personal Google accounts for people 18 and older, and to Google AI Plus, Pro and Ultra users.
The Mac app can be downloaded at gemini.google/mac. The announcement did not say what the Google AI plans cost. It also did not say when the feature would reach other languages or countries.
The description of how the feature works comes from Google’s own announcement. The post did not include independent testing or data on how often tasks are completed correctly.