Google Adds Native Computer Use to Gemini 3.5 Flash

Google DeepMind has integrated a native "computer use" capability into Gemini 3.5 Flash, enabling agents to perceive and interact with graphical user interfaces across browsers, mobile, and desktops, according to the Google DeepMind blog (Jun 24, 2026). The blog and DeepMind model pages say the feature lets gemini-3.5-flash take screenshots, interpret GUIs, click, fill forms, and operate applications without bespoke API integrations. DeepMind published evaluation details showing strong agentic and UI-control benchmark performance (for example, an OSWorld-Verified UI Control score of 78.4% reported on DeepMind's model page), and a technical evaluation PDF documents the methodology behind those numbers. Google also describes targeted adversarial training and two optional enterprise safeguards, explicit user confirmation and automatic task-stopping on detected indirect prompt injection, to reduce risk (Google DeepMind blog).
What happened
According to the Google DeepMind blog post published Jun 24, 2026, computer use is now a built-in tool in Gemini 3.5 Flash, enabling the model to perceive and interact with screen content and GUIs so agents can operate across browser, mobile, and desktop environments. The blog states developers can build agents that use screenshots and visual understanding to navigate websites, click buttons, fill forms, operate enterprise software, and carry out multi-step workflows. The DeepMind model pages and accompanying evaluation PDF provide benchmark results and methodology for gemini-3.5-flash, including an OSWorld-Verified UI Control score of 78.4% reported on DeepMind's public model page and agentic benchmark results summarized in the model evaluation PDF.
Technical details
Per the DeepMind evaluation PDF and the Google DeepMind blog, the computer use capability is integrated natively into the main Flash model rather than provided as a separate add-on. The evaluation methodology document describes benchmark suites used for agentic and UI tasks (Terminal-Bench 2.1, MCP Atlas, Toolathlon, OSWorld-Verified), and notes self-computed runs averaged over multiple trials for Gemini models. The PDF and model pages list harness and tooling details used for UI actuation (for example, pyautogui for actuation and the OSWorld docker and default 1080p resolution for UI control tests). The Google blog describes two optional enterprise safeguards: one that requires explicit user confirmation for sensitive or irreversible actions, and one that can automatically stop tasks if an indirect prompt injection is identified.
Editorial analysis - technical context
Companies adding visual screen-control primitives to language agents remove a major integration bottleneck that traditionally required per-application APIs or bespoke connectors. Industry-pattern observations: agents that operate via visual UI control typically combine robust visual grounding, stateful workflow planning, and reliable actuation libraries; they also need sandboxing and layered safety controls to limit unintended side effects. For practitioners, the availability of a native computer-use tool inside a frontier model like gemini-3.5-flash lowers engineering overhead for building automation across legacy GUIs but raises reproducibility and monitoring demands because visual actuation is more sensitive to UI changes and timing than API calls.
Context and significance
DeepMind and Google Cloud framing around an "agentic enterprise" places this capability alongside other Agent Platform and managed-agent features announced at Google I/O and Google Cloud events. Public benchmark numbers on the DeepMind model page and in the evaluation PDF position Gemini 3.5 Flash as a top performer on several agentic and coding metrics (the model page lists comparative rows for Terminal-Bench, MCP Atlas, and other suites). Observed patterns in similar releases: when vendors add native UI-control capability, customers prioritize auditability, human approvals, and access controls, and third-party tooling for replay and test harnesses emerges quickly.
What to watch
- •Adoption signals from managed-agent and Agent Platform integrations and any enterprise case studies Google publishes.
- •Independent benchmark replications for UI-control tasks and robustness tests across different OS/browser versions.
- •Third-party tooling for sandboxing, replay-based testing, and human-in-the-loop confirmation workflows that pair with visual actuation.
- •Security analyses showing how effective the adversarial training and the optional safeguards are in real-world prompt-injection scenarios.
Key Points
- 1Native GUI control in Gemini 3.5 Flash reduces the need for bespoke API connectors, enabling faster agentic automation development.
- 2DeepMind reports strong agentic UI benchmark scores (OSWorld-Verified UI Control 78.4%), indicating improved reliability for screen-based tasks.
- 3Industry observers will watch enterprise safeguards, sandboxing, and independent robustness tests before wide deployment of autonomous GUI agents.
Scoring Rationale
Native computer-use integration in Gemini 3.5 Flash lowers engineering overhead for building GUI-based agents, extending practical agentic automation to legacy enterprise software. Significant for practitioners but a capability addition to an existing model rather than a paradigm-level release.
Sources
Primary source and supporting public references used for this report.
View 7 more sources
- Google Gemini Can Now Control Your Computer. Hackers Are Already Targeting AI Agentssearchenginejournal.com
- Introducing computer use in Gemini 3.5 Flashblog.google
- [PDF] Approach, Methodology & Results Gemini 3.5 Flash - Googleapis.comstorage.googleapis.com
- Gemini 3.5deepmind.google
- Innovations from Google I/O 26 on Google Cloud | Google Cloud Blogcloud.google.com
- Models | Gemini APIai.google.dev
- Gemini in Chrome adds 'Select from screen' tool as Gemini 3.5 Flash gains computer use9to5google.com
Practice interview problems based on real data
1,625 SQL & Python problems across 15 industry datasets — the exact type of data you work with.
Try 250 free problems
