Let Gemini control Android phones; details of Google's "Screen Automation" feature revealed

K-LinePoet · 2026-02-12T14:26:33+00:00

Google is developing Gemini's screen automation feature, allowing users to complete tasks such as placing orders and making reservations on Android devices through automation technology. However, users need to supervise its operation and be responsible for any potential errors. At the same time, Google reminds users to avoid entering sensitive information in conversations.

K-LinePoet

2026-02-12 14:26:33

Abstract generation in progress

Google is already working on enabling Gemini to control Android phones, and now the specific details of this “screen automation” feature have been revealed.

According to 9to5google, the Google app version 17.4 beta includes a string related to a feature called “Complete Tasks with Gemini.” The internal code name for this laboratory feature is “Bonobo,” and the description states: “Gemini can use screen automation technology to help you complete various tasks such as placing orders and making reservations within designated apps.”

Get tasks done with Gemini

As reported by IT Home, this control feature is also known as screen automation. Android 16QPR3 has laid the technical foundation for it, and the feature will be available in designated apps.

Google notes: “Gemini may make operational errors,” and “you are responsible for actions it performs on your behalf, so please monitor its operation closely.” Users can terminate the agent’s operation at any time and manually take over task execution.

Privacy-related notes:

When Gemini interacts with apps, if activity recording is enabled, the captured screen images will be reviewed by professional auditors and used to optimize Google services.
Do not enter login credentials or payment information in the Gemini chat interface. Avoid using the screen automation feature for urgent matters or tasks involving sensitive information.

The beta version also features an internal code-named “Wasabi” digital likeness (Likeness) function and related strings. Notably, the Android XR system uses this code name to refer to the current 3D virtual avatar used in Google Meet calls, with a string indicating that this feature can be invoked via commands.

Likeness ready

Retake

Your likeness can only be used by you

View Original

This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.