What you need to know
- A rumor claims to have discovered code in an app beta that points toward a “screen automation” feature for Gemini on Android.
- This feature would supposedly enable the AI to “order food” and “book rides” for users, per their request.
- There were several warnings spotted in its early code, advising users to not share sensitive data, as screenshots are shared with “reviewers.”
Google’s AI continues to advance, and now new rumors claim Gemini could rise to a position where it’s doing even more for you, like placing orders.
It looks like Google is working on a “screen automation” feature with Gemini in a report by AssembleDebug (Android Authority). The tipster discovered new insights about this feature, which will supposedly enable Gemini to “help with tasks.” Specifically, a beta version of the Google app states Gemini can “place orders and book rides” for the user.
This functionality is most likely based on the user’s prompt, as they would tell Gemini what to do and (maybe?) how. Early strings in the code reportedly state that Gemini will automate what’s happening on your screen in “certain apps.”
The tipster highlights some security concerns here. They discovered a warning from Google advising users not to enter sensitive information. Supposedly, this is due to screenshots being sent to “trained reviewers” if users have “Keep Activity” enabled. A post by 9to5Google also highlights, though their discovery was made from Android 16 QPR3’s beta.
It was found that these screenshots are taken whenever Gemini takes over with “screen automation.” The screenshots are sent to these “reviewers” to help make Google’s services better. While it’s unclear which apps Gemini’s automated feature could work with, the tipster speculates apps like Uber and Lyft would be involved.
Gemini wants to help
This feature reminds us of an AI Mode update Google delivered in Search last summer, which lets the software act on behalf of the user. In Search, AI Mode can call businesses for users for information on their prices and appointment availability. However, before this, the AI will have the user fill out a questionnaire to understand their intention before calling around for them.
Similar to this AI Mode, this Gemini rumor also advises users to be aware of what the AI is doing. Remember: it’s software, and there’s a real chance it can make a mistake.
On a related note, the tipster saw a direction line between this Gemini feature and Google’s Project Astra. It’s worth mentioning that, last March, Google moved Project Astra into its Gemini arm, as it went from a research project to something bigger.
Android Central’s Take
There’s no hiding the fact that Gemini will have its uses automating tasks for users. The one thing that concerns me—and, likely others, too—is the security concern. It’s something that’s easily avoidable, as the warnings are to not share anything sensitive in Gemini’s chats, which users should already know. Additionally, this code leak is also advising users against activating Gemini’s automations during emergencies. We’ll have to see where things actually go, as things can always change from this leak to what Google provides. One thing is for certain: this is an opt-in feature.
By
