Google is bringing a new live view feature to its Gemini apps on iOS and Android, allowing users to live stream their surroundings to Gemini to get feedback on what they’re seeing. Integration is rolling out starting today.

In a demo, Gemini identified objects that the user was looking at, corrected wrong assumptions about what an object was, and provided context by answering questions. Gemini’s live view can identify objects in real-time, provide assistance with DIY or home improvement projects, help organize spaces, assist with shopping, and more.

You can also share your iPhone or iPad screen with Gemini to get feedback on something that you see online.

Gemini’s Live option could be helpful for those who are blind or who have low vision, as it can provide a live vocal feed of a person’s surroundings. Live is built on Project Astra, which Google previewed at I/O last year, and it previously rolled out to Pixel devices.

This summer, Google also plans to add personal context to Gemini for features like Gmail’s smart reply. Gemini will be able to use relevant information across Google apps to provide a more personalized experience. For example, the AI reply feature in Gmail can sound like you, rather than having a generic voice. It is able to scan past emails to match tone, style, and word choice, plus it can look up notes, documents from Google Drive, and more to add context to emails.

Popular Stories

Apple’s CarPlay Ultra Is Here – Does Your iPhone Support It?

Apple’s recently announced CarPlay Ultra promises a deeply integrated in-car experience, but not all iPhone users will be able to take advantage of the new feature.
According to Apple’s press release, CarPlay Ultra requires an iPhone 12 or later running iOS 18.5 or later. This means if you’re using an iPhone 11, iPhone XR, or any older model, you’ll need to upgrade your device to access…

Apple’s ‘CarPlay Ultra’ Experience Now Available

Apple today announced that its next-generation CarPlay experience, now dubbed “CarPlay Ultra” begins rolling out today, starting with Aston Martin vehicles.
Subscribe to the MacRumors YouTube channel for more videos.
CarPlay Ultra is now available with new Aston Martin vehicle orders in the U.S. and Canada. It will also be available for existing models that feature the brand’s next-generation …

iPhone 17 Air Battery Capacity and Weight Allegedly Revealed

Apple is expected to launch an all-new ultra-thin iPhone 17 Air later this year, and while there have been plenty of rumors about the camera’s overall design and thinness, we haven’t heard any details about the device’s weight and battery capacity until now.
According to the leaker going by the account name “yeux1122” on the Korean-langauge Naver blog, the 6.6-inch iPhone 17 Air has a weight …

Apple Says These Vehicle Brands Plan to Offer All-New CarPlay Ultra

Apple today announced the launch of CarPlay Ultra, the long-awaited next-generation version of its CarPlay software system for vehicles.
CarPlay Ultra features deep integration with a vehicle’s instrument cluster and systems, built-in Radio and Climate apps, customizable widgets, and more. The interface is tailored to each vehicle model and automaker’s identity, and drivers can also adjust…

Apple Will Reportedly Be More Cautious About Announcing New Features Well in Advance

Apple plans to mostly stop announcing new features more than a few months before they are ready to launch, according to Bloomberg’s Mark Gurman and Drake Bennett. The pair of reporters revealed this noteworthy tidbit towards the bottom of a lengthy report about Apple’s artificial intelligence shortcomings today.
This alleged change in strategy comes after Apple was forced to delay its more…

Report: Apple’s Next-Gen Version of Siri Is ‘On Par’ With ChatGPT

Apple has big plans to improve Siri over the next few years, Bloomberg’s Mark Gurman and Drake Bennett report.
Some Apple executives are now reportedly pushing to turn Siri into a true ChatGPT competitor. A next-generation, chatbot version of Siri has reportedly made significant progress during testing over the past six months; some executives allegedly now see it as “on par” with recent…