Artificial Intelligence
··2 min read

Gemini Live Expands Visual Guidance and App Integrations

Gemini Live Expands Visual Guidance and App Integrations

  • Visual guidance overlays debut August 28 on Pixel 10, expanding to Android and iOS devices.
  • Gemini Live now integrates with Google Calendar, Keep, and Tasks, with Messages, Phone, and Maps coming soon.
  • New audio model introduces more natural, expressive speech and user-controlled accents.

Visual Overlays and Camera Sharing Arrive August 28

Google is enhancing its AI assistant, Gemini Live, with a suite of new features aimed at making it more visually aware and interactive. Beginning August 28, users of the new Pixel 10 will be able to access real-time visual guidance when sharing their camera. This feature overlays visual cues directly on the screen, allowing Gemini to highlight objects and provide context-sensitive assistance. For example, users can point their camera at two pairs of sneakers and Gemini will visually indicate which pair best matches their outfit, or identify the correct tool from a toolbox. The rollout to other Android devices will follow the Pixel 10 launch, with iOS support expected in the subsequent weeks.

Deeper Integration with Google Apps

Gemini Live is expanding its connections to core Google apps, aiming to streamline daily tasks within a single conversational interface. Starting immediately, integration with Google Calendar, Keep, and Tasks allows users to manage appointments, create reminders, and build shopping lists through natural dialogue. Additional integrations with Messages, Phone, and Maps are planned, enabling actions such as sending texts or making calls without leaving the conversation. For instance, users can discuss their schedule, set reminders, and even initiate calls or messages—all within Gemini Live.

Enhanced Speech and Expressiveness

Google is also updating Gemini Live’s audio capabilities, introducing a new model that delivers more expressive, natural speech. The improvements focus on intonation, rhythm, and pitch, aiming to create conversations that feel more human and responsive. In the coming weeks, users will be able to adjust Gemini’s speaking speed and choose from a variety of accents, further personalizing their interactions with the assistant.

Broader Vision for Everyday AI Assistance

Since its debut alongside the Pixel 9 at last year’s Made by Google event, Gemini Live has steadily expanded its language support and geographic reach. Google describes its long-term vision as making Gemini a “universal AI assistant”—one capable of understanding real-world context, managing tasks, and supporting daily routines across devices and applications. The latest updates reflect a push toward more seamless, multimodal assistance, blending voice, vision, and integration with the broader Google ecosystem.

Availability and Compatibility

The new visual guidance features will be available with the launch of the Pixel 10 on August 28, with a staged rollout to other Android and iOS devices. App integration updates are live today for Calendar, Keep, and Tasks, while support for Messages, Phone, and Maps will arrive in the coming weeks. Compatibility may vary by device and region.

Source: Techswire Aggregate (rss.app)