Home » Technology » Artificial Intelligence » Google introduces new Gemini features

Google introduces new Gemini features

Google has now introduced two fundamental innovations for its AI: Firstly, owners of the new Pixel 9 series can look forward to a variety of AI-supported functions, and secondly, Gemini Live is launching a “natural” way to communicate with the AI.

AI ensures greater accessibility

In addition, the newly introduced AI functions include improvements to the accessibility of the devices. The AI ​​allows for simplified operation if the user needs support due to physical limitations. Google has already provided details on this in a new Blog post explains. Google showed off some pretty impressive AI-powered accessibility features in the live demo that are designed to help people better use their Pixel devices regardless of their physical abilities or limitations. But these new features are of interest to everyone because they show what Google is now making possible.

Guided Frame: Perfect selfies for everyone

The first new feature is Guided Frame, which is designed to help blind and visually impaired users take great selfies. Guided Frame gives spoken suggestions to improve the image, such as positioning the face correctly, choosing the optimal angle or finding a better-lit spot. The latest update improves object detection, face filtering in group photos and focusing on subjects. Another advantage: Guided Frame can now be launched directly from the Camera app without having to use Android’s native TalkBack screen reader.

Magnifier: Enlarge the world

The Magnifier is a Pixel-exclusive app that will be available starting with the Pixel 5. The app uses the camera to magnify objects in the environment. With the latest improvements, the Magnifier app can now search for specific words – useful when reading menus in restaurants, for example – and select the best lens for certain scenarios. The app also supports picture-in-picture format and can be used as a lighted mirror for selfies.

Live Transcribe Mode

The new foldable phones, including the Pixel 9 Pro Fold, now have Live Transcribe mode. This feature allows users to place their foldable device on the table so that everyone can join the conversation while the transcriptions are clearly visible.

Advanced language support

Finally, Live Caption and Live Transcribe have been enhanced with additional language support. Live Caption now supports Korean, Polish, Portuguese, Russian, Chinese, Turkish, and Vietnamese. Live Transcribe’s offline mode is now available in 15 languages, while its online mode supports over 120 languages. These enhancements are especially useful in areas with poor network coverage – or when mobile data is low.

Google unveils new AI features of Gemini

At the recent Pixel hardware event, Google unveiled new features for smartphones that use the AI ​​assistant Gemini. One of the key announcements was Gemini Live, a feature that enables an enhanced conversational experience with the AI ​​chatbot.

Gemini Live: Seamless conversations

Gemini Live allows you to pause conversations with the chatbot and continue later or focus on specific points. Gemini Live is also available as a hands-free function, so users can continue talking even when the phone is locked. Starting today, the function is available in English for Android devices, provided users have subscribed to Gemini Advance. A version for iOS and other languages ​​is planned. Google has also added ten different voices for Gemini Live.

Extensions for YouTube Music, Keep, Tasks and more

In the coming weeks, Google will release more Gemini extensions for YouTube Music, Keep, Tasks and Utilities. A new calendar feature allows users to take a photo of a concert flyer and ask Gemini if ​​they’re available that day.

Gemini on Android

Google plans to integrate even more Gemini features into Android. Users can activate the AI ​​assistant by long-pressing the power button or saying “Hey Google.” With “Questions about this screen,” users get contextual help about what’s on their screen. Gemini’s new features show how Google is continuing to advance the use of AI. With Gemini Live, planned extensions, and deep integration into Android, Google may offer an innovative solution. What do you think of the new features?

Leave a Reply