Google has released a functional update for Android mobile OS and Pixel devices. The developers have improved the video subtitle generation tool, updated the Lookout application, and also added several AI functions based on the Gemini 1.5 neural network. All innovations will be available to owners of devices with Android 15, but some functions will also appear in smartphones with older versions of the software platform.
Image source: Google
The developers have improved the Lookout application, with which people with visual impairments can receive audio descriptions of various objects and photographs. Google has integrated the Gemini 1.5 neural network into the application, allowing users to receive better and more detailed descriptions of photos taken or opened using Lookout. This innovation marks the latest step in Google’s efforts to integrate more AI features into the Lookout app, which the company announced at its I/O conference earlier this year.
The Android update will bring with it improved subtitles for videos. Now, in addition to transcribing speech, subtitles will display accompanying sounds and emotions, such as applause or sighs. This innovation applies to the entire Android system and will be available wherever it is possible to activate the subtitle function.
Google continues to develop its new AI assistant, Gemini Assistant. This time it gets a Spotify extension that allows you to play audio from the music service through Gemini. When Gemini Assistant debuted, it lacked support for some basic features, such as playing music from Spotify. Now that will change, and the new AI assistant will become more similar to the standard Google Assistant, which has been able to play audio from Spotify for several years. Gemini will also have access to the Utilities extension, allowing the AI assistant to perform more actions on behalf of the user, such as making calls, sending emails and changing device settings.
Other notable features in the update include the ability to create stickers using Emoji Kitchen inside Gboard, the ability to share photos using a QR code in Quick Share, and an improved tool for scanning receipts and other documents in Google Drive. All the features mentioned will be available on devices running Android 15, but some of them will also appear on older versions of the OS.
The December update will bring a few more innovations to Pixel smartphones. In addition to these features, Google smartphone owners will be able to use the improved incoming call screening feature. While the caller is talking to the voice assistant, the user will be able to join the conversation to answer questions asked by the caller on behalf of the assistant, without accepting the call. The developers have also updated the Screenshots app, improving the Circle to Search feature and adding the ability to save search results in the app.