what you should Know
- Google is introducing software that allows users to detect unknown phishing/spam calls in real time, warning users to end the call before giving out personal information.
- Circle to search will now be able to solve complex math and physics problems by providing a step-by-step process and examples that help the user understand the concepts better.
- The already existing Talk Back feature will now be able to provide accurate descriptions of images shared by friends or family.
- Gemini is said to pop into other apps as and when needed and help users generate images that can be dropped into Gmail, Google Messages or other apps.
- The new Gemini 1.5 can also provide more information about YouTube videos when paused via “Ask this video”
AI took center stage at this year’s Google I/O, so much so that it was used 121 times during the entire presentation. With artificial intelligence now at the core of most Android devices and operating systems, here are some of the new updates that were discussed at this year’s event – specifically for Android users.
One thing that caught our eye at this year’s I/O, which is the most useful addition to Android phones, is the detection of phishing scams.
Google is introducing software that allows users to detect unknown phishing/spam calls in real time. They are currently testing a feature that uses the Gemini Nano to provide alerts during calls if it detects that the unidentified caller is using speech patterns associated with fraud.
Imagine a user receives a call from an unknown/private number asking to transfer funds as their checking account may be compromised, requiring personal information such as card numbers, PINs or passwords. Gemini will immediately show users a red warning sign on the phone’s screen that says “probably spam,” asking the user to end the conversation, along with a brief description of why Gemini thinks it might be a threat.
Google says the conversation is encrypted and private to the user. They will share more information for users to opt in “later this year.” This feature can be useful especially for older users or even children who may not be aware and get involved in numerous scams that have been doing the rounds.
We’ve all heard about the magic of AI with Search Circle ever since Samsung’s Unpacked event. Google says it’s not taking this further by having its language-learning model solve math or physics problems when prompted. This turns the feature into a personalized tutor that shows you how to solve a math problem and gives you examples from your everyday life to help you understand difficult physics concepts.
The tech giant says it will give users an answer to these text problems and a step-by-step explanation on how to solve them. The company is also teasing more upgrades coming later this year that will help students analyze and solve problems involving symbolic formulas, charts and graphs.
Image 1 on 2
Additionally, Google announced a faster Gemini 1.5 model, and with it, Android users will soon be able to bring up Gemini on top of any app. With AI built into Android phones, users can get creative by generating funny AI images and dropping them into various apps like Gmail and Google Messages, or even create memes to add to their chats.
With Ask This Video and Ask This PDF, users will be able to get more information about a YouTube video they’re watching or get answers about a PDF without having to scroll through pages of information.
While Google didn’t give us details on when we might see these tricks on our phones, we can expect them to roll out in the “next few months.”
Image 1 on 3
Finally, Gemini Nano and Multimodality will give more “powers” to the already existing TalkBack option. This means Android phones can process text with better understanding of sounds, sights and even spoken language.
TalkBack is a tool that helps people who are blind or have low vision by reading aloud accurate descriptions of what’s happening in an image, so an upgrade like this can be very helpful. For example, when an image of a dress is shared, the TalkBack option will describe the exact color of the dress, the length of the sleeves and other accessories that go with it, helping the user visualize the dress effectively without looking at it.
Google says these descriptions are generated in real-time and don’t need a network connection, as Gemini Nano will run directly on the user’s device.
Gemini Nano with multimodality will appear on Pixel phones later this year. However, it is not yet clear which models will receive this update. We’ll have to keep an eye out for these monthly updates to see when these new features start rolling out.
