Google is introducing groundbreaking real-time AI capabilities in Gemini, allowing users to analyze their surroundings using their device’s camera or screen. These new features, part of Project Astra, were initially showcased last year and are now rolling out to select users.
A Reddit user recently shared a video demonstrating the Gemini Live feature, which enables real-time, natural language interactions with the AI assistant. Google later confirmed to The Verge that the rollout had begun, starting with Gemini Advanced subscribers under the Google One Premium plan on Android.
At the Mobile World Congress in Barcelona, Google announced that features such as live video analysis and screen sharing would soon be available. These advancements build upon Google’s December updates to Project Astra, which enhanced dialogue quality, reduced response latency, improved memory functions, and enabled external tool integration. The introduction of Multimodal Live API with Gemini 2.0 further allows real-time screen reading and interactive assistance.
This move puts Google in direct competition with OpenAI, which already offers a real-time camera feature for ChatGPT Plus and Pro subscribers.
In addition to these AI upgrades, Google has launched Audio Overviews for Gemini, leveraging NotebookLM capabilities to provide AI-powered summaries. The Gemini 2.0 Flash model now also includes native image generation and editing.
Also Read: Milind Sharma returns to Delhivery to lead rapid commerce & D2C expansion
On the AI model front, Google has unveiled Gemma 3, the latest version of its open-weight AI family. Notably, Gemma 3 27B outperformed competitors like DeepSeek-V3, OpenAI’s o3-mini, and Meta’s Llama 3-405B in the Chatbot Arena, a platform where models are benchmarked through human-led evaluations.
These advancements highlight Google’s commitment to staying at the forefront of AI innovation, offering cutting-edge solutions for real-time assistance, multimodal interaction, and creative AI applications.
Source: https://cio.eletsonline.com/
