Google I/O on May 14 2024 | Latest Android 15 with AI

Google I/O 2024 May 14 Confirmed

Google has officially set the stage for its 2024 iteration of the highly anticipated developer conference, Google I/O, scheduled for May 14. As the tech giant gears up to unveil a series of updates and new products, here’s everything we know so far about what to expect.

Gemini AI Enhancements

Google has been actively enhancing its AI capabilities across various domains. Here are some recent enhancements and initiatives:

1. Language Models: Google has developed advanced language models like BERT, GPT-3, and the more recent LaMDA (Language Model for Dialogue Applications), which are designed to improve natural language understanding and conversational AI.

2. MUM (Multitask Unified Model): MUM is a new AI model that can understand complex queries and provide comprehensive answers. It can handle multiple tasks simultaneously, such as text understanding, image processing, and multilingual capabilities.

3. Google Cloud AI: Google has been expanding its AI and machine learning services on Google Cloud. These services include AutoML, which allows developers to train high-quality models with minimal effort, and Vertex AI, which is an end-to-end platform for managing machine learning workflows.

4. AI in Search: Google continuously enhances its search algorithms with AI to provide more accurate and relevant search results. This includes understanding user intent better, improving voice search, and integrating more visual and video content in search results.

5. Healthcare AI: Google Health uses AI to improve healthcare outcomes. This includes developing tools for diagnosing diseases, predicting patient outcomes, and managing healthcare data securely and efficiently.

6. Responsible AI: Google emphasizes ethical AI development and has initiatives focused on fairness, accountability, and transparency in AI systems. This includes developing guidelines and tools to ensure AI systems are unbiased and inclusive.

7. AI in Products: Google's AI enhancements are also integrated into its products like Google Assistant, Google Photos, and Gmail. These enhancements improve user experience through features like smart replies, photo recognition, and predictive text.

8. Quantum AI: Google is investing in quantum computing with the aim of solving complex problems faster than classical computers can. This involves developing quantum processors and algorithms that can be used for tasks like optimization and simulation.

Generative Media Models

• Imagen 3 is our highest quality text-to-image model. It generates an incredible level of detail, producing photorealistic, lifelike images, with far fewer distracting visual artifacts than our prior models.

• Veo generates high-quality 1080p resolution videos in a wide range of cinematic and visual styles that can go beyond a minute. With an advanced understanding of natural language and visual semantics, it generates video that closely represents a user’s creative vision — accurately capturing a prompt’s tone and rendering details in longer prompts. 

• We’ll also bring some of Veo’s capabilities to YouTube Shorts and other products in the future.

• We added in more editorial controls to ImageFX — a top feature request from the community — so you can add, remove or change elements by simply brushing over your image.

• ImageFX will also use Imagen 3 to unlock more photorealism with richer details and fewer visual artifacts and more accurate text rendering.

• VideoFX, our newest experimental tool that uses Google DeepMind’s generative video model, Veo, and lets you turn an idea into a video clip.

•  It also comes with a Storyboard mode that lets you iterate scene by scene and add music to your final video.

Ask Photos: A new way to search your photos with Gemini

Google Photos was one of the first products we built with AI at the center, giving you the ability to search your photos and videos for people, pets, places and more. Now we're giving Google Photos a major upgrade with Gemini, our most capable AI model. With Ask Photos, our newest experimental feature rolling out over the coming months, it’s even easier for you to look for a specific memory or recall information included in your gallery. 

• A new experimental feature in Google Photos called Ask Photos makes it even easier to look for specific memories or recall information included in your gallery. The feature uses Gemini models, and it’s rolling out over the coming months.

•  You can also use Ask Photos to create a highlight gallery from a recent trip, and it will even write personalized captions for you to share on social media.

Gemini for Google Workspace

Starting today, Gemini in the side panel of Gmail, Docs, Drive, Slides and Sheets will use Gemini 1.5 Pro. With a longer context window and more advanced reasoning, Gemini can answer a wider variety of questions and provide more insightful responses. it's easy to get started with summaries that will appear in the side panel, suggested prompts and more.

• Gmail’s mobile app will soon use Gemini for two other new features: Contextual Smart Reply and Gmail Q&A.

• You’ll be able to use Gmail’s side panel to summarize emails to get the most important details and action items.

• Summarize emails:
• Contextual Smart Reply
• Gmail Q&A

Android advancements

Google has confirmed a session called ‘What’s new in Android' where the tech giant says it will detail its plans about Android 15, latest in android development covering generative AI, form factors, compose, performance and more.

• We announced that Circle to Search is currently available on more than 100 million Android devices, and we’re on track to double that by the end of the year.

• Coming to Android 15 this year, private space lets you create a separate space with an extra layer of authentication, keeping your sensitive apps secure and away from prying eyes. It’s like a digital safe within your phone for the apps you don’t want others to easily access or see.

• Theft Detection Lock uses powerful Google AI to sense if your device has been snatched and quickly lock down your information on your phone.

• Under the hood, Android 15 brings numerous efficiency improvements to optimise app performance and battery life. Foreground services now have a 6-hour limit on dataSync and media processing, pushing them to the background after the time limit to conserve power. The introduction of 16KB page support reduces power draw during app launch and improves camera app opening speed.

• Soon, you’ll be able to use Gemini on Android to create and drag and drop generated images into Gmail, Google Messages and more, or ask about the YouTube video you’re viewing.

• If you have Gemini Advanced, you’ll also have the option to “Ask this PDF” to get an answer quickly without having to scroll through multiple pages.

• We showed off how augmented reality content will be available directly in Google Maps, laying the foundation for an extended reality (XR) platform we’re building in collaboration with Samsung and Qualcomm for the Android ecosystem.

Wear OS 5

Google has also listed a session called ‘Building for the future of Wear OS’ and the confirmed that it is indeed going to unveil the latest Wear OS operating system during the I/O 2024 event. The latest Google operating system for smartwatches is touted to include ‘advances in Watch Face Format, and how to design and build for the increasing range of device sizes.

Pixel 8a

The Google Pixel 8a is said to pack a slightly underclocked version of the Tensor G3 chipset backed by the Mali-G715 GPU. While Google’s in-house developed chipset may not beat the Snapdragon 8 Gen 3 in terms of raw performance, we noted in our Pixel 8 review that it blazes through everyday tasks without lags or stutters.

Android TV OS

Google has also listed out an event especially dedicated to the new enhancements in Android TV and Google TV, suggesting that the platforms might be getting a much needed upgrade at this year's I/O event.

Introducing to Search

Our phones are a window to the world’s information — whether it’s to explore a passion, solve a problem, buy the perfect gift, learn a new skill or simply find a reason to smile. And when you’re truly immersed in a moment of discovery or exploration, it can feel disruptive to stop what you’re doing and switch to another app to learn more. That’s why we’re introducing Circle to Search, a new way to search anything on your Android phone without switching apps. Now, with a simple gesture, you can select what you’re curious about in whatever way comes naturally to you — like circling, highlighting, scribbling or tapping — and get more information right where you are.