Based on what we know so far, this is shaping up to be a hours-long launch event chock full of announcements. If you can't watch Google's I/O 2024 keynote for that much time, or prefer a text-and-images approach, we've got the liveblog for you. Our reporters Karissa Bell and Sam Rutherford will be at Shoreline Amphitheater to bring you the news live, with backup from the entire Engadget home team. Come back around 12pm ET on May 14th to hang with us as we cover all the updates from Google I/O 2024!
LIVE COVERAGE IS OVER129 updates
Gemini will be accessible in the side panel on Google apps like Gmail and Docs
Google is adding Gemini-powered AI automation to more tasks in Workspace. In its Tuesday Google I/O keynote, the company said its advanced Gemini 1.5 Pro will soon be available in the Workspace side panel as “the connective tissue across multiple applications with AI-powered workflows,” as AI grows more intelligent, learns more about you and automates more of your workflow.
Thanks for joining us. We're off to try and get a closer look at some of the things Google announced today at I/O.
Oh, and that Sundar bumped that final AI count up one more time to 121.
Who wants to bet if Google will top that next year?
Cherlynn Low
Frankly I'm just glad it didn't last any longer than that. While Sam and Karissa go and check out whatever demos might be available at I/O 2024, come on over and join myself and senior reviewer Devindra Hardawar on Engadget's YouTube channel. I'm sure you have thoughts and feelings to share on everything Google just announced!
Karissa Bell
And that's a wrap on the keynote, it was *just* under 2 hours of all things Gemini and AI.
Sam Rutherford
Karissa Bell
120 mentions of "AI" in this keynote, according to Sundar (who just came back onstage) and Gemini. I actually would have guessed a bit higher.
Sam Rutherford
Karissa Bell
Google, like most of its AI peers, plans to use watermarking to increase transparency around AI-generated content with SynthID. Those watermarks will be expanding to AI-generated video (remember those Veo demos from earlier?) and text, which is especially interesting because AI-generated text is so much more prevalent (and in some ways harder to detect than images or video).
Sam Rutherford
SynthID is a tool that Google is making so that it's easy detect AI-generated content. But it also sounds like something from the Blade Runner universe that people can use to detect replicants.
Karissa Bell
We're getting into "building AI responsibly" portion, with a look at Google's approach to red-teaming, the process for looking for threats, "problematic" outputs and other issues that might cause problems for Google (and maybe the rest of us). After the fiasco with Gemini's image generator earlier this year, I'm actually surprised they waited this long to bring all this up.
Sam Rutherford
Sam Rutherford
So it appears we've reached the developer-focused section of the I/O keynote. Karissa and I were just talking about how for non-developers, it can be hard to contextualize the amounts of tokens available in various Gemini plans.
Karissa Bell
We're getting a deeper dive into Gemini Flash, which we first heard about at the top of the keynote. Flash is the "lighter weight" Gemini model that has lower latency and is more efficient. It sounds like this is meant for developers and organizations that don't need the full power of Gemini 1.5 Pro but still want to take advantage of multimodal capabilities.
Sam Rutherford
Yea, I think the scam alert feature is really nice, because it can give you a gut check in real-time when you might be feeling that a call feels a little sus.
Google Gemini can power a virtual AI teammate with its own Workspace account
Google's Gemini AI systems can do a lot, judging by today's I/O keynote. That includes the option to set up a virtual teammate with its own Workspace account. You can configure the teammate to carry out specific tasks, such as to monitor and track projects, organize information, provide context, pinpoint trends after analyzing data and to play a role in team collaboration.
Josh Woodward is back to talk about various Gemini models available to developers.
Karissa Bell
Google has another solution to the never-ending scam calls. If you pick up, and it detects that the call is "suspicious" or a likely scam, it can surface a big alert right on your phone, potentially saving you from buying thousands of dollars of gift cards or transferring funds to a rogue account. A lot of those scams seem obvious, but people still fall for them and this might help.
Sam Rutherford
Sam Rutherford
Like, will we ever see the day where you're allowed to bring a phone to take the SATs? Because if not, you're potentially giving students an aid they might not being able to use during important evaluations, which might end up being a disadvantage.
Sam Rutherford
Karissa, I think Circle to Search supporting formulas is weird because for older types like us (or at least me), it feels like cheating.
Karissa Bell
I hate searching for something and getting a 5-minute YouTube video as a result so being able to "ask this video" instead is something I could definitely see myself using. I wonder if you still have to watch the pre-roll?
Sam Rutherford
Sam Rutherford
Karissa Bell
I understand why it would be helpful for Google to help with homework questions but there's something that still feels a bit off about encouraging students and parents to punt homework help over to Google's AI.
Sam Rutherford
OK, sidenote: They showed a photo of someone searching for Fly by Jing sauce. That stuff is great.
Karissa Bell
We've finally started the Android portion of the keynote. Wow, Gemini is "becoming the new AI assistant on Android" so I guess Google Assistant is dead?
Sam Rutherford
Sam Rutherford
Oh no, we've hit the musical interlude for Google I/O.
Google's new scam detection tools provide real-time alerts during phone calls
Google just announced forthcoming scam detection tools coming to Android phones later this year, which is a good thing as these scammers keep getting better and better at parting people from their money. The toolset, revealed at Google I/O 2024, is still in the testing stages but uses AI to suss out fraudsters in the middle of a conversation.
I agree. I experimented with using chatGPT and other AI tools to plan an itinerary last summer and it was a bit ... rough. If anything, it was more of a starting place than an actual solution, especially because several of its suggestions were straight-up hallucinations! Maybe Gemini will do better,
Sam Rutherford
Sam Rutherford
Now Sissie is talking about planning a trip with Gemini, and I feel like vacations are too expensive to trust an AI to plan. It's going to take some time for people to feel comfortable with letting AI take the wheel like this.
Karissa Bell
Gemini's app is getting a new "Live" feature that brings in the Project Astra tech we saw early in the keynote. It can speak and respond to voice commands and use your phone's camera for input.
Sam Rutherford
The tech might be there, but I really don't think humans are ready for AI co-workers. Can you even imagine people who struggle with email trying to talk to smart chatbots in Slack?
Google's Gemini Nano brings better image-description smarts to its TalkBack vision tool
The Google I/O event is here, and the company is announcing lots of great updates for your Android device. As we heard earlier, Gemini Nano is getting multimodal support, meaning your Android will still process text but with a better understanding of other factors like sights, sounds and spoken language. Now Google has shared that the new tool is also coming to it's TalkBack feature.
TalkBack is an existing tool that reads aloud a description of an image, whether it's one you captured or from the internet. Gemini Nano's multimodal support should provide a more detailed understanding of the image.
Chip is essentially an AI coworker.. it can analyze shared documents, schedule meetings and track projects across your company's workspace. It sounds like organizations will be able to customize their own versions of Chip to suit their needs.
Google builds Gemini right into Android, adding contextual awareness within apps
Google just announced some nifty improvements to its Gemini AI chatbot for Android devices as part of the company’s I/O 2024 event. The AI is now part of the Android operating system, allowing it to integrate in a more comprehensive way.
The coolest new feature wouldn’t be possible without that integration with the underlying OS. Gemini is now much better at understanding context as you control apps on the smartphone. What does this mean exactly? Once the tool officially launches as part of Android 15, you’ll be able to bring up a Gemini overlay that rests on top of the app you’re using. This will allow for context-specific actions and queries.
Android's Circle to Search can now help students solve math and physics homework
Google has introduced another capability for its Circle to Search feature at the company's annual I/O developer conference, and it's something that could help students better understand potentially difficult class topics. The feature will now be able to show them step-by-step instructions for a "range of physics and math word problems." They just have to activate the feature by long-pressing the home button or navigation bar and then circling the problem that's got them stumped, though some math problems will require users to be signed up for Google's experimental Search Labs feature.
We're officially one hour into this keynote, by the way, and still no love for Android. I know there will be plenty of time for Android updates later on, but it says a lot about how far Google's priorities have shifted, it wasn't that long ago that Android was the star of I/O. Now, it feels almost like an afterthought.
Sam Rutherford
Though I guess that's sort of skipping ahead of where AI is at right now.
Sam Rutherford
But I have to wonder if this role might be better served by an AI agent that would do these same things with potentially even less manual input.
Sam Rutherford
Yea, I'm not going to lie, the ability of AI's to summarize things is nice, but it feels like the lowest rung of its capabilities. So it's good to see how things are evolving with contextual replies and carrying over data between various apps like Gmail, Calendar, etc.
Karissa Bell
Gemini is going to power some interesting new features in the Gmail app, including summaries of long email threads. You'll also be able to chat with Gemini directly to find details from throughout your inbox. There are also new reply suggestions that can understand the context of your emails for (hopefully) more useful text suggestions. I've never been particularly impressed with Gmail's auto-suggestions but maybe Gemini will make them actually useful.
Sam Rutherford
Sam Rutherford
Yea, making all this work in the real world isn't something you can just snap your fingers and voila. But down the line it almost makes me wonder if humanity's role going forward might be to just fact-check whatever army of AI agents you have at your disposal.
Karissa Bell
Okay, this actually seems pretty useful. Search is getting video recognition capabilities so you can search based on the contents of a video, which could be particularly helpful when you need to fix something or answer a question you can't easily describe. Google will be able to understand what's in the clip and (hopefully) surface relevant results.
Google's Gemini will search your videos to help you solve problems
As part of its push toward adding generative AI to search, Google has introduced a new twist: video. Gemini will let you upload video that demonstrates an issue you're trying to resolve, then scour user forums and other areas of the internet to find a solution.
As an example, Google's Rose Yao talked onstage at I/O 2024 about a used turntable they bought and how they couldn't get the needle to sit on the record.
Smart scales can make it easier for you to keep track of your weight and overall health over time. These are our favorite smart scales on the market right now.
Logitech's first branded control panel is the MX Creative Console, a $200 device that includes a keypad, dialpad and plugins for popular Adobe apps like Premiere Pro.
Amazon Music Unlimited is free for three months to those who haven't used it before. Prime members who are newcomers to the service get an additional month of access at no extra cost.
Tales of the Shire: A The Lord of the Rings Game is now due out in March 2025. The cozy sim blends Animal Crossing, Stardew Valley and other titles in the genre.
Sony has announced that its next State of Play stream will take place on September 24 at 6PM ET. The company plans to shine the spotlight on more than 20 PS5 and PS VR2 games during the stream, which is set to run for over 30 minutes.
Meta Connect is right around the corner. Here's how to watch Mark Zuckerberg discuss advancements in mixed reality, AI and wearables, possibly including AR smart glasses and a cheaper version of the Quest 3.