News
Google Expands AI Search Capabilities to Desktop Users
Google introduced expanded artificial intelligence features for its Search platform, bringing image analysis and document querying capabilities to desktop users as students prepare for the new academic year.
The search giant now allows desktop users to upload and ask questions about images through AI Mode, matching functionality previously limited to mobile Android and iOS applications. Desktop support for PDF document uploads will follow within weeks, enabling users to submit files such as lecture notes or academic materials for AI-powered analysis and questioning.
The AI system examines uploaded content and correlates it with web-based information to generate responses with source citations. Google said the desktop rollout begins in the United States, with plans to support additional file formats including Google Drive documents in future updates.
The new Canvas feature in AI Mode assists with planning and organizing information. Users can create study plans or other projects, with AI Mode populating a dynamic side panel that updates with refinements. The upcoming upload feature will enable customization with context from files like class notes. Canvas projects can be revisited across sessions.
This feature is also rolling out "in the coming weeks" to users in the AI Mode Labs experiment in the U.S., accessible via a "Create Canvas" option when planning is requested.
Search Live with video input is being introduced, incorporating capabilities from Project Astra. This feature allows users to engage in real-time, back-and-forth conversations with Search in AI Mode, utilizing live camera feed for visual context. It integrates with Google Lens.
To use it, users open Lens in the Google app, tap the Live icon, and ask questions while pointing their camera. Search Live with video input is rolling out "this week" on mobile in the U.S. for users in the AI Mode Labs experiment.
Google Lens in Chrome and AI Mode will allow users to search and learn about content on their desktop screen, including websites and PDFs. Soon, clicking the Chrome address bar will present an option to "Ask Google about this page."
Users can select a specific element, such as a diagram, to receive an AI Overview in the side panel. This week, users will be able to ask follow-up questions through AI Mode by selecting AI Mode at the top of Lens search results or via a "Dive deeper" button at the bottom of the AI Overview.
A Google exec characterized the new features as being "just in time for the back-to-school season."
"Whether you're a student, a parent or an educator -- or just wrapping up a busy summer -- AI Mode can help you explore complex questions and discover high-quality information from across the web. To get started today on desktop, look for the new AI Mode button on the Google homepage," the company said in a blog post.
About the Author
David Ramel is an editor and writer at Converge 360.