News
Google Expands AI Search to Help Students with Images, Documents
Google is rolling out new artificial intelligence features for its search engine that let users upload images and documents for analysis, targeting students preparing for the upcoming school year. The search giant said Monday it is bringing image analysis capabilities to desktop computers, matching functionality already available on mobile devices. Users can now upload photos and ask questions about their content through Google's AI Mode.
Desktop support for PDF document uploads will follow within weeks, the company said. Students could upload lecture slides or academic papers and ask the AI system follow-up questions about the material.The AI analyzes uploaded content and combines it with web-based information to generate responses with source citations. Google said the features are launching initially in the United States.
The company plans to expand support to additional file formats, including documents stored in Google Drive, though it did not provide a timeline for those additions. The new capabilities represent Google's latest effort to integrate AI more deeply into its core search product as competition intensifies with Microsoft Corp.'s AI-powered Bing and other search alternatives.
Google introduced AI Mode earlier this year as part of a broader push to transform how users interact with its search engine through conversational AI interfaces.
Canvas for Organization
The new Canvas feature in AI Mode assists with planning and organizing information. Users can create study plans or other projects, with AI Mode populating a dynamic side panel that updates with refinements. The upcoming upload feature will enable customization with context from files like class notes. Canvas projects can be revisited across sessions.
This feature is also rolling out "in the coming weeks" to users in the AI Mode Labs experiment in the U.S., accessible via a "Create Canvas" option when planning is requested.
Real-time Assistance with Search Live
Search Live with video input is being introduced, incorporating capabilities from Project Astra. This feature allows users to engage in real-time, back-and-forth conversations with Search in AI Mode, utilizing live camera feed for visual context. It integrates with Google Lens.
To use it, users open Lens in the Google app, tap the Live icon, and ask questions while pointing their camera. Search Live with video input is rolling out "this week" on mobile in the U.S. for users in the AI Mode Labs experiment.
Browse Integration with Lens in Chrome
Google Lens in Chrome and AI Mode will allow users to search and learn about content on their desktop screen, including websites and PDFs. Soon, clicking the Chrome address bar will present an option to "Ask Google about this page."
Users can select a specific element, such as a diagram, to receive an AI Overview in the side panel. This week, users will be able to ask follow-up questions through AI Mode by selecting AI Mode at the top of Lens search results or via a "Dive deeper" button at the bottom of the AI Overview.
Back to School
A Google exec characterized the new features as being "just in time for the back-to-school season."
"Whether you're a student, a parent or an educator -- or just wrapping up a busy summer -- AI Mode can help you explore complex questions and discover high-quality information from across the web. To get started today on desktop, look for the new AI Mode button on the Google homepage," the company said in a blog post.
About the Author
David Ramel is an editor and writer at Converge 360.