en.Wedoany.com Reported - Google has officially launched the "Select from Screen" feature in the Chrome browser, aiming to enhance the context understanding and interaction response speed of its AI assistant, Gemini. This feature allows users to directly highlight specific text or images from a webpage and send them as conversational context to Gemini.

The "Select from Screen" feature addresses a major obstacle in previous AI interactions: users had to manually describe on-screen content. With this feature, Gemini can directly focus on the specific content the user wants to inquire about, eliminating the need for additional descriptions. Located in the "+" menu of Gemini within Chrome, the feature works similarly to a built-in screenshot tool. Once activated, users can select visible text or images from the current browser tab, and the selected content is automatically attached to Gemini's prompt.

Google has begun rolling out this feature as part of Chrome 149. Some users may need to restart their browser to see the feature. This update continues Google's efforts to transform Gemini from a standalone chatbot into an assistant that understands the user's current actions. This enhancement primarily removes interaction barriers. By enabling Gemini to precisely understand and directly interact with on-screen content, Google is pushing AI assistants toward evolving to understand context, anticipate intent, and assist in completing tasks.

The "Select from Screen" feature meets the modern user's need to frequently switch between reading content and searching for supplementary information. For example, when reading a technical article containing unfamiliar terms, users can simply highlight the word, and Gemini will provide an explanation directly, without needing to re-enter it. Context has become key to the evolution of AI assistants, and this feature fundamentally changes how users interact with Gemini, shifting from abstract questioning to contextually relevant queries based on what they see.

This announcement was released alongside other major Gemini upgrades on the same day. Developers can now directly use the "computer use" capability via Gemini 3.5 Flash. This capability allows AI agents to view, reason, and perform actions within browsers, mobile apps, and desktop environments without relying on separate models. Google stated that this integration enhances long-cycle tasks such as software testing, enterprise workflows, and other multi-step automation.

For everyday Chrome users, the "Select from Screen" feature means time savings. Students can highlight content from e-books or articles to obtain detailed explanations, professionals can select data from reports for quick analysis, and researchers can cite content for cross-verification. This feature demonstrates Google's commitment to more deeply integrating Gemini into its products, aligning with its strategy to make it a universal cross-platform assistant.

The "Select from Screen" feature also paves the way for more intuitive AI interactions. By eliminating unnecessary steps, it creates a smoother experience, marking a shift from a question-and-answer model to a collaborative one. The feature is still in the early stages of rollout and may not be immediately available to all users. Google has not disclosed whether the feature will appear on platforms other than the desktop version of Chrome. As this feature rolls out, competition in the AI assistant market intensifies. "Select from Screen" is expected to become a significant differentiator against competitors.

This article is compiled by Wedoany. All AI citations must indicate the source as "Wedoany". If there is any infringement or other issues, please notify us promptly, and we will modify or delete it accordingly. Email: news@wedoany.com