Click to Do: do more with what’s on your screen

System requirements

A Copilot+ PC that has Recall enabled

• You don’t have to save snapshots for Recall to use Click to Do

The more intelligent text actions are available only on Snapdragon-powered Copilot+ PCs today when your language is set to English with support for AMD and Intel-powered Copilot+ PCs coming soon. 

Click to Do does more with text

When you highlight text with Click to Do, you’re given the following options:  

• Copy: Copies the selected text to the clipboard.

• Open with: Opens the selected text in a text editor like Notepad.

• Search the web: Does a search for the selected text using your default browser and search engine.

More intelligent text actions, powered by the Phi Silica small language model and the NPU, are available if your default language is set to English and include:

• Summarize: Briefly outlines the main points of the selected text

• Rewrite (Casual): Revises the selected text using a casual tone

• Rewrite (Formal): Revises the selected text using a formal tone

When the highlighted text is an email address, you can either copy the text or Send email.

• Send email: Uses your default email app to open a new email to the selected email address

When the highlighted text is a website, you can either copy the text or Open website.

• Open website: Opens the selected website in your default browser

Click to Do does more with images

If you select an image you’re given the following options:

• Copy: Copies the image to the clipboard

• Save as: Save the image to a specified location

• Share: Opens the share files option for the image file

• Open with: Open the image with an app such as Photos, Snipping Tool, or Paint

• Visual search with Bing: Does a visual search using Bing using your default web browser

• Blur background with Photos: Blur the background with the Photos app

• Erase objects with Photos: Erase unwanted objects in the image with the Photos app

• Remove background with Paint: Remove the background of the image with Paint

​​​​​​​​​​​​​​

How to use Click to Do

Simply use Windows logo key  +  mouse click or Windows logo key + Q to enter Click to Do and take actions on what you clicked. You can also enter Click to Do by through the Snipping Tool menu if Snipping Tool is installed. If you ever need, you can also search for Click to Do from Windows Search to select and take actions on what you see. 

Click to Do privacy considerations  

When you choose to send info from Click to Do to an app, like Paint, Click to Do will temporarily save this info in order to complete the transfer. Click to Do creates a temporary file in the following location: 

• C:\Users\{username}\AppData\Local\Temp

Temporary files may also be saved when you choose send feedback. These temporary files aren’t saved long term. Click to Do doesn’t keep any content from your screen after completing the requested action, but some diagnostic data is gathered to keep Click to Do secure, up to date, and working.

Click to Do’s more intelligent text actions, including Summarize, Rewrite (Casual), and Rewrite (Formal), are powered by a state-of-the-art small language model called Phi Silica. Phi Silica leverages the NPU and the language model runs locally on Copilot+ PCs. Phi Silica ships inbox with Windows on Copilot+ PCs. 

When a user clicks on the Click to Do text actions, the selected text and the chosen action are sent to Phi Silica as part of a prompt. Phi Silica intelligently rewrites the selected text as per the user's request and streams back the response from the model. Phi Silica provides responses quickly and efficiently, using very little power. For more information, see Phi Silica, small but mighty on-device SLM. 

While Phi Silica runs locally, Click to Do’s more intelligent text actions also leverage the power of Microsoft’s secure cloud to improve your text results by ensuring prompts and responses are safe and appropriate. When a text action is selected, the highlighted text is sent to Microsoft’s secure cloud. This data is automatically deleted. For more information about privacy for Click to Do, see the Microsoft Privacy Statement.

Microsoft’s commitment to responsible AI and Privacy

 
Microsoft has been working to advance AI responsibly since 2017, when we first defined our AI principles and later operationalized our approach through our Responsible AI Standard. Privacy and security are core principles as we develop and deploy AI systems. We work to help our customers use our AI products responsibly, sharing our learnings, and building trust-based partnerships. For more about our responsible AI efforts, the principles that guide us, and the tools and capabilities we've created to assure that we develop AI technology responsibly, see Responsible AI.

Click to Do uses optical character recognition (OCR) on your PC to detect text entities on screenshots. For more information about OCR, see Transparency note and use cases for OCR. 

Click to Do’s intelligent text actions use a small language model called Phi Silica. For more information on Phi Silica, see Get started with Phi Silica in the Windows App SDK. For information on the Responsible AI principles guiding Phi Silica deployment and the safety measures in place when using generative language models, please see Responsible Generative AI Development on Windows. 

Click to Do’s models have undergone fairness assessments, alongside comprehensive responsible AI, security and privacy assessments, to make sure the technology is effective and equitable while adhering to Microsoft’s Responsible AI best practices.