How Screen Copilot Works

Get started in seconds with our simple three-step process. No complex setup, no technical knowledge required.

1

Share Your Screen

Click the 'Start Sharing' button and choose what to share: your entire screen, a specific window, or just a browser tab. The AI will see exactly what you see.

  • Choose from screen, window, or tab sharing
  • Works with all major browsers
  • Secure, encrypted connection
  • Stop sharing anytime with one click

Choose what to share

Select a screen sharing option

Entire Screen

Share everything

Window

Single application

Browser Tab

Just this tab

Start Sharing
2

Ask Your Question

Type your question in natural language. You can ask for help with specific tasks, request explanations, or describe problems you're facing.

  • Natural language understanding
  • Context-aware responses
  • Ask follow-up questions
  • Reference specific UI elements
photoshop.adobe.com
Welcome! Share your screen to get started.
Send
3

Follow AI Guidance

Receive clear, step-by-step instructions tailored to your exact situation. The AI adapts its guidance based on what it sees on your screen.

  • Step-by-step instructions
  • Visual references to UI elements
  • Adapts to your screen state
  • Explains the 'why' behind each step

How do I remove background?

I can see you have an image open. To remove the background:

1. Select the Quick Selection Tool (W)

2. Click and drag over the subject

3. Go to Select > Inverse

4. Press Delete

Under the Hood

Screen Capture

We use the browser's native Screen Capture API (getDisplayMedia) to securely capture your screen. No browser extensions or plugins required.

AI Processing

Your screen captures are analyzed by Google's latest multi-modal AI, optimized for speed, accuracy, and visual understanding.

Privacy

Screen data is processed in real-time and not stored on our servers by default. You control what gets saved and where.

Streaming

Responses are streamed in real-time, so you see guidance appearing as the AI generates it - no waiting for complete responses.

Requirements

Supported Browsers

  • Chrome 72+
  • Firefox 66+
  • Safari 13+
  • Edge 79+

System Requirements

  • Modern operating system (Windows, macOS, Linux)
  • Stable internet connection
  • Screen sharing permissions enabled

Ready to Try It?

Experience AI-powered screen guidance for yourself. Start your free trial today.

Start Free Trial