Screen Share

Description

The Screen Share tool lets the agent “see” the browser tab or window you choose to share. By viewing your screen in real time, the agent can provide context‑aware, step‑by‑step guidance—perfect for technical demos, troubleshooting, or walking through tasks like building a new AI agent.

Target Audience

User

Features

Real‑Time Context Awareness

The agent watches your shared screen, understands what you’re seeing, and tailors instructions accordingly.

Click‑by‑Click Guidance

Receive precise directions (“Click the Create + button…”) as you navigate complex workflows.

Live Confirmation & Troubleshooting

Ask questions like

“Did my resource finish training?”
and get immediate reassurance or corrections.

On‑Demand Tool Toggles

Screen sharing pairs seamlessly with other agent tools (Web Search, Code Interpreter, Image Generation, etc.), which you can enable or disable as needed.

Privacy Control

You choose exactly which window or tab to share and can stop sharing at any moment.

How to Use (step by step)

Verify that your agent’s Screen Sharing toggle is On (in agent settings).

Open a Chat Session

Start chatting with the agent you want to share your screen with.

Hover over the desktop‑screen icon in the lower‑right corner of the prompt box
Click the icon
Select the browser tab or window you wish to share and approve the prompt

Interact & Receive Guidance

The agent greets you and begins context‑specific help.
Follow its spoken or written instructions as it “watches” what you do.

Ask Questions in Real Time

Example:

Did my resource finish training?
The agent checks the on‑screen status and confirms instantly.

Close the screen‑share window or click Stop Sharing to end the session.

How to Use (Screensharing Transcript)

Purpose

After a screen-sharing session with the agent (e.g., in a course side panel), the voice conversation transcript appears in the chat automatically once screen sharing ends.

Steps

Start screen sharing and choose what to share (e.g., Full Window).
Speak with the agent.

You: “Can you see my screen?”
Agent: “Yes, I can see your screen. You are on a page titled War of 1812…”

You: “Great. Can you summarize what you’re seeing on the page?”

Agent: (Summarizes the page:)
- Causes: British impressment, support for Native American attacks
- Impacts: Boosted American nationalism, weakened Native resistance
- Confirms U.S. independence
Stop screen sharing.
Refresh the page.

The agent’s on-call description from the screen-sharing session now appears in the chat transcript, allowing you to reference what the agent observed even after sharing ends.

Pedagogical Use Cases

Technical Walkthroughs

Get live, click‑by‑click assistance when creating a new AI agent, configuring datasets, or adjusting model settings.

Coding & Debugging Sessions

Share an IDE tab so the agent can point out syntax errors or suggest refactors as you code.

Software Demonstrations

Let the agent observe your use of design tools, spreadsheets, or simulations and provide targeted tips.

Lab Procedure Guidance

Stream a virtual‑lab environment; Agentic OS ensures you follow each step correctly and safely.

Accessibility Support

Learners who struggle with written instructions benefit from visual, real‑time guidance accompanied by voice or text explanations.

With Screen Share plus Agentic OS’s context awareness, you receive immediate, personalized help—click by click—making onboarding, troubleshooting, and complex tasks faster and clearer.