Screen awareness

Share what is on your screen

Tai can reason about a screenshot you deliberately share — what you are looking at, and what to do next. Pixels stay request-scoped and are never archived.

Scaffold honesty: NOT WIRED — dedicated screen/ask model call (fixtures only; live chat uses /tai converse)

Share into a live Tai turn

Production multimodal path — real vision answers via the converse brain.

Open Tai · Look with me / Photo

On /tai use Look with me (Mac) or Photo or file (iPhone) to share the current screen into a live turn.

Scaffold capture → fixture ask

Exercises POST /api/tai/screen/capture and /ask. Returns a synthetic flow description only — no model call.