Work with your agents
A marked-up screenshot and a short request give your agent something specific to work with. Use fab to capture, point, and dictate in the agent app you already use.
You need: Fab on Mac with capture and dictation permissions · An agent chat that accepts images, or an agent that can read local image files
Updated:
On this page01 / 08
Capture what you want to change
⌃⌥S
Press Control+Option+S and select the area or window you want the agent to see. Include enough context to make the problem clear.
Point out the important part
R
Click the capture to open markup. Press R for a box, A for an arrow, or N for a note. For example, draw a box around a button and add “Move below the form.”
Save the markup
Click Done to finish the whole edit. Return only finishes a note while you are typing one. Fab writes the marks into the image and keeps the original beside it. Check the marked image before sharing it.
Attach it to your agent’s chat
⌃⌥V
Focus the agent’s message box and press Control+Option+V. Use the Here lane and select the marked capture by its shown number to paste the image. If Shared is open, press Tab to return to Here. If the chat does not accept image paste, drag the marked capture into its attachment area. For an agent that can read files on this Mac, hold Shift with the capture’s number to paste its path instead.
Dictate what you want
Before dictating, turn off Press Return after in Fab so you can review before sending. Click the message box, hold your talk key, and say the request. Try: “Move the button inside the red box below the form. Keep the existing label and styling.” Release the key and check that the words landed in the draft.
Review and send
Check that the draft contains the marked image, or an accessible image path, and the request. Then send it with the agent app’s own Send control. Fab provides the capture and text; the agent app handles the conversation and its permissions.
Tips
- For an agent running locally in a terminal, hold Shift while selecting the capture’s number to paste its file path. Ask the agent to open that image. A path works only when the agent can access that file.
- For a cloud agent or an agent on another machine, upload the marked image using that app’s attachment flow. A path on your Mac does not transfer the file.
- Name the change you want and anything that should stay the same. The markup identifies where; your words explain what to do.
Questions
- Do I need to turn on Labs?
- No. This guide uses capture, markup, the paster, and dictation inside your agent’s own app. Fab’s Line and automatic agent routing are separate Labs features.
- Will the agent see my markup?
- The marks are part of the image after you click Done. Check that you attached the marked capture, and use an agent that can read images.
- Does Fab send the request automatically?
- This walkthrough leaves sending to the agent app. Turn off Press Return after for dictation so you can review your draft first.
- Can I send several captures?
- Yes, if the agent app supports multiple attachments. Add the captures you need and refer to each clearly in your request.
Download for Mac