← 插件

Browser prompt

Turns browser-prompt code blocks in agent replies into cards that start the steps in ChatGPT (desktop or web), the Claude desktop app, a Paseo browser agent, a Server browser agent (headless, on the Paseo server) or a Claude in Chrome tab, copy them, or mark them done.

$ paseo plugin add midego1/browser-prompt
报告问题
midego1编排4次安装c4479afc030e源代码
Browser prompt 截图 1Browser prompt 截图 2Browser prompt 截图 3Browser prompt 截图 4

该插件的概览尚未翻译为你的语言,因此以英文显示。

Browser prompt turns step-by-step browser instructions written by an agent into a card. From the card you can hand the steps to ChatGPT (desktop app or web) or to the Claude desktop app, copy them, mark them done, or have a Paseo agent carry them out in the browser tabs of your Paseo desktop app, in its own headless browser on the Paseo server (no desktop app needed, not signed in), or, through Claude in Chrome, in a tab of your real Chrome.

What it does

When an assistant message contains a fenced code block whose info string is browser-prompt (optionally followed by a title), the block is replaced by a card, and the rest of the message is shown as before. The card shows the title and the steps, with a button for every way to run them, grouped by Paseo, ChatGPT and Claude, plus Copy and Mark done. Your usual way is highlighted, and the gear in the card header opens the settings. In short:

  • ChatGPT › Desktop and Web copy the steps to the clipboard with a short header asking ChatGPT to carry them out with its own computer use (@Computer), and to stop and ask before entering secrets or confirming destructive actions. They then open the ChatGPT desktop app or chatgpt.com.
  • Claude › Desktop copies the steps with a header asking Claude to use Claude in Chrome, then opens the Claude desktop app with them in a new chat (through the same launcher page as ChatGPT Desktop, with its claude://claude.ai/new?q= link). You press send.
  • Copy copies the same text without opening anything.
  • Mark done marks the card as finished (Undo done reverts it). Done marks are stored on the Paseo host, so every connected app sees them.
  • Paseo › Paseo browser starts a new Paseo agent that carries out the steps in the browser tabs of your Paseo desktop app. Paseo › Server browser starts one with its own headless Chromium in a throwaway Docker container on the Paseo server, so it works without the desktop app (also from a phone); that browser is not signed in to any of your accounts and cannot reach your tailnet or private addresses. Claude › Chrome tab does the same in a tab of your real Chrome, through Claude in Chrome.

A card appears only after the block's closing fence has streamed in. Blocks nested inside another code block are ignored. The README describes the block convention for agents.

When an agent repeats a block it already wrote earlier in the same chat (the same title and steps, ignoring spacing, line endings and how the steps are numbered), the copy is a full card with all its buttons and a note, "Also shown earlier in this chat". Copies share the done mark and the agent run: marking one done marks them all, and while a run of those steps is going, a copy shows its status instead of starting a second one. Once the steps are done, later copies collapse to ✓ Already done · Show; Show opens the card in place. Turn off Collapse repeated blocks that are done to show every copy as a plain card.

Setup

No account or token is needed. Paseo 0.11.4 or later.

  • ChatGPT web mode and Copy only work everywhere.
  • ChatGPT app mode (the desktop default) opens the ChatGPT desktop app with the prompt in a new chat (you still press send). It needs the ChatGPT desktop app on macOS or Windows and a small launcher page served by the plugin on the Paseo daemon's host. The launcher binds only to that host's own Tailscale address (100.64.0.0/10, detected with tailscale ip -4 or from Tailscale's network interface) or, if you set it, to 127.0.0.1 when the Paseo app runs on the same machine. It never binds to 0.0.0.0, a LAN or a public address. Tailscale is optional: without it the launcher stays off and the ChatGPT Desktop button copies the prompt instead. The first time, the browser asks whether to open ChatGPT.
  • Claude Desktop opens the Claude desktop app (macOS, Windows or Linux) with the prompt in a new chat through the same launcher page, so it has the same needs; without the launcher it copies the prompt instead.
  • Paseo browser needs the Paseo desktop app open with its browser available. Server browser needs Docker on the Paseo server (rootless works) and a Paseo with agent session hooks; you set it up once in Settings › Server browser with Download and build (downloads about 2.6 GB, a few minutes; nothing is downloaded before you confirm), and until then the button says why it cannot start. Claude › Chrome tab needs Chrome open with the Claude in Chrome extension signed in to the agent's Claude account (see the README for a claude-chrome provider, or name one under Claude in Chrome provider). Both need an enabled Claude provider (or another provider with a known ask-first mode). Claude Auto mode needs Claude Code on the Anthropic API; Paseo refuses it on Bedrock and Vertex.

What is read and where data goes

  • Clipboard: the ChatGPT buttons, Claude › Desktop and Copy write the prompt to the clipboard of the device you press the button on. Nothing is read from the clipboard.
  • ChatGPT web mode: opens https://chatgpt.com/?hints=agent in your browser. When the prompt is short (under about 1,500 characters as a URL) and contains nothing that looks like a token or key, the prompt is added to that URL as the q parameter, so it is sent to OpenAI and can appear in your browser history. Otherwise only the bare URL is opened and you paste the prompt.
  • ChatGPT app mode: the prompt is sent from the Paseo app to the plugin on your Paseo daemon and kept in memory under a random one-time id for at most 10 minutes. Your browser opens http://<launcher address>:5299/open?id=<id>, which does not contain the prompt. That page hands the prompt to the ChatGPT app through its codex://new?prompt=... deep link and deletes the id on first use. The prompt then goes to OpenAI when you send it in the ChatGPT app.
  • Claude Desktop: the same launcher page and one-time id, handing the prompt to the Claude app through its claude://claude.ai/new?q=... deep link. The prompt then goes to Anthropic when you send it in the Claude app.
  • Paseo browser and Claude in Chrome: start an agent on your own Paseo daemon, in the workspace of the agent whose message holds the card (or your most recently active workspace). Its first message is a fixed safety preamble followed by the card's steps, so the steps are sent to that agent's model provider (Anthropic by default). It is told to use only Paseo's browser tools, which act in your Paseo desktop app, or with Claude in Chrome only the extension's tools, which act in your real Chrome; in both you may be signed in to websites (an instruction to the model, see below). Claude in Chrome steps and page content can go through Anthropic's bridge.
  • Server browser: the run's own Chromium runs in a Docker container on the Paseo server with no access to the server's files, a read-only file system and Chromium's own sandbox, alone on an internal Docker network with no route out. Its pages are fetched from the server's network by a separate proxy container that refuses tailnet, private, loopback and link-local addresses and the server's own addresses. At most 3 such runs have a browser at once. Page content and screenshots go to the agent's model provider like any run's; the container and its profile are removed when the run's session ends. Building the image downloads the pinned Playwright base image (when missing) and the pinned Playwright MCP package from npm.
  • Talk to the chat: a question of the browser agent (up to 1,500 characters, escaped and marked as untrusted) is sent to the agent whose chat showed the card, so it also reaches that agent's model provider, whatever permission mode that chat uses. Off, or a limit of 0, sends nothing.
  • Report back to chat: when that agent finishes or fails, a message goes to the agent whose chat showed the card, so it also reaches that agent's model provider. With Auto it holds the browser agent's final message (up to 4,000 characters) only when that chat runs in an ask-first mode; otherwise only the title, outcome and run agent id. The plugin keeps the ids of runs that already reported in reported-runs.json in its state directory. Logs contain agent ids only.
  • Settings and state: start modes, done marks, agent settings and links between cards and started agents are stored as Paseo host settings. To recognize repeated blocks, the card reads the chat's own messages in your Paseo app; nothing is sent anywhere. After a check or update, the updater keeps a small state file, a log and a commit-only copy of the plugin's Git history in ~/.local/state/paseo-plugin-browser-prompt/.
  • Updates: for Git installs from an https:// remote, the daemon contacts that remote (the repository the plugin was installed from) only when you enabled auto-update for it, or when you press Check now or Update now. Registry installs are updated by Paseo instead.
  • Prompt text is never written to logs. The plugin sends no telemetry.

Run with Paseo agent

The agent starts in Claude Auto mode by default: a model classifier, not you, reviews its tool calls. The agent is additionally told that an approved tool call is not your approval and that it must ask you, as a question, before secrets, anything destructive or irreversible, merges, payments and security changes. You can choose Always Ask (default, you approve each new tool) or Plan instead; Oh My Pi uses Ask. Bypass, accept-edits and other auto-approve modes are refused, and providers without a known ask-first mode are not started. By default the card asks "Start a Paseo agent to do these steps in your browser?" first and mentions Auto mode. Updating from an earlier version moves a stored Always Ask setting to Auto mode once.

The plugin checks the mode the agent actually runs in, right after starting it and again whenever it starts a turn or asks for a permission. Moving between Auto mode, Always Ask and Plan is fine. A run in a refused mode such as bypass or accept-edits is stopped (archived) and the card shows why.

The safety preamble is always included. It tells the agent to use only the Paseo browser tools (never Playwright or a browser on the server), only the Server browser's Playwright tools for a Server browser run (never the Paseo browser tools), or only the extension's tools with Claude in Chrome, with no shell commands and no file edits, to stop and ask before typing any secret, before anything destructive or irreversible and whenever the page differs from the steps, never to repeat secret values shown on a page, and to finish with a summary of what it did and what is left for you. Secrets and confirmations of destructive, security, billing, merge or publish actions are a fixed rule in the prompt that no setting changes: the agent is told to always ask you for them, never the chat.

These rules (browser tools only, asking before secrets and risky actions) are instructions in the agent's prompt, not a sandbox: the plugin does not block shell, file or other tools for the run. How well they are followed depends on the provider and model you select; the permission mode (Always Ask to approve each new tool yourself) and the mode guard are the controls the plugin does enforce.

With Show step progress (on by default) the agent writes a short line as it starts each numbered step, and the card shows "Step N of M" with what it is doing and a progress bar; done fills the bar, and failed, needs you or waiting for the chat keep the last step. The card reads these lines from the agent's own chat; nothing extra is sent anywhere.

Under it, one small line shows how long the run has taken since it started, including time it waited for you (counting up with a spinning icon while it runs, the total once it ended), and, once a turn has finished, that turn's tokens as Paseo reports them, for example "Took 3m 02s · last turn: 36 in · 701k cached · 4.6k out". The spinner stays still when your system asks for reduced motion. No cost is shown. A stopped run shows just "Stopped", and tokens are missing for runs from before a Paseo daemon restart.

With Show live screenshot (on by default) the agent takes a screenshot of the visible page after each step, never of a page that shows a password, token or code, and the card shows one thumbnail per step with "Step N" above it, the latest highlighted: side by side when the card is wide enough, as a horizontal strip otherwise, and only the latest on very narrow screens (or always, with Thumbnails set to Latest only). Pressing a thumbnail opens the agent. Screenshots stay in your Paseo app and are never sent to a chat. Each screenshot is also read by the agent's model, which adds to its token use; turn the setting off to save tokens. The thumbnail needs a Paseo 0.13 or later app. Paseo can only capture a browser tab your app is showing, so a run in the background usually gets no screenshot: it tries once, stops taking them for that run, and the card says that the run's browser tab must be visible (for example in a split next to the chat).

With Claude › Chrome tab on the card (Claude in Chrome) the agent works in your real Chrome instead of the Paseo browser, with every account you are signed in to. It needs a Claude provider, Chrome open and the Claude in Chrome extension signed in to the same Claude account as the agent. In Auto mode, the default, a model classifier approves its browser actions and the extension does not ask per site; choose Always Ask to approve them yourself. The card shows no screenshots for these runs.

With Close tabs after a successful run (on by default) the agent notes which browser tabs were open when it started and, only when every step succeeded with nothing left for you, closes the tabs it opened itself as its last action before its report, which names their hosts. Tabs that were already open stay open, also when the run used them, as do tabs a step says to leave open and tabs the agent is unsure it opened; a run that fails, stops, asks or needs you leaves every tab open so you can see where it stopped. This is an instruction in the agent's prompt, not an enforced control: how well it holds depends on the provider and model you select, and a model may close the wrong tab or none. In Always Ask mode you approve the close like any other new tool.

With Archive the agent after a successful run (off by default) the plugin archives an agent that reports every step succeeded with nothing left for you, once the chat got its report or notice (with Report back to chat off, right away). Any other run stays open. The card keeps showing it as done.

When the agent needs you (a question it asks you, or a permission it needs), the card says so in the warning color and shows the question and its options, or the permission with what it would do, so you can answer right on the card: select an option and press Send answer, or press Allow and then Confirm allow, or Deny. Text the agent would type into a page is masked until you tap Show, and Allow waits until you have shown it. Allow is offered only when the card can show everything the permission would allow, and each Allow button only when its own text is shown in full (a long "Always allow …" rule that would be cut is left out); otherwise only Deny and Open run. A free-text answer opens the agent. Only your click answers; these questions are never sent to the chat.

By default the agent starts in the background: the card shows its state (running, needs you for a question or permission, done, failed) with a link to open it. Turn on Open the agent when started to open its view right away.

Talk to the chat (on by default) lets the agent ask the chat that showed the card about the task itself, for example which of two buttons to use, which value to fill in, or how to go on when the page differs from the steps. The agent ends its turn with the question, the plugin forwards it to that chat marked as untrusted text that may come from web pages, and that chat's agent answers by sending a message to the browser agent. A run asks at most 10 questions by default (0 to 50 in settings; 0 works like off); after that, when talking is off, or when the chat is not available, the agent asks you instead. If it keeps asking the chat anyway, its third such turn is treated as its final report. Questions never count as the final report.

Report back to chat tells the chat that showed the card when the agent finishes or fails, so that chat's agent can continue with the result. It has three settings:

  • Auto (default): the full report when that chat runs in an ask-first permission mode (Claude Always Ask or Plan, Oh My Pi Ask). For any other mode, including bypass and auto-approve modes and providers without a known ask-first mode, only a short notice that the run finished or failed, without any text from the web pages; open the run agent to read its report.
  • Always send the full report: also to chats that act without your approval. The report can contain text from web pages, so a page could try to steer that agent.
  • Off: nothing is sent.

The report is escaped, fenced and marked as the browser agent's untrusted output, not your instructions. It is sent once per run, only for runs a card recorded, never to a browser agent itself, and not at all when the original chat no longer exists. When that chat's agent is busy or waiting for your answer, the report waits up to two hours for it to be idle and is dropped after that. When you run a card again, an earlier run that is still going still reports (the newest 5 runs per card are kept).

Updates

The plugin never downloads or installs new code on its own. Auto-update is off until you turn it on in settings, where the plugin first shows the Git repository it was installed from and tells you that, once enabled, newer plugin code from that repository will be downloaded and installed automatically when you use the plugin. If you choose Not now, or never decide, nothing is checked or installed, also when a card is shown. Consent applies to that repository only: if the plugin is later installed from another one, auto-update is off again until you enable it for the new one. An install that had auto-update on from an earlier version without being asked is turned off and asked again.

With auto-update on, the plugin checks the branch it was installed from when a card is first shown in an app session and when you press a card button, at most once every 30 minutes, and installs a newer commit only when the remote is https:// and the commit is a fast-forward of the installed one; anything else is reported in settings and left for you. Without it you can still press Check now, which reads the newest commit from that repository and installs nothing, and Update now, which downloads and installs the commit it names only when you press it. npm and registry installs are updated by Paseo, not by the plugin. The daemon is never restarted.

Settings

  • The usual way to start, highlighted on the card, on desktop (ChatGPT desktop, ChatGPT web, Claude desktop, Paseo browser, Server browser, Claude Chrome tab, or copy only; default ChatGPT desktop) and on iOS and Android (copy only, ChatGPT web, Paseo browser, Server browser or Claude Chrome tab; default copy only).
  • ChatGPT app deep link template (default codex://new?prompt={prompt}, with Save and Reset), collapse repeated blocks that are done (on by default), and clearing done marks.
  • Run with Paseo agent: confirm before starting, open the agent when started, show step progress, show live screenshot, thumbnails (all steps or latest only), close tabs after a successful run (on by default), archive the agent after a successful run (off by default), talk to the chat, max questions to the chat per run, report back to chat (Auto, Always send the full report, Off), provider, model, permission mode, Claude in Chrome provider (empty: claude-chrome when the daemon has that provider, else Provider), thinking level, reset to defaults, and clearing card-to-agent links.
  • Server browser: status (ready, building, image missing or failed, Docker missing or not reachable) and Download and build (two presses; about 2.6 GB). At most 3 Server browser runs have a browser at once; the button says so when the limit is reached.
  • ChatGPT launcher: status, bind address (empty means the detected Tailscale address) and port (default 5299).
  • Updates (Git installs): the repository updates come from, enable auto-update or not now, installed and latest commit, last check, Check now, Update now, and an optional branch to follow.

The Command Center has Open last browser prompt in ChatGPT.

Limits

  • The prompt is always copied first, so you can paste it if ChatGPT, Claude or the launcher page cannot be opened.
  • ChatGPT Desktop needs the ChatGPT desktop app on macOS or Windows, and Claude Desktop the Claude desktop app on macOS, Windows or Linux. Both open with the prompt filled in; you press send, because their links never send by themselves. Neither documents a mobile deep link for a new prompt.
  • The ChatGPT web URL parameters are not officially documented and may change.
  • Run with Paseo agent in the Paseo browser needs the Paseo desktop app open (the Server browser does not, but is signed in to nothing); on Paseo 0.11 and 0.12 the card's message text uses a compact built-in Markdown renderer.
  • On a permission, the card shows an "Always allow …" button's own text in full, but not the rule list Paseo keeps next to it; read the button text before you confirm.
  • Look-alike letters from other alphabets (a Cyrillic "а" in a web address, for example) look the same on the card and do not block Allow.