跳到正文

基准测试

同一个智能体,同一个问题。

一个智能体靠页面快照来读、点、填;另一个调用网站的 WebMCP 工具。选一个模型看看,节省最多的排在最前。

GPT-6.1 Sol(OpenAI)

精选案例:35 个问题中的 21 个,即 WebMCP 的 token 用量不超过一半的问题。全部结果均已公开,你也可以用 just bench 自己跑一遍。

Notion

“How many requests per minute does the Notion API allow per connection on plans other than Business and Enterprise?”

打开 (打开 Notion)
不用 WebMCP

25k

token

10.3s · 5.0 步 · 每千次 $13.77

解决 3/3

24× token 更少

用 webmcpx

1.1k

token

3.6s · 2.0 步 · 每千次 $2.59

解决 3/3
Token(按问题统计,每次运行的 token 数):越低越好。另附各组成功率。
问题不用 WebMCP:token用 webmcpx:token不用 WebMCP:解决情况用 webmcpx:解决情况
Notion:How many requests per minute does the Notion API allow per connection on plans other than Business and Enterprise?25k1.1k100%100%
Notion:I'm writing long paragraphs into a Notion page through the API. What's the maximum number of characters a single rich text object's text content can have in a request?22k1.1k100%100%
Notion:I'm paginating through results from the Notion API. What's the largest page_size I can request per call on the list endpoints?14k1.1k100%100%
Notion:When my Notion integration sends too many requests, what error code string does the API put in the error response body?14k4.6k100%100%
耗时(按问题统计,每次运行的秒数):越低越好。另附各组成功率。
问题不用 WebMCP:耗时用 webmcpx:耗时不用 WebMCP:解决情况用 webmcpx:解决情况
Notion:How many requests per minute does the Notion API allow per connection on plans other than Business and Enterprise?10.3s3.6s100%100%
Notion:I'm writing long paragraphs into a Notion page through the API. What's the maximum number of characters a single rich text object's text content can have in a request?9.2s4.1s100%100%
Notion:I'm paginating through results from the Notion API. What's the largest page_size I can request per call on the list endpoints?9.5s5.4s100%100%
Notion:When my Notion integration sends too many requests, what error code string does the API put in the error response body?9.1s7.1s100%100%
步数(按问题统计,每次运行的模型轮次):越低越好。另附各组成功率。
问题不用 WebMCP:步数用 webmcpx:步数不用 WebMCP:解决情况用 webmcpx:解决情况
Notion:How many requests per minute does the Notion API allow per connection on plans other than Business and Enterprise?5.02.0100%100%
Notion:I'm writing long paragraphs into a Notion page through the API. What's the maximum number of characters a single rich text object's text content can have in a request?4.72.0100%100%
Notion:I'm paginating through results from the Notion API. What's the largest page_size I can request per call on the list endpoints?6.02.0100%100%
Notion:When my Notion integration sends too many requests, what error code string does the API put in the error response body?6.04.0100%100%
成本(按问题统计,每 1,000 次运行的美元数):越低越好。另附各组成功率。
问题不用 WebMCP:成本用 webmcpx:成本不用 WebMCP:解决情况用 webmcpx:解决情况
Notion:How many requests per minute does the Notion API allow per connection on plans other than Business and Enterprise?$13.77$2.59100%100%
Notion:I'm writing long paragraphs into a Notion page through the API. What's the maximum number of characters a single rich text object's text content can have in a request?$13.68$3.01100%100%
Notion:I'm paginating through results from the Notion API. What's the largest page_size I can request per call on the list endpoints?$6.69$2.84100%100%
Notion:When my Notion integration sends too many requests, what error code string does the API put in the error response body?$6.80$7.40100%100%

Notion 注册的 5 个 WebMCP 工具

智能体当时看到的版本 · 2026-11-07

工具描述已调用
search_docs

Search the Notion Docs documentation for relevant pages and content.

search_docs({"query":"rate limits requests per minute per connection Business Enterprise"})

search_docs({"query":"rich text text content maximum length request 2000 characters"})

search_docs({"query":"pagination maximum page_size list endpoints"})

search_docs({"query":"rate limits error code rate_limited"})

search_docs({"query":"status codes rate_limited 429"})

已调用
read_page

Read the full content of a Notion Docs documentation page as markdown.

read_page({"path":"https://developers.notion.com/reference/status-codes"})

已调用
get_site_overview

Get an outline of the Notion Docs documentation, grouped by section, with a short description of each page. May be truncated for large sites; use search_docs to find pages not listed.

–未调用
navigate_page

Navigate the current browser tab to a Notion Docs documentation page.

–未调用
read_skill

Read a Notion Docs agent skill document by name.

–未调用
  • gpt-6.1-sol,推理强度 medium,无头 Chrome。两组使用相同的提示词和步数上限;每个问题每组运行 3 次。
  • 不用 WebMCP:基于 DOM 快照的智能体,靠读、点、填完成操作。
  • 用 webmcpx:只能使用页面注册的工具。
  • 按答案中的事实和页面状态评分,不用 LLM 当评委。
  • 真实网站:自带 WebMCP 工具。
复现步骤
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just bench

Cloudflare

“What is the maximum size of a single value stored in Cloudflare Workers KV?”

打开 (打开 Cloudflare)
不用 WebMCP

21k

token

7.9s · 6.0 步 · 每千次 $8.74

解决 3/3

20× token 更少

用 webmcpx

1.0k

token

4.7s · 2.0 步 · 每千次 $2.62

解决 3/3
Token(按问题统计,每次运行的 token 数):越低越好。另附各组成功率。
问题不用 WebMCP:token用 webmcpx:token不用 WebMCP:解决情况用 webmcpx:解决情况
Cloudflare:What is the maximum size of a single value stored in Cloudflare Workers KV?21k1.0k100%100%
Cloudflare:How many requests per day can my Workers handle on the Cloudflare Workers Free plan before hitting the limit?40k9.5k100%100%
Cloudflare:How long can a key be in Cloudflare Workers KV? I want to know the maximum key size.21k6.7k100%100%
Cloudflare:I'm on the Workers Paid plan. What's the maximum size a single Cloudflare D1 database can grow to?22k9.6k100%100%
Cloudflare:What is the largest message I can send to a Cloudflare Queue? I need the per-message size limit.21k9.8k100%100%
耗时(按问题统计,每次运行的秒数):越低越好。另附各组成功率。
问题不用 WebMCP:耗时用 webmcpx:耗时不用 WebMCP:解决情况用 webmcpx:解决情况
Cloudflare:What is the maximum size of a single value stored in Cloudflare Workers KV?7.9s4.7s100%100%
Cloudflare:How many requests per day can my Workers handle on the Cloudflare Workers Free plan before hitting the limit?8.8s6.1s100%100%
Cloudflare:How long can a key be in Cloudflare Workers KV? I want to know the maximum key size.8.1s5.7s100%100%
Cloudflare:I'm on the Workers Paid plan. What's the maximum size a single Cloudflare D1 database can grow to?8.5s6.0s100%100%
Cloudflare:What is the largest message I can send to a Cloudflare Queue? I need the per-message size limit.8.3s6.1s100%100%
步数(按问题统计,每次运行的模型轮次):越低越好。另附各组成功率。
问题不用 WebMCP:步数用 webmcpx:步数不用 WebMCP:解决情况用 webmcpx:解决情况
Cloudflare:What is the maximum size of a single value stored in Cloudflare Workers KV?6.02.0100%100%
Cloudflare:How many requests per day can my Workers handle on the Cloudflare Workers Free plan before hitting the limit?6.03.0100%100%
Cloudflare:How long can a key be in Cloudflare Workers KV? I want to know the maximum key size.6.02.7100%100%
Cloudflare:I'm on the Workers Paid plan. What's the maximum size a single Cloudflare D1 database can grow to?6.03.0100%100%
Cloudflare:What is the largest message I can send to a Cloudflare Queue? I need the per-message size limit.6.03.0100%100%
成本(按问题统计,每 1,000 次运行的美元数):越低越好。另附各组成功率。
问题不用 WebMCP:成本用 webmcpx:成本不用 WebMCP:解决情况用 webmcpx:解决情况
Cloudflare:What is the maximum size of a single value stored in Cloudflare Workers KV?$8.74$2.62100%100%
Cloudflare:How many requests per day can my Workers handle on the Cloudflare Workers Free plan before hitting the limit?$20.61$6.62100%100%
Cloudflare:How long can a key be in Cloudflare Workers KV? I want to know the maximum key size.$8.74$6.52100%100%
Cloudflare:I'm on the Workers Paid plan. What's the maximum size a single Cloudflare D1 database can grow to?$9.79$6.17100%100%
Cloudflare:What is the largest message I can send to a Cloudflare Queue? I need the per-message size limit.$9.34$6.66100%100%

Cloudflare 注册的 2 个 WebMCP 工具

智能体当时看到的版本 · 2026-11-07

工具描述已调用
search

Full-text search across Cloudflare developer documentation. Returns matching pages with titles, URLs, and content snippets. Use this to find documentation on any Cloudflare product or feature.

search({"query":"Workers KV maximum size single value","limit":3})

search({"query":"Workers Free requests per day 100,000 midnight UTC","limit":3})

search({"query":"Workers KV maximum key size","limit":3})

search({"query":"D1 limits maximum database size Workers Paid","limit":3})

search({"query":"queues limits message size","limit":3})

已调用
list-directories

Returns a list of all Cloudflare products available in the developer documentation, including each product's name, docs URL, short description, and category group. Use this to discover what products exist before searching or navigating.

list-directories({})

list-directories({})

list-directories({})

已调用
  • gpt-6.1-sol,推理强度 medium,无头 Chrome。两组使用相同的提示词和步数上限;每个问题每组运行 3 次。
  • 不用 WebMCP:基于 DOM 快照的智能体,靠读、点、填完成操作。
  • 用 webmcpx:只能使用页面注册的工具。
  • 按答案中的事实和页面状态评分,不用 LLM 当评委。
  • 真实网站:自带 WebMCP 工具。
复现步骤
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just bench

specification.website

“How long should a page's meta description be, according to this spec?”

打开 (打开 specification.website)
不用 WebMCP

40k

token

14.6s · 10.0 步 · 每千次 $16.52

解决 3/3

10× token 更少

用 webmcpx

3.9k

token

5.2s · 3.0 步 · 每千次 $6.63

解决 3/3
Token(按问题统计,每次运行的 token 数):越低越好。另附各组成功率。
问题不用 WebMCP:token用 webmcpx:token不用 WebMCP:解决情况用 webmcpx:解决情况
specification.website:How long should a page's meta description be, according to this spec?40k3.9k100%100%
specification.website:What max-age should I put in my HSTS header for production, per this spec?13k3.7k100%100%
specification.website:What minimum contrast ratio does this site's spec require for normal-size body text?13k3.7k100%100%
specification.website:What INP value does this spec set as the target for good responsiveness?13k3.8k100%100%
specification.website:What's the minimum tap target size this spec requires for buttons and other interactive controls?14k4.5k100%100%
耗时(按问题统计,每次运行的秒数):越低越好。另附各组成功率。
问题不用 WebMCP:耗时用 webmcpx:耗时不用 WebMCP:解决情况用 webmcpx:解决情况
specification.website:How long should a page's meta description be, according to this spec?14.6s5.2s100%100%
specification.website:What max-age should I put in my HSTS header for production, per this spec?9.0s5.7s100%100%
specification.website:What minimum contrast ratio does this site's spec require for normal-size body text?7.9s5.5s100%100%
specification.website:What INP value does this spec set as the target for good responsiveness?7.7s4.5s100%100%
specification.website:What's the minimum tap target size this spec requires for buttons and other interactive controls?8.5s5.7s100%100%
步数(按问题统计,每次运行的模型轮次):越低越好。另附各组成功率。
问题不用 WebMCP:步数用 webmcpx:步数不用 WebMCP:解决情况用 webmcpx:解决情况
specification.website:How long should a page's meta description be, according to this spec?10.03.0100%100%
specification.website:What max-age should I put in my HSTS header for production, per this spec?6.03.0100%100%
specification.website:What minimum contrast ratio does this site's spec require for normal-size body text?6.03.0100%100%
specification.website:What INP value does this spec set as the target for good responsiveness?6.03.0100%100%
specification.website:What's the minimum tap target size this spec requires for buttons and other interactive controls?6.03.0100%100%
成本(按问题统计,每 1,000 次运行的美元数):越低越好。另附各组成功率。
问题不用 WebMCP:成本用 webmcpx:成本不用 WebMCP:解决情况用 webmcpx:解决情况
specification.website:How long should a page's meta description be, according to this spec?$16.52$6.63100%100%
specification.website:What max-age should I put in my HSTS header for production, per this spec?$6.91$9.44100%100%
specification.website:What minimum contrast ratio does this site's spec require for normal-size body text?$6.47$7.08100%100%
specification.website:What INP value does this spec set as the target for good responsiveness?$6.27$7.69100%100%
specification.website:What's the minimum tap target size this spec requires for buttons and other interactive controls?$7.24$9.33100%100%

specification.website 注册的 5 个 WebMCP 工具

智能体当时看到的版本 · 2026-11-07

工具描述已调用
search_spec

Search The Website Specification for matching topics. Returns ranked results with title, status, category, canonical URL, and a one-line summary. Use this when the user asks about a topic by keyword (e.g. "CSP", "alt text", "llms.txt").

search_spec({"query":"meta description length","limit":5})

search_spec({"query":"HSTS max-age production","limit":5})

search_spec({"query":"contrast ratio normal text","limit":3})

search_spec({"query":"INP","limit":5})

search_spec({"query":"tap target size interactive controls","limit":5})

已调用
get_topic

Fetch the Markdown for one spec page by its slug, returned as lines you can page through. Use this after search_spec or list_topics to read the canonical guidance.

get_topic({"slug":"meta-description"})

get_topic({"slug":"hsts"})

get_topic({"slug":"color-contrast","limit":100})

get_topic({"slug":"core-web-vitals","limit":100})

get_topic({"slug":"touch-target-size","limit":120})

已调用
list_topics

List spec topics, optionally filtered by category and/or status. Returns title, status, category, summary, and URL per topic. Use this when the user wants the canonical list (e.g. "all required SEO topics"). Results are paged — follow page/page_size to walk the whole list.

–未调用
open_checklist

Navigate the user to the full spec checklist page. Optionally jumps to a category section via URL hash. UI action — does not return data.

–未调用
open_search

Open the on-page ⌘K search overlay so the user can search the spec interactively. Optionally pre-fills a query. UI action — does not return results; use search_spec for that.

–未调用
  • gpt-6.1-sol,推理强度 medium,无头 Chrome。两组使用相同的提示词和步数上限;每个问题每组运行 3 次。
  • 不用 WebMCP:基于 DOM 快照的智能体,靠读、点、填完成操作。
  • 用 webmcpx:只能使用页面注册的工具。
  • 按答案中的事实和页面状态评分,不用 LLM 当评委。
  • 真实网站:自带 WebMCP 工具。
复现步骤
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just bench

Kiln & Co

“Add one Stoneware Teapot and one Speckled Bowl to my cart, then tell me the cart total.”

不用 WebMCP

12k

token

9.0s · 6.0 步 · 每千次 $5.77

解决 3/3

5.1× token 更少

用 webmcpx

2.4k

token

5.5s · 4.0 步 · 每千次 $5.88

解决 3/3
Token(按问题统计,每次运行的 token 数):越低越好。另附各组成功率。
问题不用 WebMCP:token用 webmcpx:token不用 WebMCP:解决情况用 webmcpx:解决情况
Kiln & Co(本地测试网站):Add one Stoneware Teapot and one Speckled Bowl to my cart, then tell me the cart total.12k2.4k100%100%
Kiln & Co(本地测试网站):Add two of the cheapest blue mug to my cart.7.1k1.5k100%100%
Kiln & Co(本地测试网站):Put the most expensive teapot you sell in my cart.5.6k1.5k100%100%
耗时(按问题统计,每次运行的秒数):越低越好。另附各组成功率。
问题不用 WebMCP:耗时用 webmcpx:耗时不用 WebMCP:解决情况用 webmcpx:解决情况
Kiln & Co(本地测试网站):Add one Stoneware Teapot and one Speckled Bowl to my cart, then tell me the cart total.9.0s5.5s100%100%
Kiln & Co(本地测试网站):Add two of the cheapest blue mug to my cart.8.0s4.0s100%100%
Kiln & Co(本地测试网站):Put the most expensive teapot you sell in my cart.6.2s3.8s100%100%
步数(按问题统计,每次运行的模型轮次):越低越好。另附各组成功率。
问题不用 WebMCP:步数用 webmcpx:步数不用 WebMCP:解决情况用 webmcpx:解决情况
Kiln & Co(本地测试网站):Add one Stoneware Teapot and one Speckled Bowl to my cart, then tell me the cart total.6.04.0100%100%
Kiln & Co(本地测试网站):Add two of the cheapest blue mug to my cart.5.03.0100%100%
Kiln & Co(本地测试网站):Put the most expensive teapot you sell in my cart.4.03.0100%100%
成本(按问题统计,每 1,000 次运行的美元数):越低越好。另附各组成功率。
问题不用 WebMCP:成本用 webmcpx:成本不用 WebMCP:解决情况用 webmcpx:解决情况
Kiln & Co(本地测试网站):Add one Stoneware Teapot and one Speckled Bowl to my cart, then tell me the cart total.$5.77$5.88100%100%
Kiln & Co(本地测试网站):Add two of the cheapest blue mug to my cart.$4.14$3.70100%100%
Kiln & Co(本地测试网站):Put the most expensive teapot you sell in my cart.$3.73$3.50100%100%

Kiln & Co 注册的 4 个 WebMCP 工具

智能体当时看到的版本 · 2026-11-07

工具描述已调用
search_products

Search the catalog. Every filter is optional; with none, returns every product. Prices are USD.

search_products({"query":"Stoneware Teapot"})

search_products({"query":"Speckled Bowl"})

search_products({"category":"mug","color":"blue","sort":"price_asc"})

search_products({"category":"teapot","sort":"price_desc"})

已调用
add_to_cart

Add a product to the cart by sku. Adding a sku already in the cart increases its quantity.

add_to_cart({"quantity":1,"sku":"TPT-01"})

add_to_cart({"quantity":1,"sku":"BWL-01"})

add_to_cart({"quantity":2,"sku":"MUG-03"})

add_to_cart({"sku":"TPT-02","quantity":1})

已调用
get_cart

Return the cart: items with quantity and the total in USD.

–未调用
get_page_context

Describe the page the user is on: title, URL, language, meta description, heading outline and the text the user has selected. Use it for the page's structure or the user's selection; to find a fact on the page, call search_page instead.

–未调用
  • gpt-6.1-sol,推理强度 medium,无头 Chrome。两组使用相同的提示词和步数上限;每个问题每组运行 3 次。
  • 不用 WebMCP:基于 DOM 快照的智能体,靠读、点、填完成操作。
  • 用 webmcpx:只能使用页面注册的工具。
  • 按答案中的事实和页面状态评分,不用 LLM 当评委。
  • 本地测试网站:工具由 webmcpx 提供。
复现步骤
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just bench

Allbirds

“I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there?”

打开 (打开 Allbirds)
不用 WebMCP

20k

token

14.2s · 8.3 步 · 每千次 $12.57

解决 3/3

3.4× token 更少

用 webmcpx

6.0k

token

5.2s · 2.0 步 · 每千次 $4.28

解决 3/3
Token(按问题统计,每次运行的 token 数):越低越好。另附各组成功率。
问题不用 WebMCP:token用 webmcpx:token不用 WebMCP:解决情况用 webmcpx:解决情况
Allbirds:I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there?20k6.0k100%100%
耗时(按问题统计,每次运行的秒数):越低越好。另附各组成功率。
问题不用 WebMCP:耗时用 webmcpx:耗时不用 WebMCP:解决情况用 webmcpx:解决情况
Allbirds:I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there?14.2s5.2s100%100%
步数(按问题统计,每次运行的模型轮次):越低越好。另附各组成功率。
问题不用 WebMCP:步数用 webmcpx:步数不用 WebMCP:解决情况用 webmcpx:解决情况
Allbirds:I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there?8.32.0100%100%
成本(按问题统计,每 1,000 次运行的美元数):越低越好。另附各组成功率。
问题不用 WebMCP:成本用 webmcpx:成本不用 WebMCP:解决情况用 webmcpx:解决情况
Allbirds:I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there?$12.57$4.28100%100%

Allbirds 注册的 12 个 WebMCP 工具

智能体当时看到的版本 · 2026-11-07

工具描述已调用
ask_business

Ask the store a question about its policies and services: returns, refunds and exchanges, shipping and delivery, privacy, terms, subscriptions, contact details and opening hours, or FAQ topics such as gift wrapping. The store answers it: from its own knowledge base when the store offers Ask, otherwise from its published policies, FAQ pages and articles. Put the shopper's question in ask.query in their own words, one question per call; name the topic when the shopper only implies it (e.g. a question about sending back a gift is a returns question). Read-only: it does not change the cart, place orders, or start returns. For products, prices and availability, use search_catalog or get_product. Examples of questions: - What is your return policy? - How long does shipping to Canada take? - What is your phone number? - What are your hours of operation? - Do you offer gift wrapping?

ask_business({"ask":{"query":"I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there?","context":{"intent":"Exchange a US purchase for another size in London, UK"}}})

已调用
browse_store

Browse OR navigate to store collections. Set navigate=true whenever the user wants to be taken to a collection page in the browser (triggers: "browse to", "go to", "show me", "open", "take me to", "navigate to" a collection or category). With navigate=false (default), returns collection or product data without changing the page — use this only when the user is asking a question about the catalog, not asking to view it. Without a collection handle, lists all collections. With a handle, returns products from that collection; use "all" to browse everything. Does NOT add anything to the cart; use create_cart or update_cart for cart changes. Prefer this over search_catalog when the user names a category, collection, or wants to explore. With navigate=true this MOVES the browser to the collection page; the tool result confirms the destination, and no further navigation is needed to show it.

–未调用
cancel_cart

Remove all items from the cart in one step. Use when the user wants to empty their cart or start over.

–未调用
create_cart

Create the shopper's cart with the given items, for a shopper whose cart has no items yet. It is the tool for a shopper asking to add or buy something when the cart is empty, and that request is all the authorization it needs. Each line item names a ProductVariant GID in item.id (variant_id from search_catalog or browse_store, or variants[].id from get_product for specific options) and a quantity; every item from one request fits in one call. When the cart already has items, nothing is created or changed: the result is that existing cart with an error message, and update_cart can extend it with its current lines plus the new ones. Returns the whole resulting cart, including its id and line ids. Repeating a call with the same items leaves the cart as it is.

–未调用
get_cart

Get the shopper's current cart: its id, every line (line id, product and variant titles, variant id, handle, URL, image, unit price, quantity, line price) and the totals. Everything needed to describe the cart to the user in natural language, without a follow-up get_product call per line. It is also where a change to an existing cart starts from: update_cart takes the cart's id and the complete set of lines the cart should hold, and create_cart applies only to a cart with no items. Works from any page.

–未调用
get_product

Get product details, OR navigate the browser to the product page. Set catalog.navigate=true whenever the user wants to see/view the product in the browser (triggers: "show me", "open", "view", "go to", "take me to", "navigate to" a product). Set catalog.navigate=false (default) only when you need data (description, options, variants, prices, availability) to answer a question or to prepare a cart change — the browser stays on the current page. Defaults to the current page's product if no catalog.id is provided. Does NOT add anything to the cart; use create_cart or update_cart for that. To view a specific variant (color/size/etc.) in the browser, use show_variant instead — it accepts partial option selections like "purple" without needing every option. To add a specific variant to the cart, call get_product with catalog.selected_options to get its variant id. With catalog.navigate=true this MOVES the browser to the product page; the tool result confirms the destination, and no further navigation is needed to show it.

–未调用
get_ucp_profile

Get this store's Universal Commerce Protocol (UCP) profile, as served at /.well-known/ucp: the UCP version, the services the store offers with their endpoints (e.g. the store's UCP MCP server), its capabilities, and its payment handlers. Use it to discover how to continue a purchase with this store over UCP, or to check which platform operates the store. Read-only; works from any page.

–未调用
manage_orders

Navigate to the customer's order history page. Use when the user asks about past orders, order status, tracking, or returns. The user will be prompted to log in if not already authenticated. This MOVES the browser to the order history page; the tool result confirms the destination, and no further navigation is needed to show it.

–未调用
proceed_to_checkout

Proceed to checkout. Verifies the cart is not empty, then MOVES the browser to the checkout page. The tool result confirms the destination, and no further navigation is needed to show it.

–未调用
search_catalog

Search the store catalog for products, collections, articles, and pages. Does NOT add anything to the cart; use create_cart or update_cart for cart changes. Each product carries variant_id, its selected or first available variant. If the user asks for a specific product variant, call get_product after search_catalog to get that variant's id, or use show_variant to display it.

–未调用
show_variant

Navigate the browser to a product page, with a specific variant OR a partial option filter selected. Use for view intents: "show me", "open", "view", "go to", "take me to" a specific product configuration. Accepts EITHER variant_id (fully specified variant) OR selected_options (partial, e.g. only Color=Purple) — with partial options the first matching available variant is picked automatically, so DO NOT ask the user for missing options when their intent is to view. Does NOT add anything to the cart; use create_cart or update_cart for cart changes. For cart operations you still need a full variant_id — call get_product with the full option combination first. This MOVES the browser to the exact variant page with the variant pre-selected; the tool result confirms the destination, and no further navigation is needed to show it.

–未调用
update_cart

Set the shopper's cart to exactly the given line items. This is a full replacement, not a patch: afterwards the cart holds these lines and only these. - A listed line with its line_items[].id keeps its place and is set to the given quantity, which is absolute (2 means 2, not 2 more). - A listed item without a line id is added, or, when that variant is already on one line of the cart, sets that line's quantity. - A line in the cart that is not listed is removed. It takes the cart's lines as most recently returned by get_cart, create_cart or update_cart. When the cart has changed since then (for example, the shopper edited it on the page, or a new cart replaced it), or an id is given that is not the shopper's current cart, nothing changes and the result is the current cart with an error message. Since the outcome depends only on the lines sent, repeating a call leaves the cart as it is. An empty line_items list empties the cart; leaving line_items out leaves the lines as they are. Returns the whole resulting cart, including its line ids, and messages about the call.

–未调用
  • gpt-6.1-sol,推理强度 medium,无头 Chrome。两组使用相同的提示词和步数上限;每个问题每组运行 3 次。
  • 不用 WebMCP:基于 DOM 快照的智能体,靠读、点、填完成操作。
  • 用 webmcpx:只能使用页面注册的工具。
  • 按答案中的事实和页面状态评分,不用 LLM 当评委。
  • 真实网站:自带 WebMCP 工具。
复现步骤
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just bench

Orbit docs

“By default, how many past releases does Orbit keep for rollback?”

不用 WebMCP

2.5k

token

2.6s · 2.0 步 · 每千次 $2.93

解决 3/3

2.5× token 更少

用 webmcpx

998

token

2.7s · 2.0 步 · 每千次 $2.40

解决 3/3
Token(按问题统计,每次运行的 token 数):越低越好。另附各组成功率。
问题不用 WebMCP:token用 webmcpx:token不用 WebMCP:解决情况用 webmcpx:解决情况
Orbit docs(本地测试网站):By default, how many past releases does Orbit keep for rollback?2.5k998100%100%
Orbit docs(本地测试网站):Which environment variable makes Orbit read its config file from a different path?2.5k1.0k100%100%
Orbit docs(本地测试网站):My CI step failed with orbit exit code 4. What does that mean?2.6k1.0k100%100%
耗时(按问题统计,每次运行的秒数):越低越好。另附各组成功率。
问题不用 WebMCP:耗时用 webmcpx:耗时不用 WebMCP:解决情况用 webmcpx:解决情况
Orbit docs(本地测试网站):By default, how many past releases does Orbit keep for rollback?2.6s2.7s100%100%
Orbit docs(本地测试网站):Which environment variable makes Orbit read its config file from a different path?3.2s3.6s100%100%
Orbit docs(本地测试网站):My CI step failed with orbit exit code 4. What does that mean?3.4s3.0s100%100%
步数(按问题统计,每次运行的模型轮次):越低越好。另附各组成功率。
问题不用 WebMCP:步数用 webmcpx:步数不用 WebMCP:解决情况用 webmcpx:解决情况
Orbit docs(本地测试网站):By default, how many past releases does Orbit keep for rollback?2.02.0100%100%
Orbit docs(本地测试网站):Which environment variable makes Orbit read its config file from a different path?2.02.0100%100%
Orbit docs(本地测试网站):My CI step failed with orbit exit code 4. What does that mean?2.02.0100%100%
成本(按问题统计,每 1,000 次运行的美元数):越低越好。另附各组成功率。
问题不用 WebMCP:成本用 webmcpx:成本不用 WebMCP:解决情况用 webmcpx:解决情况
Orbit docs(本地测试网站):By default, how many past releases does Orbit keep for rollback?$2.93$2.40100%100%
Orbit docs(本地测试网站):Which environment variable makes Orbit read its config file from a different path?$2.99$2.53100%100%
Orbit docs(本地测试网站):My CI step failed with orbit exit code 4. What does that mean?$3.32$2.85100%100%

Orbit docs 注册的 3 个 WebMCP 工具

智能体当时看到的版本 · 2026-11-07

工具描述已调用
search_page

Find passages on the current page that match a query. Returns up to `limit` passages ranked by relevance, each with its section heading and a link to it. Prefer it to reading the whole page when looking for something specific.

search_page({"query":"rollback past releases default","limit":5})

search_page({"query":"environment variable config file path","limit":5})

search_page({"query":"orbit exit code 4","limit":5})

已调用
fetch_as_markdown

Return the main content of the current page as Markdown. Long pages come in parts: when `truncated` is true, call again with `cursor` set to `next_cursor`.

–未调用
get_page_context

Describe the page the user is on: title, URL, language, meta description, heading outline and the text the user has selected. Use it for the page's structure or the user's selection; to find a fact on the page, call search_page instead.

–未调用
  • gpt-6.1-sol,推理强度 medium,无头 Chrome。两组使用相同的提示词和步数上限;每个问题每组运行 3 次。
  • 不用 WebMCP:基于 DOM 快照的智能体,靠读、点、填完成操作。
  • 用 webmcpx:只能使用页面注册的工具。
  • 按答案中的事实和页面状态评分,不用 LLM 当评委。
  • 本地测试网站:工具由 webmcpx 提供。
复现步骤
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just bench