Бенчмарк
Тот же агент. Тот же вопрос.
Один агент читает, кликает и заполняет формы по снимкам страницы, другой вызывает WebMCP-инструменты сайта. Выберите модель; сначала — наибольшая экономия.
GPT-6.1 Sol (OpenAI)
Отобранные случаи: 21 из 35 вопросов, где WebMCP потратил не больше половины токенов. Все результаты открыты — или запустите бенчмарк сами: just bench.
Notion
“How many requests per minute does the Notion API allow per connection on plans other than Business and Enterprise?”
developers.notion.com Открыть (откроется Notion)25k
токенов
10.3s · шагов: 5.0 · $13.77 за 1 000
Решено 3/324× меньше токенов
1.1k
токенов
3.6s · шагов: 2.0 · $2.59 за 1 000
Решено 3/3| Вопрос | Без WebMCP: токены | С webmcpx: токены | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Notion: How many requests per minute does the Notion API allow per connection on plans other than Business and Enterprise? | 25k | 1.1k | 100% | 100% |
| Notion: I'm writing long paragraphs into a Notion page through the API. What's the maximum number of characters a single rich text object's text content can have in a request? | 22k | 1.1k | 100% | 100% |
| Notion: I'm paginating through results from the Notion API. What's the largest page_size I can request per call on the list endpoints? | 14k | 1.1k | 100% | 100% |
| Notion: When my Notion integration sends too many requests, what error code string does the API put in the error response body? | 14k | 4.6k | 100% | 100% |
| Вопрос | Без WebMCP: время | С webmcpx: время | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Notion: How many requests per minute does the Notion API allow per connection on plans other than Business and Enterprise? | 10.3s | 3.6s | 100% | 100% |
| Notion: I'm writing long paragraphs into a Notion page through the API. What's the maximum number of characters a single rich text object's text content can have in a request? | 9.2s | 4.1s | 100% | 100% |
| Notion: I'm paginating through results from the Notion API. What's the largest page_size I can request per call on the list endpoints? | 9.5s | 5.4s | 100% | 100% |
| Notion: When my Notion integration sends too many requests, what error code string does the API put in the error response body? | 9.1s | 7.1s | 100% | 100% |
| Вопрос | Без WebMCP: шаги | С webmcpx: шаги | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Notion: How many requests per minute does the Notion API allow per connection on plans other than Business and Enterprise? | 5.0 | 2.0 | 100% | 100% |
| Notion: I'm writing long paragraphs into a Notion page through the API. What's the maximum number of characters a single rich text object's text content can have in a request? | 4.7 | 2.0 | 100% | 100% |
| Notion: I'm paginating through results from the Notion API. What's the largest page_size I can request per call on the list endpoints? | 6.0 | 2.0 | 100% | 100% |
| Notion: When my Notion integration sends too many requests, what error code string does the API put in the error response body? | 6.0 | 4.0 | 100% | 100% |
| Вопрос | Без WebMCP: стоимость | С webmcpx: стоимость | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Notion: How many requests per minute does the Notion API allow per connection on plans other than Business and Enterprise? | $13.77 | $2.59 | 100% | 100% |
| Notion: I'm writing long paragraphs into a Notion page through the API. What's the maximum number of characters a single rich text object's text content can have in a request? | $13.68 | $3.01 | 100% | 100% |
| Notion: I'm paginating through results from the Notion API. What's the largest page_size I can request per call on the list endpoints? | $6.69 | $2.84 | 100% | 100% |
| Notion: When my Notion integration sends too many requests, what error code string does the API put in the error response body? | $6.80 | $7.40 | 100% | 100% |
Notion регистрирует 5 инструментов WebMCP
так их видел агент · 2026-11-07
| Инструмент | Описание | Вызван |
|---|---|---|
search_docs | Search the Notion Docs documentation for relevant pages and content. search_docs({"query":"rate limits requests per minute per connection Business Enterprise"}) search_docs({"query":"rich text text content maximum length request 2000 characters"}) search_docs({"query":"pagination maximum page_size list endpoints"}) search_docs({"query":"rate limits error code rate_limited"}) search_docs({"query":"status codes rate_limited 429"}) | Вызван |
read_page | Read the full content of a Notion Docs documentation page as markdown. read_page({"path":"https://developers.notion.com/reference/status-codes"}) | Вызван |
get_site_overview | Get an outline of the Notion Docs documentation, grouped by section, with a short description of each page. May be truncated for large sites; use search_docs to find pages not listed. | –Не вызван |
navigate_page | Navigate the current browser tab to a Notion Docs documentation page. | –Не вызван |
read_skill | Read a Notion Docs agent skill document by name. | –Не вызван |
- gpt-6.1-sol, reasoning medium, headless Chrome. В обоих вариантах одинаковые промпт и лимит шагов; 3 запуска на вопрос и вариант.
- Без WebMCP: агент на снимках DOM, который читает, кликает и заполняет формы.
- С webmcpx: только инструменты, которые регистрирует страница.
- Оценка — по фактам в ответе и состоянию страницы. Без LLM-судьи.
- Реальный сайт: у него собственные WebMCP-инструменты.
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just benchCloudflare
“What is the maximum size of a single value stored in Cloudflare Workers KV?”
developers.cloudflare.com Открыть (откроется Cloudflare)21k
токенов
7.9s · шагов: 6.0 · $8.74 за 1 000
Решено 3/320× меньше токенов
1.0k
токенов
4.7s · шагов: 2.0 · $2.62 за 1 000
Решено 3/3| Вопрос | Без WebMCP: токены | С webmcpx: токены | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Cloudflare: What is the maximum size of a single value stored in Cloudflare Workers KV? | 21k | 1.0k | 100% | 100% |
| Cloudflare: How many requests per day can my Workers handle on the Cloudflare Workers Free plan before hitting the limit? | 40k | 9.5k | 100% | 100% |
| Cloudflare: How long can a key be in Cloudflare Workers KV? I want to know the maximum key size. | 21k | 6.7k | 100% | 100% |
| Cloudflare: I'm on the Workers Paid plan. What's the maximum size a single Cloudflare D1 database can grow to? | 22k | 9.6k | 100% | 100% |
| Cloudflare: What is the largest message I can send to a Cloudflare Queue? I need the per-message size limit. | 21k | 9.8k | 100% | 100% |
| Вопрос | Без WebMCP: время | С webmcpx: время | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Cloudflare: What is the maximum size of a single value stored in Cloudflare Workers KV? | 7.9s | 4.7s | 100% | 100% |
| Cloudflare: How many requests per day can my Workers handle on the Cloudflare Workers Free plan before hitting the limit? | 8.8s | 6.1s | 100% | 100% |
| Cloudflare: How long can a key be in Cloudflare Workers KV? I want to know the maximum key size. | 8.1s | 5.7s | 100% | 100% |
| Cloudflare: I'm on the Workers Paid plan. What's the maximum size a single Cloudflare D1 database can grow to? | 8.5s | 6.0s | 100% | 100% |
| Cloudflare: What is the largest message I can send to a Cloudflare Queue? I need the per-message size limit. | 8.3s | 6.1s | 100% | 100% |
| Вопрос | Без WebMCP: шаги | С webmcpx: шаги | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Cloudflare: What is the maximum size of a single value stored in Cloudflare Workers KV? | 6.0 | 2.0 | 100% | 100% |
| Cloudflare: How many requests per day can my Workers handle on the Cloudflare Workers Free plan before hitting the limit? | 6.0 | 3.0 | 100% | 100% |
| Cloudflare: How long can a key be in Cloudflare Workers KV? I want to know the maximum key size. | 6.0 | 2.7 | 100% | 100% |
| Cloudflare: I'm on the Workers Paid plan. What's the maximum size a single Cloudflare D1 database can grow to? | 6.0 | 3.0 | 100% | 100% |
| Cloudflare: What is the largest message I can send to a Cloudflare Queue? I need the per-message size limit. | 6.0 | 3.0 | 100% | 100% |
| Вопрос | Без WebMCP: стоимость | С webmcpx: стоимость | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Cloudflare: What is the maximum size of a single value stored in Cloudflare Workers KV? | $8.74 | $2.62 | 100% | 100% |
| Cloudflare: How many requests per day can my Workers handle on the Cloudflare Workers Free plan before hitting the limit? | $20.61 | $6.62 | 100% | 100% |
| Cloudflare: How long can a key be in Cloudflare Workers KV? I want to know the maximum key size. | $8.74 | $6.52 | 100% | 100% |
| Cloudflare: I'm on the Workers Paid plan. What's the maximum size a single Cloudflare D1 database can grow to? | $9.79 | $6.17 | 100% | 100% |
| Cloudflare: What is the largest message I can send to a Cloudflare Queue? I need the per-message size limit. | $9.34 | $6.66 | 100% | 100% |
Cloudflare регистрирует 2 инструмента WebMCP
так их видел агент · 2026-11-07
| Инструмент | Описание | Вызван |
|---|---|---|
search | Full-text search across Cloudflare developer documentation. Returns matching pages with titles, URLs, and content snippets. Use this to find documentation on any Cloudflare product or feature. search({"query":"Workers KV maximum size single value","limit":3}) search({"query":"Workers Free requests per day 100,000 midnight UTC","limit":3}) search({"query":"Workers KV maximum key size","limit":3}) search({"query":"D1 limits maximum database size Workers Paid","limit":3}) search({"query":"queues limits message size","limit":3}) | Вызван |
list-directories | Returns a list of all Cloudflare products available in the developer documentation, including each product's name, docs URL, short description, and category group. Use this to discover what products exist before searching or navigating. list-directories({}) list-directories({}) list-directories({}) | Вызван |
- gpt-6.1-sol, reasoning medium, headless Chrome. В обоих вариантах одинаковые промпт и лимит шагов; 3 запуска на вопрос и вариант.
- Без WebMCP: агент на снимках DOM, который читает, кликает и заполняет формы.
- С webmcpx: только инструменты, которые регистрирует страница.
- Оценка — по фактам в ответе и состоянию страницы. Без LLM-судьи.
- Реальный сайт: у него собственные WebMCP-инструменты.
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just benchspecification.website
“How long should a page's meta description be, according to this spec?”
specification.website Открыть (откроется specification.website)40k
токенов
14.6s · шагов: 10.0 · $16.52 за 1 000
Решено 3/310× меньше токенов
3.9k
токенов
5.2s · шагов: 3.0 · $6.63 за 1 000
Решено 3/3| Вопрос | Без WebMCP: токены | С webmcpx: токены | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| specification.website: How long should a page's meta description be, according to this spec? | 40k | 3.9k | 100% | 100% |
| specification.website: What max-age should I put in my HSTS header for production, per this spec? | 13k | 3.7k | 100% | 100% |
| specification.website: What minimum contrast ratio does this site's spec require for normal-size body text? | 13k | 3.7k | 100% | 100% |
| specification.website: What INP value does this spec set as the target for good responsiveness? | 13k | 3.8k | 100% | 100% |
| specification.website: What's the minimum tap target size this spec requires for buttons and other interactive controls? | 14k | 4.5k | 100% | 100% |
| Вопрос | Без WebMCP: время | С webmcpx: время | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| specification.website: How long should a page's meta description be, according to this spec? | 14.6s | 5.2s | 100% | 100% |
| specification.website: What max-age should I put in my HSTS header for production, per this spec? | 9.0s | 5.7s | 100% | 100% |
| specification.website: What minimum contrast ratio does this site's spec require for normal-size body text? | 7.9s | 5.5s | 100% | 100% |
| specification.website: What INP value does this spec set as the target for good responsiveness? | 7.7s | 4.5s | 100% | 100% |
| specification.website: What's the minimum tap target size this spec requires for buttons and other interactive controls? | 8.5s | 5.7s | 100% | 100% |
| Вопрос | Без WebMCP: шаги | С webmcpx: шаги | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| specification.website: How long should a page's meta description be, according to this spec? | 10.0 | 3.0 | 100% | 100% |
| specification.website: What max-age should I put in my HSTS header for production, per this spec? | 6.0 | 3.0 | 100% | 100% |
| specification.website: What minimum contrast ratio does this site's spec require for normal-size body text? | 6.0 | 3.0 | 100% | 100% |
| specification.website: What INP value does this spec set as the target for good responsiveness? | 6.0 | 3.0 | 100% | 100% |
| specification.website: What's the minimum tap target size this spec requires for buttons and other interactive controls? | 6.0 | 3.0 | 100% | 100% |
| Вопрос | Без WebMCP: стоимость | С webmcpx: стоимость | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| specification.website: How long should a page's meta description be, according to this spec? | $16.52 | $6.63 | 100% | 100% |
| specification.website: What max-age should I put in my HSTS header for production, per this spec? | $6.91 | $9.44 | 100% | 100% |
| specification.website: What minimum contrast ratio does this site's spec require for normal-size body text? | $6.47 | $7.08 | 100% | 100% |
| specification.website: What INP value does this spec set as the target for good responsiveness? | $6.27 | $7.69 | 100% | 100% |
| specification.website: What's the minimum tap target size this spec requires for buttons and other interactive controls? | $7.24 | $9.33 | 100% | 100% |
specification.website регистрирует 5 инструментов WebMCP
так их видел агент · 2026-11-07
| Инструмент | Описание | Вызван |
|---|---|---|
search_spec | Search The Website Specification for matching topics. Returns ranked results with title, status, category, canonical URL, and a one-line summary. Use this when the user asks about a topic by keyword (e.g. "CSP", "alt text", "llms.txt"). search_spec({"query":"meta description length","limit":5}) search_spec({"query":"HSTS max-age production","limit":5}) search_spec({"query":"contrast ratio normal text","limit":3}) search_spec({"query":"INP","limit":5}) search_spec({"query":"tap target size interactive controls","limit":5}) | Вызван |
get_topic | Fetch the Markdown for one spec page by its slug, returned as lines you can page through. Use this after search_spec or list_topics to read the canonical guidance. get_topic({"slug":"meta-description"}) get_topic({"slug":"hsts"}) get_topic({"slug":"color-contrast","limit":100}) get_topic({"slug":"core-web-vitals","limit":100}) get_topic({"slug":"touch-target-size","limit":120}) | Вызван |
list_topics | List spec topics, optionally filtered by category and/or status. Returns title, status, category, summary, and URL per topic. Use this when the user wants the canonical list (e.g. "all required SEO topics"). Results are paged — follow page/page_size to walk the whole list. | –Не вызван |
open_checklist | Navigate the user to the full spec checklist page. Optionally jumps to a category section via URL hash. UI action — does not return data. | –Не вызван |
open_search | Open the on-page ⌘K search overlay so the user can search the spec interactively. Optionally pre-fills a query. UI action — does not return results; use search_spec for that. | –Не вызван |
- gpt-6.1-sol, reasoning medium, headless Chrome. В обоих вариантах одинаковые промпт и лимит шагов; 3 запуска на вопрос и вариант.
- Без WebMCP: агент на снимках DOM, который читает, кликает и заполняет формы.
- С webmcpx: только инструменты, которые регистрирует страница.
- Оценка — по фактам в ответе и состоянию страницы. Без LLM-судьи.
- Реальный сайт: у него собственные WebMCP-инструменты.
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just benchKiln & Co
“Add one Stoneware Teapot and one Speckled Bowl to my cart, then tell me the cart total.”
12k
токенов
9.0s · шагов: 6.0 · $5.77 за 1 000
Решено 3/35.1× меньше токенов
2.4k
токенов
5.5s · шагов: 4.0 · $5.88 за 1 000
Решено 3/3| Вопрос | Без WebMCP: токены | С webmcpx: токены | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Kiln & Co (локальный тестовый сайт): Add one Stoneware Teapot and one Speckled Bowl to my cart, then tell me the cart total. | 12k | 2.4k | 100% | 100% |
| Kiln & Co (локальный тестовый сайт): Add two of the cheapest blue mug to my cart. | 7.1k | 1.5k | 100% | 100% |
| Kiln & Co (локальный тестовый сайт): Put the most expensive teapot you sell in my cart. | 5.6k | 1.5k | 100% | 100% |
| Вопрос | Без WebMCP: время | С webmcpx: время | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Kiln & Co (локальный тестовый сайт): Add one Stoneware Teapot and one Speckled Bowl to my cart, then tell me the cart total. | 9.0s | 5.5s | 100% | 100% |
| Kiln & Co (локальный тестовый сайт): Add two of the cheapest blue mug to my cart. | 8.0s | 4.0s | 100% | 100% |
| Kiln & Co (локальный тестовый сайт): Put the most expensive teapot you sell in my cart. | 6.2s | 3.8s | 100% | 100% |
| Вопрос | Без WebMCP: шаги | С webmcpx: шаги | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Kiln & Co (локальный тестовый сайт): Add one Stoneware Teapot and one Speckled Bowl to my cart, then tell me the cart total. | 6.0 | 4.0 | 100% | 100% |
| Kiln & Co (локальный тестовый сайт): Add two of the cheapest blue mug to my cart. | 5.0 | 3.0 | 100% | 100% |
| Kiln & Co (локальный тестовый сайт): Put the most expensive teapot you sell in my cart. | 4.0 | 3.0 | 100% | 100% |
| Вопрос | Без WebMCP: стоимость | С webmcpx: стоимость | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Kiln & Co (локальный тестовый сайт): Add one Stoneware Teapot and one Speckled Bowl to my cart, then tell me the cart total. | $5.77 | $5.88 | 100% | 100% |
| Kiln & Co (локальный тестовый сайт): Add two of the cheapest blue mug to my cart. | $4.14 | $3.70 | 100% | 100% |
| Kiln & Co (локальный тестовый сайт): Put the most expensive teapot you sell in my cart. | $3.73 | $3.50 | 100% | 100% |
Kiln & Co регистрирует 4 инструмента WebMCP
так их видел агент · 2026-11-07
| Инструмент | Описание | Вызван |
|---|---|---|
search_products | Search the catalog. Every filter is optional; with none, returns every product. Prices are USD. search_products({"query":"Stoneware Teapot"}) search_products({"query":"Speckled Bowl"}) search_products({"category":"mug","color":"blue","sort":"price_asc"}) search_products({"category":"teapot","sort":"price_desc"}) | Вызван |
add_to_cart | Add a product to the cart by sku. Adding a sku already in the cart increases its quantity. add_to_cart({"quantity":1,"sku":"TPT-01"}) add_to_cart({"quantity":1,"sku":"BWL-01"}) add_to_cart({"quantity":2,"sku":"MUG-03"}) add_to_cart({"sku":"TPT-02","quantity":1}) | Вызван |
get_cart | Return the cart: items with quantity and the total in USD. | –Не вызван |
get_page_context | Describe the page the user is on: title, URL, language, meta description, heading outline and the text the user has selected. Use it for the page's structure or the user's selection; to find a fact on the page, call search_page instead. | –Не вызван |
- gpt-6.1-sol, reasoning medium, headless Chrome. В обоих вариантах одинаковые промпт и лимит шагов; 3 запуска на вопрос и вариант.
- Без WebMCP: агент на снимках DOM, который читает, кликает и заполняет формы.
- С webmcpx: только инструменты, которые регистрирует страница.
- Оценка — по фактам в ответе и состоянию страницы. Без LLM-судьи.
- Локальный тестовый сайт: инструменты ему даёт webmcpx.
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just benchAllbirds
“I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there?”
www.allbirds.com Открыть (откроется Allbirds)20k
токенов
14.2s · шагов: 8.3 · $12.57 за 1 000
Решено 3/33.4× меньше токенов
6.0k
токенов
5.2s · шагов: 2.0 · $4.28 за 1 000
Решено 3/3| Вопрос | Без WebMCP: токены | С webmcpx: токены | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Allbirds: I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there? | 20k | 6.0k | 100% | 100% |
| Вопрос | Без WebMCP: время | С webmcpx: время | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Allbirds: I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there? | 14.2s | 5.2s | 100% | 100% |
| Вопрос | Без WebMCP: шаги | С webmcpx: шаги | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Allbirds: I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there? | 8.3 | 2.0 | 100% | 100% |
| Вопрос | Без WebMCP: стоимость | С webmcpx: стоимость | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Allbirds: I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there? | $12.57 | $4.28 | 100% | 100% |
Allbirds регистрирует 12 инструментов WebMCP
так их видел агент · 2026-11-07
| Инструмент | Описание | Вызван |
|---|---|---|
ask_business | Ask the store a question about its policies and services: returns, refunds and exchanges, shipping and delivery, privacy, terms, subscriptions, contact details and opening hours, or FAQ topics such as gift wrapping. The store answers it: from its own knowledge base when the store offers Ask, otherwise from its published policies, FAQ pages and articles. Put the shopper's question in ask.query in their own words, one question per call; name the topic when the shopper only implies it (e.g. a question about sending back a gift is a returns question). Read-only: it does not change the cart, place orders, or start returns. For products, prices and availability, use search_catalog or get_product. Examples of questions: - What is your return policy? - How long does shipping to Canada take? - What is your phone number? - What are your hours of operation? - Do you offer gift wrapping? ask_business({"ask":{"query":"I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there?","context":{"intent":"Exchange a US purchase for another size in London, UK"}}}) | Вызван |
browse_store | Browse OR navigate to store collections. Set navigate=true whenever the user wants to be taken to a collection page in the browser (triggers: "browse to", "go to", "show me", "open", "take me to", "navigate to" a collection or category). With navigate=false (default), returns collection or product data without changing the page — use this only when the user is asking a question about the catalog, not asking to view it. Without a collection handle, lists all collections. With a handle, returns products from that collection; use "all" to browse everything. Does NOT add anything to the cart; use create_cart or update_cart for cart changes. Prefer this over search_catalog when the user names a category, collection, or wants to explore. With navigate=true this MOVES the browser to the collection page; the tool result confirms the destination, and no further navigation is needed to show it. | –Не вызван |
cancel_cart | Remove all items from the cart in one step. Use when the user wants to empty their cart or start over. | –Не вызван |
create_cart | Create the shopper's cart with the given items, for a shopper whose cart has no items yet. It is the tool for a shopper asking to add or buy something when the cart is empty, and that request is all the authorization it needs. Each line item names a ProductVariant GID in item.id (variant_id from search_catalog or browse_store, or variants[].id from get_product for specific options) and a quantity; every item from one request fits in one call. When the cart already has items, nothing is created or changed: the result is that existing cart with an error message, and update_cart can extend it with its current lines plus the new ones. Returns the whole resulting cart, including its id and line ids. Repeating a call with the same items leaves the cart as it is. | –Не вызван |
get_cart | Get the shopper's current cart: its id, every line (line id, product and variant titles, variant id, handle, URL, image, unit price, quantity, line price) and the totals. Everything needed to describe the cart to the user in natural language, without a follow-up get_product call per line. It is also where a change to an existing cart starts from: update_cart takes the cart's id and the complete set of lines the cart should hold, and create_cart applies only to a cart with no items. Works from any page. | –Не вызван |
get_product | Get product details, OR navigate the browser to the product page. Set catalog.navigate=true whenever the user wants to see/view the product in the browser (triggers: "show me", "open", "view", "go to", "take me to", "navigate to" a product). Set catalog.navigate=false (default) only when you need data (description, options, variants, prices, availability) to answer a question or to prepare a cart change — the browser stays on the current page. Defaults to the current page's product if no catalog.id is provided. Does NOT add anything to the cart; use create_cart or update_cart for that. To view a specific variant (color/size/etc.) in the browser, use show_variant instead — it accepts partial option selections like "purple" without needing every option. To add a specific variant to the cart, call get_product with catalog.selected_options to get its variant id. With catalog.navigate=true this MOVES the browser to the product page; the tool result confirms the destination, and no further navigation is needed to show it. | –Не вызван |
get_ucp_profile | Get this store's Universal Commerce Protocol (UCP) profile, as served at /.well-known/ucp: the UCP version, the services the store offers with their endpoints (e.g. the store's UCP MCP server), its capabilities, and its payment handlers. Use it to discover how to continue a purchase with this store over UCP, or to check which platform operates the store. Read-only; works from any page. | –Не вызван |
manage_orders | Navigate to the customer's order history page. Use when the user asks about past orders, order status, tracking, or returns. The user will be prompted to log in if not already authenticated. This MOVES the browser to the order history page; the tool result confirms the destination, and no further navigation is needed to show it. | –Не вызван |
proceed_to_checkout | Proceed to checkout. Verifies the cart is not empty, then MOVES the browser to the checkout page. The tool result confirms the destination, and no further navigation is needed to show it. | –Не вызван |
search_catalog | Search the store catalog for products, collections, articles, and pages. Does NOT add anything to the cart; use create_cart or update_cart for cart changes. Each product carries variant_id, its selected or first available variant. If the user asks for a specific product variant, call get_product after search_catalog to get that variant's id, or use show_variant to display it. | –Не вызван |
show_variant | Navigate the browser to a product page, with a specific variant OR a partial option filter selected. Use for view intents: "show me", "open", "view", "go to", "take me to" a specific product configuration. Accepts EITHER variant_id (fully specified variant) OR selected_options (partial, e.g. only Color=Purple) — with partial options the first matching available variant is picked automatically, so DO NOT ask the user for missing options when their intent is to view. Does NOT add anything to the cart; use create_cart or update_cart for cart changes. For cart operations you still need a full variant_id — call get_product with the full option combination first. This MOVES the browser to the exact variant page with the variant pre-selected; the tool result confirms the destination, and no further navigation is needed to show it. | –Не вызван |
update_cart | Set the shopper's cart to exactly the given line items. This is a full replacement, not a patch: afterwards the cart holds these lines and only these. - A listed line with its line_items[].id keeps its place and is set to the given quantity, which is absolute (2 means 2, not 2 more). - A listed item without a line id is added, or, when that variant is already on one line of the cart, sets that line's quantity. - A line in the cart that is not listed is removed. It takes the cart's lines as most recently returned by get_cart, create_cart or update_cart. When the cart has changed since then (for example, the shopper edited it on the page, or a new cart replaced it), or an id is given that is not the shopper's current cart, nothing changes and the result is the current cart with an error message. Since the outcome depends only on the lines sent, repeating a call leaves the cart as it is. An empty line_items list empties the cart; leaving line_items out leaves the lines as they are. Returns the whole resulting cart, including its line ids, and messages about the call. | –Не вызван |
- gpt-6.1-sol, reasoning medium, headless Chrome. В обоих вариантах одинаковые промпт и лимит шагов; 3 запуска на вопрос и вариант.
- Без WebMCP: агент на снимках DOM, который читает, кликает и заполняет формы.
- С webmcpx: только инструменты, которые регистрирует страница.
- Оценка — по фактам в ответе и состоянию страницы. Без LLM-судьи.
- Реальный сайт: у него собственные WebMCP-инструменты.
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just benchOrbit docs
“By default, how many past releases does Orbit keep for rollback?”
2.5k
токенов
2.6s · шагов: 2.0 · $2.93 за 1 000
Решено 3/32.5× меньше токенов
998
токенов
2.7s · шагов: 2.0 · $2.40 за 1 000
Решено 3/3| Вопрос | Без WebMCP: токены | С webmcpx: токены | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Orbit docs (локальный тестовый сайт): By default, how many past releases does Orbit keep for rollback? | 2.5k | 998 | 100% | 100% |
| Orbit docs (локальный тестовый сайт): Which environment variable makes Orbit read its config file from a different path? | 2.5k | 1.0k | 100% | 100% |
| Orbit docs (локальный тестовый сайт): My CI step failed with orbit exit code 4. What does that mean? | 2.6k | 1.0k | 100% | 100% |
| Вопрос | Без WebMCP: время | С webmcpx: время | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Orbit docs (локальный тестовый сайт): By default, how many past releases does Orbit keep for rollback? | 2.6s | 2.7s | 100% | 100% |
| Orbit docs (локальный тестовый сайт): Which environment variable makes Orbit read its config file from a different path? | 3.2s | 3.6s | 100% | 100% |
| Orbit docs (локальный тестовый сайт): My CI step failed with orbit exit code 4. What does that mean? | 3.4s | 3.0s | 100% | 100% |
| Вопрос | Без WebMCP: шаги | С webmcpx: шаги | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Orbit docs (локальный тестовый сайт): By default, how many past releases does Orbit keep for rollback? | 2.0 | 2.0 | 100% | 100% |
| Orbit docs (локальный тестовый сайт): Which environment variable makes Orbit read its config file from a different path? | 2.0 | 2.0 | 100% | 100% |
| Orbit docs (локальный тестовый сайт): My CI step failed with orbit exit code 4. What does that mean? | 2.0 | 2.0 | 100% | 100% |
| Вопрос | Без WebMCP: стоимость | С webmcpx: стоимость | Без WebMCP: решено | С webmcpx: решено |
|---|---|---|---|---|
| Orbit docs (локальный тестовый сайт): By default, how many past releases does Orbit keep for rollback? | $2.93 | $2.40 | 100% | 100% |
| Orbit docs (локальный тестовый сайт): Which environment variable makes Orbit read its config file from a different path? | $2.99 | $2.53 | 100% | 100% |
| Orbit docs (локальный тестовый сайт): My CI step failed with orbit exit code 4. What does that mean? | $3.32 | $2.85 | 100% | 100% |
Orbit docs регистрирует 3 инструмента WebMCP
так их видел агент · 2026-11-07
| Инструмент | Описание | Вызван |
|---|---|---|
search_page | Find passages on the current page that match a query. Returns up to `limit` passages ranked by relevance, each with its section heading and a link to it. Prefer it to reading the whole page when looking for something specific. search_page({"query":"rollback past releases default","limit":5}) search_page({"query":"environment variable config file path","limit":5}) search_page({"query":"orbit exit code 4","limit":5}) | Вызван |
fetch_as_markdown | Return the main content of the current page as Markdown. Long pages come in parts: when `truncated` is true, call again with `cursor` set to `next_cursor`. | –Не вызван |
get_page_context | Describe the page the user is on: title, URL, language, meta description, heading outline and the text the user has selected. Use it for the page's structure or the user's selection; to find a fact on the page, call search_page instead. | –Не вызван |
- gpt-6.1-sol, reasoning medium, headless Chrome. В обоих вариантах одинаковые промпт и лимит шагов; 3 запуска на вопрос и вариант.
- Без WebMCP: агент на снимках DOM, который читает, кликает и заполняет формы.
- С webmcpx: только инструменты, которые регистрирует страница.
- Оценка — по фактам в ответе и состоянию страницы. Без LLM-судьи.
- Локальный тестовый сайт: инструменты ему даёт webmcpx.
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just bench