Benchmark
Même agent. Même question.
Un agent lit, clique et remplit à partir de snapshots de la page ; l’autre appelle les outils WebMCP du site. Choisissez un modèle ; les plus fortes économies d’abord.
GPT-6 Luna (OpenAI)
Cas sélectionnés, 21 sur 35 : les questions où WebMCP a utilisé au plus la moitié des tokens. Tous les résultats sont publics ; vous pouvez aussi relancer le benchmark avec just bench.
Cloudflare
“How many requests per day can my Workers handle on the Cloudflare Workers Free plan before hitting the limit?”
developers.cloudflare.com Ouvrir (ouvre Cloudflare)113k
tokens
13.1s · 10.0 étapes · $4.45 pour 1 000
Résolu 3/397× moins de tokens
1.2k
tokens
3.8s · 2.0 étapes · $0.15 pour 1 000
Résolu 3/3| Question | Sans WebMCP : tokens | Avec webmcpx : tokens | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Cloudflare : How many requests per day can my Workers handle on the Cloudflare Workers Free plan before hitting the limit? | 113k | 1.2k | 100% | 100% |
| Cloudflare : I'm on the Workers Paid plan. What's the maximum size a single Cloudflare D1 database can grow to? | 22k | 1.0k | 100% | 100% |
| Cloudflare : What is the maximum size of a single value stored in Cloudflare Workers KV? | 21k | 1.0k | 100% | 100% |
| Cloudflare : How long can a key be in Cloudflare Workers KV? I want to know the maximum key size. | 21k | 1.5k | 100% | 100% |
| Cloudflare : What is the largest message I can send to a Cloudflare Queue? I need the per-message size limit. | 21k | 2.8k | 100% | 100% |
| Question | Sans WebMCP : durée | Avec webmcpx : durée | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Cloudflare : How many requests per day can my Workers handle on the Cloudflare Workers Free plan before hitting the limit? | 13.1s | 3.8s | 100% | 100% |
| Cloudflare : I'm on the Workers Paid plan. What's the maximum size a single Cloudflare D1 database can grow to? | 6.8s | 4.7s | 100% | 100% |
| Cloudflare : What is the maximum size of a single value stored in Cloudflare Workers KV? | 7.0s | 3.5s | 100% | 100% |
| Cloudflare : How long can a key be in Cloudflare Workers KV? I want to know the maximum key size. | 6.4s | 4.9s | 100% | 100% |
| Cloudflare : What is the largest message I can send to a Cloudflare Queue? I need the per-message size limit. | 6.4s | 9.2s | 100% | 100% |
| Question | Sans WebMCP : étapes | Avec webmcpx : étapes | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Cloudflare : How many requests per day can my Workers handle on the Cloudflare Workers Free plan before hitting the limit? | 10.0 | 2.0 | 100% | 100% |
| Cloudflare : I'm on the Workers Paid plan. What's the maximum size a single Cloudflare D1 database can grow to? | 6.0 | 2.0 | 100% | 100% |
| Cloudflare : What is the maximum size of a single value stored in Cloudflare Workers KV? | 6.0 | 2.0 | 100% | 100% |
| Cloudflare : How long can a key be in Cloudflare Workers KV? I want to know the maximum key size. | 6.0 | 2.3 | 100% | 100% |
| Cloudflare : What is the largest message I can send to a Cloudflare Queue? I need the per-message size limit. | 6.0 | 3.7 | 100% | 100% |
| Question | Sans WebMCP : coût | Avec webmcpx : coût | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Cloudflare : How many requests per day can my Workers handle on the Cloudflare Workers Free plan before hitting the limit? | $4.45 | $0.15 | 100% | 100% |
| Cloudflare : I'm on the Workers Paid plan. What's the maximum size a single Cloudflare D1 database can grow to? | $0.94 | $0.12 | 100% | 100% |
| Cloudflare : What is the maximum size of a single value stored in Cloudflare Workers KV? | $0.80 | $0.12 | 100% | 100% |
| Cloudflare : How long can a key be in Cloudflare Workers KV? I want to know the maximum key size. | $0.81 | $0.20 | 100% | 100% |
| Cloudflare : What is the largest message I can send to a Cloudflare Queue? I need the per-message size limit. | $0.86 | $0.32 | 100% | 100% |
Cloudflare enregistre 2 outils WebMCP
tels que l’agent les a vus · 2026-11-07
| Outil | Description | Appelé |
|---|---|---|
search | Full-text search across Cloudflare developer documentation. Returns matching pages with titles, URLs, and content snippets. Use this to find documentation on any Cloudflare product or feature. search({"query":"Workers Free plan requests per day limit 100,000 requests daily"}) search({"query":"D1 maximum database size Workers Paid plan single database"}) search({"query":"Cloudflare Workers KV maximum size of a single value"}) search({"query":"Cloudflare Workers KV maximum key size limit key length 512 bytes"}) search({"query":"Cloudflare Queues per-message size limit maximum message size","limit":5}) search({"query":"site:developers.cloudflare.com/queues/platform/limits/ message size 128 KB per message Cloudflare Queues","limit":5}) search({"query":"Queues Limits \"Message size\" Cloudflare 128 KB","limit":10}) search({"query":"\"Message size\" \"Queues\" \"128 KB\" Cloudflare","limit":5}) | Appelé |
list-directories | Returns a list of all Cloudflare products available in the developer documentation, including each product's name, docs URL, short description, and category group. Use this to discover what products exist before searching or navigating. | –Non appelé |
- gpt-6-luna, raisonnement medium, Chrome headless. Même prompt et même limite d’étapes dans les deux variantes ; 3 exécutions par question et par variante.
- Sans WebMCP : un agent qui lit, clique et remplit à partir de snapshots du DOM.
- Avec webmcpx : uniquement les outils que la page enregistre.
- Notation sur les faits présents dans la réponse et sur l’état de la page. Pas de LLM juge.
- Un site en ligne : il fournit ses propres outils WebMCP.
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just benchNotion
“I'm writing long paragraphs into a Notion page through the API. What's the maximum number of characters a single rich text object's text content can have in a request?”
developers.notion.com Ouvrir (ouvre Notion)64k
tokens
14.0s · 10.7 étapes · $2.37 pour 1 000
Résolu 3/361× moins de tokens
1.0k
tokens
3.0s · 2.0 étapes · $0.13 pour 1 000
Résolu 3/3| Question | Sans WebMCP : tokens | Avec webmcpx : tokens | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Notion : I'm writing long paragraphs into a Notion page through the API. What's the maximum number of characters a single rich text object's text content can have in a request? | 64k | 1.0k | 100% | 100% |
| Notion : How many requests per minute does the Notion API allow per connection on plans other than Business and Enterprise? | 57k | 1.1k | 33% | 100% |
| Notion : When my Notion integration sends too many requests, what error code string does the API put in the error response body? | 38k | 1.0k | 100% | 100% |
| Notion : I'm paginating through results from the Notion API. What's the largest page_size I can request per call on the list endpoints? | 37k | 1.1k | 67% | 100% |
| Question | Sans WebMCP : durée | Avec webmcpx : durée | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Notion : I'm writing long paragraphs into a Notion page through the API. What's the maximum number of characters a single rich text object's text content can have in a request? | 14.0s | 3.0s | 100% | 100% |
| Notion : How many requests per minute does the Notion API allow per connection on plans other than Business and Enterprise? | 17.3s | 3.1s | 33% | 100% |
| Notion : When my Notion integration sends too many requests, what error code string does the API put in the error response body? | 12.2s | 2.6s | 100% | 100% |
| Notion : I'm paginating through results from the Notion API. What's the largest page_size I can request per call on the list endpoints? | 11.1s | 3.0s | 67% | 100% |
| Question | Sans WebMCP : étapes | Avec webmcpx : étapes | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Notion : I'm writing long paragraphs into a Notion page through the API. What's the maximum number of characters a single rich text object's text content can have in a request? | 10.7 | 2.0 | 100% | 100% |
| Notion : How many requests per minute does the Notion API allow per connection on plans other than Business and Enterprise? | 11.7 | 2.0 | 33% | 100% |
| Notion : When my Notion integration sends too many requests, what error code string does the API put in the error response body? | 9.3 | 2.0 | 100% | 100% |
| Notion : I'm paginating through results from the Notion API. What's the largest page_size I can request per call on the list endpoints? | 9.3 | 2.0 | 67% | 100% |
| Question | Sans WebMCP : coût | Avec webmcpx : coût | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Notion : I'm writing long paragraphs into a Notion page through the API. What's the maximum number of characters a single rich text object's text content can have in a request? | $2.37 | $0.13 | 100% | 100% |
| Notion : How many requests per minute does the Notion API allow per connection on plans other than Business and Enterprise? | $1.79 | $0.13 | 33% | 100% |
| Notion : When my Notion integration sends too many requests, what error code string does the API put in the error response body? | $1.32 | $0.12 | 100% | 100% |
| Notion : I'm paginating through results from the Notion API. What's the largest page_size I can request per call on the list endpoints? | $1.13 | $0.13 | 67% | 100% |
Notion enregistre 5 outils WebMCP
tels que l’agent les a vus · 2026-11-07
| Outil | Description | Appelé |
|---|---|---|
search_docs | Search the Notion Docs documentation for relevant pages and content. search_docs({"query":"maximum number characters single rich text object text content request API rich_text 2000"}) search_docs({"query":"requests per minute per connection plans other than Business Enterprise Notion API rate limit"}) search_docs({"query":"too many requests error response body error code string rate limit"}) search_docs({"query":"largest page_size request per call list endpoints pagination maximum 100"}) | Appelé |
get_site_overview | Get an outline of the Notion Docs documentation, grouped by section, with a short description of each page. May be truncated for large sites; use search_docs to find pages not listed. | –Non appelé |
navigate_page | Navigate the current browser tab to a Notion Docs documentation page. | –Non appelé |
read_page | Read the full content of a Notion Docs documentation page as markdown. | –Non appelé |
read_skill | Read a Notion Docs agent skill document by name. | –Non appelé |
- gpt-6-luna, raisonnement medium, Chrome headless. Même prompt et même limite d’étapes dans les deux variantes ; 3 exécutions par question et par variante.
- Sans WebMCP : un agent qui lit, clique et remplit à partir de snapshots du DOM.
- Avec webmcpx : uniquement les outils que la page enregistre.
- Notation sur les faits présents dans la réponse et sur l’état de la page. Pas de LLM juge.
- Un site en ligne : il fournit ses propres outils WebMCP.
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just benchspecification.website
“How long should a page's meta description be, according to this spec?”
specification.website Ouvrir (ouvre specification.website)43k
tokens
13.2s · 11.3 étapes · $1.39 pour 1 000
Résolu 3/311× moins de tokens
4.0k
tokens
3.5s · 3.0 étapes · $0.39 pour 1 000
Résolu 3/3| Question | Sans WebMCP : tokens | Avec webmcpx : tokens | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| specification.website : How long should a page's meta description be, according to this spec? | 43k | 4.0k | 100% | 100% |
| specification.website : What's the minimum tap target size this spec requires for buttons and other interactive controls? | 41k | 4.4k | 67% | 100% |
| specification.website : What max-age should I put in my HSTS header for production, per this spec? | 18k | 3.7k | 100% | 100% |
| specification.website : What INP value does this spec set as the target for good responsiveness? | 13k | 3.3k | 100% | 100% |
| specification.website : What minimum contrast ratio does this site's spec require for normal-size body text? | 13k | 3.9k | 100% | 100% |
| Question | Sans WebMCP : durée | Avec webmcpx : durée | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| specification.website : How long should a page's meta description be, according to this spec? | 13.2s | 3.5s | 100% | 100% |
| specification.website : What's the minimum tap target size this spec requires for buttons and other interactive controls? | 13.1s | 3.5s | 67% | 100% |
| specification.website : What max-age should I put in my HSTS header for production, per this spec? | 8.0s | 3.9s | 100% | 100% |
| specification.website : What INP value does this spec set as the target for good responsiveness? | 7.2s | 3.0s | 100% | 100% |
| specification.website : What minimum contrast ratio does this site's spec require for normal-size body text? | 5.9s | 3.7s | 100% | 100% |
| Question | Sans WebMCP : étapes | Avec webmcpx : étapes | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| specification.website : How long should a page's meta description be, according to this spec? | 11.3 | 3.0 | 100% | 100% |
| specification.website : What's the minimum tap target size this spec requires for buttons and other interactive controls? | 10.3 | 3.0 | 67% | 100% |
| specification.website : What max-age should I put in my HSTS header for production, per this spec? | 6.7 | 3.0 | 100% | 100% |
| specification.website : What INP value does this spec set as the target for good responsiveness? | 6.0 | 2.7 | 100% | 100% |
| specification.website : What minimum contrast ratio does this site's spec require for normal-size body text? | 6.0 | 3.0 | 100% | 100% |
| Question | Sans WebMCP : coût | Avec webmcpx : coût | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| specification.website : How long should a page's meta description be, according to this spec? | $1.39 | $0.39 | 100% | 100% |
| specification.website : What's the minimum tap target size this spec requires for buttons and other interactive controls? | $1.34 | $0.35 | 67% | 100% |
| specification.website : What max-age should I put in my HSTS header for production, per this spec? | $0.76 | $0.31 | 100% | 100% |
| specification.website : What INP value does this spec set as the target for good responsiveness? | $0.59 | $0.29 | 100% | 100% |
| specification.website : What minimum contrast ratio does this site's spec require for normal-size body text? | $0.59 | $0.30 | 100% | 100% |
specification.website enregistre 5 outils WebMCP
tels que l’agent les a vus · 2026-11-07
| Outil | Description | Appelé |
|---|---|---|
search_spec | Search The Website Specification for matching topics. Returns ranked results with title, status, category, canonical URL, and a one-line summary. Use this when the user asks about a topic by keyword (e.g. "CSP", "alt text", "llms.txt"). search_spec({"query":"meta description recommended length characters"}) search_spec({"query":"minimum tap target size interactive controls buttons"}) search_spec({"query":"HSTS max-age production"}) search_spec({"query":"INP target good responsiveness value","limit":5}) search_spec({"query":"minimum contrast ratio normal-size body text WCAG"}) | Appelé |
get_topic | Fetch the Markdown for one spec page by its slug, returned as lines you can page through. Use this after search_spec or list_topics to read the canonical guidance. get_topic({"slug":"meta-description"}) get_topic({"slug":"touch-target-size"}) get_topic({"slug":"hsts","limit":200}) get_topic({"slug":"color-contrast"}) | Appelé |
list_topics | List spec topics, optionally filtered by category and/or status. Returns title, status, category, summary, and URL per topic. Use this when the user wants the canonical list (e.g. "all required SEO topics"). Results are paged — follow page/page_size to walk the whole list. | –Non appelé |
open_checklist | Navigate the user to the full spec checklist page. Optionally jumps to a category section via URL hash. UI action — does not return data. | –Non appelé |
open_search | Open the on-page ⌘K search overlay so the user can search the spec interactively. Optionally pre-fills a query. UI action — does not return results; use search_spec for that. | –Non appelé |
- gpt-6-luna, raisonnement medium, Chrome headless. Même prompt et même limite d’étapes dans les deux variantes ; 3 exécutions par question et par variante.
- Sans WebMCP : un agent qui lit, clique et remplit à partir de snapshots du DOM.
- Avec webmcpx : uniquement les outils que la page enregistre.
- Notation sur les faits présents dans la réponse et sur l’état de la page. Pas de LLM juge.
- Un site en ligne : il fournit ses propres outils WebMCP.
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just benchKiln & Co
“Add one Stoneware Teapot and one Speckled Bowl to my cart, then tell me the cart total.”
12k
tokens
7.7s · 6.0 étapes · $0.45 pour 1 000
Résolu 3/36.0× moins de tokens
2.1k
tokens
3.9s · 3.7 étapes · $0.26 pour 1 000
Résolu 3/3| Question | Sans WebMCP : tokens | Avec webmcpx : tokens | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Kiln & Co (site de test local) : Add one Stoneware Teapot and one Speckled Bowl to my cart, then tell me the cart total. | 12k | 2.1k | 100% | 100% |
| Kiln & Co (site de test local) : I need a green gift under $30 that I can buy right now. What do you have? | 5.7k | 1.1k | 100% | 100% |
| Kiln & Co (site de test local) : Add two of the cheapest blue mug to my cart. | 5.4k | 1.6k | 100% | 100% |
| Kiln & Co (site de test local) : Put the most expensive teapot you sell in my cart. | 4.8k | 1.5k | 100% | 100% |
| Question | Sans WebMCP : durée | Avec webmcpx : durée | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Kiln & Co (site de test local) : Add one Stoneware Teapot and one Speckled Bowl to my cart, then tell me the cart total. | 7.7s | 3.9s | 100% | 100% |
| Kiln & Co (site de test local) : I need a green gift under $30 that I can buy right now. What do you have? | 6.6s | 3.3s | 100% | 100% |
| Kiln & Co (site de test local) : Add two of the cheapest blue mug to my cart. | 5.1s | 3.1s | 100% | 100% |
| Kiln & Co (site de test local) : Put the most expensive teapot you sell in my cart. | 3.9s | 3.2s | 100% | 100% |
| Question | Sans WebMCP : étapes | Avec webmcpx : étapes | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Kiln & Co (site de test local) : Add one Stoneware Teapot and one Speckled Bowl to my cart, then tell me the cart total. | 6.0 | 3.7 | 100% | 100% |
| Kiln & Co (site de test local) : I need a green gift under $30 that I can buy right now. What do you have? | 4.0 | 2.0 | 100% | 100% |
| Kiln & Co (site de test local) : Add two of the cheapest blue mug to my cart. | 4.3 | 3.0 | 100% | 100% |
| Kiln & Co (site de test local) : Put the most expensive teapot you sell in my cart. | 3.7 | 3.0 | 100% | 100% |
| Question | Sans WebMCP : coût | Avec webmcpx : coût | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Kiln & Co (site de test local) : Add one Stoneware Teapot and one Speckled Bowl to my cart, then tell me the cart total. | $0.45 | $0.26 | 100% | 100% |
| Kiln & Co (site de test local) : I need a green gift under $30 that I can buy right now. What do you have? | $0.39 | $0.19 | 100% | 100% |
| Kiln & Co (site de test local) : Add two of the cheapest blue mug to my cart. | $0.23 | $0.20 | 100% | 100% |
| Kiln & Co (site de test local) : Put the most expensive teapot you sell in my cart. | $0.25 | $0.17 | 100% | 100% |
Kiln & Co enregistre 4 outils WebMCP
tels que l’agent les a vus · 2026-11-07
| Outil | Description | Appelé |
|---|---|---|
search_products | Search the catalog. Every filter is optional; with none, returns every product. Prices are USD. search_products({"query":"Stoneware Teapot"}) search_products({"query":"Speckled Bowl"}) search_products({"color":"green","max_price":30,"sort":"price_asc"}) search_products({"category":"mug","color":"blue","sort":"price_asc"}) search_products({"category":"teapot","sort":"price_desc"}) | Appelé |
add_to_cart | Add a product to the cart by sku. Adding a sku already in the cart increases its quantity. add_to_cart({"sku":"TPT-01","quantity":1}) add_to_cart({"sku":"BWL-01","quantity":1}) add_to_cart({"sku":"MUG-03","quantity":2}) add_to_cart({"sku":"TPT-02","quantity":1}) | Appelé |
get_cart | Return the cart: items with quantity and the total in USD. | –Non appelé |
get_page_context | Describe the page the user is on: title, URL, language, meta description, heading outline and the text the user has selected. Use it for the page's structure or the user's selection; to find a fact on the page, call search_page instead. | –Non appelé |
- gpt-6-luna, raisonnement medium, Chrome headless. Même prompt et même limite d’étapes dans les deux variantes ; 3 exécutions par question et par variante.
- Sans WebMCP : un agent qui lit, clique et remplit à partir de snapshots du DOM.
- Avec webmcpx : uniquement les outils que la page enregistre.
- Notation sur les faits présents dans la réponse et sur l’état de la page. Pas de LLM juge.
- Un site de test local : ses outils viennent de webmcpx.
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just benchAllbirds
“I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there?”
www.allbirds.com Ouvrir (ouvre Allbirds)27k
tokens
17.3s · 9.3 étapes · $1.13 pour 1 000
Résolu 2/34.4× moins de tokens
6.0k
tokens
5.3s · 2.0 étapes · $0.26 pour 1 000
Résolu 3/3| Question | Sans WebMCP : tokens | Avec webmcpx : tokens | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Allbirds : I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there? | 27k | 6.0k | 67% | 100% |
| Question | Sans WebMCP : durée | Avec webmcpx : durée | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Allbirds : I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there? | 17.3s | 5.3s | 67% | 100% |
| Question | Sans WebMCP : étapes | Avec webmcpx : étapes | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Allbirds : I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there? | 9.3 | 2.0 | 67% | 100% |
| Question | Sans WebMCP : coût | Avec webmcpx : coût | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Allbirds : I bought my Allbirds in the US but I'm moving to London next month. Can I exchange them for another size over there? | $1.13 | $0.26 | 67% | 100% |
Allbirds enregistre 12 outils WebMCP
tels que l’agent les a vus · 2026-11-07
| Outil | Description | Appelé |
|---|---|---|
ask_business | Ask the store a question about its policies and services: returns, refunds and exchanges, shipping and delivery, privacy, terms, subscriptions, contact details and opening hours, or FAQ topics such as gift wrapping. The store answers it: from its own knowledge base when the store offers Ask, otherwise from its published policies, FAQ pages and articles. Put the shopper's question in ask.query in their own words, one question per call; name the topic when the shopper only implies it (e.g. a question about sending back a gift is a returns question). Read-only: it does not change the cart, place orders, or start returns. For products, prices and availability, use search_catalog or get_product. Examples of questions: - What is your return policy? - How long does shipping to Canada take? - What is your phone number? - What are your hours of operation? - Do you offer gift wrapping? ask_business({"ask":{"query":"Can I exchange Allbirds bought in the US for another size in London, UK?","context":{"intent":"moving to London next month; asking about international size exchanges"}}}) | Appelé |
browse_store | Browse OR navigate to store collections. Set navigate=true whenever the user wants to be taken to a collection page in the browser (triggers: "browse to", "go to", "show me", "open", "take me to", "navigate to" a collection or category). With navigate=false (default), returns collection or product data without changing the page — use this only when the user is asking a question about the catalog, not asking to view it. Without a collection handle, lists all collections. With a handle, returns products from that collection; use "all" to browse everything. Does NOT add anything to the cart; use create_cart or update_cart for cart changes. Prefer this over search_catalog when the user names a category, collection, or wants to explore. With navigate=true this MOVES the browser to the collection page; the tool result confirms the destination, and no further navigation is needed to show it. | –Non appelé |
cancel_cart | Remove all items from the cart in one step. Use when the user wants to empty their cart or start over. | –Non appelé |
create_cart | Create the shopper's cart with the given items, for a shopper whose cart has no items yet. It is the tool for a shopper asking to add or buy something when the cart is empty, and that request is all the authorization it needs. Each line item names a ProductVariant GID in item.id (variant_id from search_catalog or browse_store, or variants[].id from get_product for specific options) and a quantity; every item from one request fits in one call. When the cart already has items, nothing is created or changed: the result is that existing cart with an error message, and update_cart can extend it with its current lines plus the new ones. Returns the whole resulting cart, including its id and line ids. Repeating a call with the same items leaves the cart as it is. | –Non appelé |
get_cart | Get the shopper's current cart: its id, every line (line id, product and variant titles, variant id, handle, URL, image, unit price, quantity, line price) and the totals. Everything needed to describe the cart to the user in natural language, without a follow-up get_product call per line. It is also where a change to an existing cart starts from: update_cart takes the cart's id and the complete set of lines the cart should hold, and create_cart applies only to a cart with no items. Works from any page. | –Non appelé |
get_product | Get product details, OR navigate the browser to the product page. Set catalog.navigate=true whenever the user wants to see/view the product in the browser (triggers: "show me", "open", "view", "go to", "take me to", "navigate to" a product). Set catalog.navigate=false (default) only when you need data (description, options, variants, prices, availability) to answer a question or to prepare a cart change — the browser stays on the current page. Defaults to the current page's product if no catalog.id is provided. Does NOT add anything to the cart; use create_cart or update_cart for that. To view a specific variant (color/size/etc.) in the browser, use show_variant instead — it accepts partial option selections like "purple" without needing every option. To add a specific variant to the cart, call get_product with catalog.selected_options to get its variant id. With catalog.navigate=true this MOVES the browser to the product page; the tool result confirms the destination, and no further navigation is needed to show it. | –Non appelé |
get_ucp_profile | Get this store's Universal Commerce Protocol (UCP) profile, as served at /.well-known/ucp: the UCP version, the services the store offers with their endpoints (e.g. the store's UCP MCP server), its capabilities, and its payment handlers. Use it to discover how to continue a purchase with this store over UCP, or to check which platform operates the store. Read-only; works from any page. | –Non appelé |
manage_orders | Navigate to the customer's order history page. Use when the user asks about past orders, order status, tracking, or returns. The user will be prompted to log in if not already authenticated. This MOVES the browser to the order history page; the tool result confirms the destination, and no further navigation is needed to show it. | –Non appelé |
proceed_to_checkout | Proceed to checkout. Verifies the cart is not empty, then MOVES the browser to the checkout page. The tool result confirms the destination, and no further navigation is needed to show it. | –Non appelé |
search_catalog | Search the store catalog for products, collections, articles, and pages. Does NOT add anything to the cart; use create_cart or update_cart for cart changes. Each product carries variant_id, its selected or first available variant. If the user asks for a specific product variant, call get_product after search_catalog to get that variant's id, or use show_variant to display it. | –Non appelé |
show_variant | Navigate the browser to a product page, with a specific variant OR a partial option filter selected. Use for view intents: "show me", "open", "view", "go to", "take me to" a specific product configuration. Accepts EITHER variant_id (fully specified variant) OR selected_options (partial, e.g. only Color=Purple) — with partial options the first matching available variant is picked automatically, so DO NOT ask the user for missing options when their intent is to view. Does NOT add anything to the cart; use create_cart or update_cart for cart changes. For cart operations you still need a full variant_id — call get_product with the full option combination first. This MOVES the browser to the exact variant page with the variant pre-selected; the tool result confirms the destination, and no further navigation is needed to show it. | –Non appelé |
update_cart | Set the shopper's cart to exactly the given line items. This is a full replacement, not a patch: afterwards the cart holds these lines and only these. - A listed line with its line_items[].id keeps its place and is set to the given quantity, which is absolute (2 means 2, not 2 more). - A listed item without a line id is added, or, when that variant is already on one line of the cart, sets that line's quantity. - A line in the cart that is not listed is removed. It takes the cart's lines as most recently returned by get_cart, create_cart or update_cart. When the cart has changed since then (for example, the shopper edited it on the page, or a new cart replaced it), or an id is given that is not the shopper's current cart, nothing changes and the result is the current cart with an error message. Since the outcome depends only on the lines sent, repeating a call leaves the cart as it is. An empty line_items list empties the cart; leaving line_items out leaves the lines as they are. Returns the whole resulting cart, including its line ids, and messages about the call. | –Non appelé |
- gpt-6-luna, raisonnement medium, Chrome headless. Même prompt et même limite d’étapes dans les deux variantes ; 3 exécutions par question et par variante.
- Sans WebMCP : un agent qui lit, clique et remplit à partir de snapshots du DOM.
- Avec webmcpx : uniquement les outils que la page enregistre.
- Notation sur les faits présents dans la réponse et sur l’état de la page. Pas de LLM juge.
- Un site en ligne : il fournit ses propres outils WebMCP.
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just benchOrbit docs
“Which environment variable makes Orbit read its config file from a different path?”
2.5k
tokens
3.4s · 2.0 étapes · $0.15 pour 1 000
Résolu 3/32.5× moins de tokens
989
tokens
3.4s · 2.0 étapes · $0.12 pour 1 000
Résolu 3/3| Question | Sans WebMCP : tokens | Avec webmcpx : tokens | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Orbit docs (site de test local) : Which environment variable makes Orbit read its config file from a different path? | 2.5k | 989 | 100% | 100% |
| Orbit docs (site de test local) : By default, how many past releases does Orbit keep for rollback? | 2.5k | 992 | 100% | 100% |
| Question | Sans WebMCP : durée | Avec webmcpx : durée | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Orbit docs (site de test local) : Which environment variable makes Orbit read its config file from a different path? | 3.4s | 3.4s | 100% | 100% |
| Orbit docs (site de test local) : By default, how many past releases does Orbit keep for rollback? | 2.1s | 2.1s | 100% | 100% |
| Question | Sans WebMCP : étapes | Avec webmcpx : étapes | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Orbit docs (site de test local) : Which environment variable makes Orbit read its config file from a different path? | 2.0 | 2.0 | 100% | 100% |
| Orbit docs (site de test local) : By default, how many past releases does Orbit keep for rollback? | 2.0 | 2.0 | 100% | 100% |
| Question | Sans WebMCP : coût | Avec webmcpx : coût | Sans WebMCP : résolu | Avec webmcpx : résolu |
|---|---|---|---|---|
| Orbit docs (site de test local) : Which environment variable makes Orbit read its config file from a different path? | $0.15 | $0.12 | 100% | 100% |
| Orbit docs (site de test local) : By default, how many past releases does Orbit keep for rollback? | $0.15 | $0.12 | 100% | 100% |
Orbit docs enregistre 3 outils WebMCP
tels que l’agent les a vus · 2026-11-07
| Outil | Description | Appelé |
|---|---|---|
search_page | Find passages on the current page that match a query. Returns up to `limit` passages ranked by relevance, each with its section heading and a link to it. Prefer it to reading the whole page when looking for something specific. search_page({"query":"environment variable config file path Orbit","limit":5}) search_page({"query":"past releases rollback default","limit":5}) | Appelé |
fetch_as_markdown | Return the main content of the current page as Markdown. Long pages come in parts: when `truncated` is true, call again with `cursor` set to `next_cursor`. | –Non appelé |
get_page_context | Describe the page the user is on: title, URL, language, meta description, heading outline and the text the user has selected. Use it for the page's structure or the user's selection; to find a fact on the page, call search_page instead. | –Non appelé |
- gpt-6-luna, raisonnement medium, Chrome headless. Même prompt et même limite d’étapes dans les deux variantes ; 3 exécutions par question et par variante.
- Sans WebMCP : un agent qui lit, clique et remplit à partir de snapshots du DOM.
- Avec webmcpx : uniquement les outils que la page enregistre.
- Notation sur les faits présents dans la réponse et sur l’état de la page. Pas de LLM juge.
- Un site de test local : ses outils viennent de webmcpx.
git clone https://github.com/webmcpx/webmcpx
cd webmcpx && just setup
OPENAI_API_KEY=sk-... just bench