alibaba
0/5. Burned $1.91 on Crunchbase alone to produce zero parseable output. The worst run in the matrix.
Alibaba's Qwen 3.6 Plus — the largest dense Qwen variant in the November 2026 lineup, pitched as a frontier reasoning option from the Chinese open-weights ecosystem.
Results by agent
Find Hightouch on Crunchbase and return their total funding, last round type, and a one-line description.
✗ 9 tool calls, $1.91. The single most expensive failure in the matrix. Almost all of the budget was thinking tokens; the model never produced parseable JSON.
Read a real r/sales thread on enrichment tools and rank the top 5 by how many people recommended them.
✗ 22 tool calls, $0.399. Most tool calls of any benchmark run in the matrix. None of them led to an answer.
Pull Google Shopping reviews for AirPods Pro 2 (USB-C) and return the top 3 recurring complaints, with verbatim quotes.
✗ 10 tool calls, $0.229. Tools called, responses read, no final message.
Read Stripe's official docs and write a real, working webhook-verification function in TypeScript.
✗ 13 tool calls, $0.251. Same pattern — engaged, retrieved, stopped without writing code.
Scrape Apollo.io's pricing page and return every tier (Free, Basic, Professional, Organization) with name, price, and top 3 features.
✗ 1 tool call, $0.188. The cheapest Qwen failure: one tool call, no JSON.