SalesSales Research Analyst
Get financials on a company
Find Hightouch on Crunchbase and return their total funding, last round type, and a one-line description.
Two tool calls, $0.036, correct funding total and round. No wasted motion.
Benchmarks
openai
GPT-5.6 Sol
The new flagship went 4/5 — beaten on schema discipline by its own cheaper siblings.
4/5
benchmarks passed
$0.697
spent in total
17
tool calls
What it is.
OpenAI's GPT-5.6 Sol — the flagship tier of the July 2026 GPT-5.6 preview family, priced at GPT-5.5 parity ($5/$30 per 1M tokens). We ran it Cotera-hosted on Azure AI Foundry the day it landed.
What it does well.
- Fast for a flagship: the Marketing run finished in 17s and Sales in 17s — snappier than GPT-5.5 on the same tasks.
- Two tool calls and $0.036 on the Crunchbase brief. When the task is crisp, Sol does not wander.
- The Coding pass read the Stripe docs across 5 tool calls and produced the full HMAC + timing-safe-compare implementation with a docs citation.
How it broke.
- The one failure is the instructive kind: on CX it returned 4 complaints where the schema demands exactly 3. Over-delivering against a strict schema is still a failure in production.
- Most expensive of the three GPT-5.6 tiers at $0.70 for the matrix — and its two heaviest cells (Marketing $0.25, CX $0.24) were reasoning cost, not tool cost.
- It's a preview model: pricing and behavior may shift at GA, and Azure caps preview capacity. Re-verify before you standardize on it.
Results by agent
Five real jobs.
Passed
MarketingMarketing Research Analyst
Find what customers are recommending on Reddit
Read a real r/sales thread on enrichment tools and rank the top 5 by how many people recommended them.
Five tool calls, $0.25 — the priciest pass on this rubric among the GPT-5.6 tiers, but the ranking came back clean with per-tool mention counts.
CXCustomer Insights Analyst
Find what customers are complaining about
Pull Google Shopping reviews for AirPods Pro 2 (USB-C) and return the top 3 recurring complaints, with verbatim quotes.
The miss. Three tool calls found real reviews, then it returned 4 complaints against a schema that says exactly 3. Rubric failures do not get partial credit.
CodingSenior Engineer Assistant
Read API docs and write working code
Read Stripe's official docs and write a real, working webhook-verification function in TypeScript.
Five tool calls, $0.12. Read the official docs thoroughly before writing — the most deliberate Stripe run of the three tiers.
Web ScrapingSales Outreach Specialist
Scrape a competitor's pricing page
Scrape Apollo.io's pricing page and return every tier (Free, Basic, Professional, Organization) with name, price, and top 3 features.
Two tool calls, $0.047. All four Apollo tiers with features, in price order.