nvidia

Nemotron 3 Ultra 550B

Biggest and priciest Nemotron, worst value — 1/5 at $2.46, most of it burned looping.

1/5

benchmarks passed

$2.46

spent in total

tool calls

What it is.

NVIDIA's Nemotron 3 Ultra, a 550B open MoE (55B active), run through OpenRouter. The flagship of the Nemotron 3 line.

Did pass the coding benchmark once the tool-call middleware let its calls through — a competent HMAC-SHA256 verifier over 15 tool calls.
Large 1M context and strong raw reasoning on paper.

By far the most expensive model in this suite: $2.46 for a single pass. One Reddit run alone burned ~$1.73 across 25 tool calls and still produced no valid JSON.
Most fragile tool-caller of the family — repeatedly emitted tool calls as plain text, which without the repair middleware ends the agent loop with no answer.
Inconsistent final output: malformed or missing JSON on four of five benchmarks, plus one run that dropped a required field.

Results by agent

SalesSales Research Analyst

Failed

Find Hightouch on Crunchbase and return their total funding, last round type, and a one-line description.

✗ 1 tool call, $0.012. Emitted a tool call as plain text; the agent never got a final answer.

MarketingMarketing Research Analyst

Failed

Read a real r/sales thread on enrichment tools and rank the top 5 by how many people recommended them.

✗ 25 tool calls, $1.73. The most expensive single run in the matrix; still no parseable JSON.

CXCustomer Insights Analyst

Failed

Pull Google Shopping reviews for AirPods Pro 2 (USB-C) and return the top 3 recurring complaints, with verbatim quotes.

✗ 3 tool calls, $0.148. Extracted a real complaint but omitted the required productId field.

CodingSenior Engineer Assistant

Passed

Read Stripe's official docs and write a real, working webhook-verification function in TypeScript.

✓ 15 tool calls, $0.399. Its one pass.

Web ScrapingSales Outreach Specialist

Failed

Scrape Apollo.io's pricing page and return every tier (Free, Basic, Professional, Organization) with name, price, and top 3 features.

✗ 8 tool calls, $0.169. Final message was not parseable JSON.