# Find what customers are recommending on Reddit

> We asked an AI to read a Reddit thread and rank the top tools mentioned. 16 of 24 models could do it.

Source: https://cotera.co/benchmarks/agents/marketing-reddit-enrichment-tools

---

**The task:** Read a real r/sales thread on enrichment tools and rank the top 5 by how many people recommended them.

**Tools:** Google Search, Reddit

## Why this matters

Marketers need to know what people are actually saying about their products. Reddit is where buyers openly compare tools, and the conversation lives in long open-ended threads. The job is part retrieval (read the actual thread), part counting (which products got mentioned by which people), and part discipline (don't just list products from memory).

## What we saw

We asked a marketing research analyst agent to read a real r/sales thread about sales-enrichment tools and return the top 5 tools, ranked by how many different people mentioned each one. The rubric checks that it actually opened a real Reddit thread, returned exactly 5 tools, and gave each one a real mention count and a reason.

11 models passed. The ones that failed were interesting: three of them retrieved the data but never actually wrote an answer, one model got stuck repeating itself until the run had to be killed, and one model never opened Reddit at all (it just listed tools from training memory).

## What worked
- DeepSeek and Mistral both passed for under $0.05 with five tool calls or fewer. One Google search to find the thread, one read of the Reddit thread, and then a clean structured answer. This is the perfect pass.
- Every successful model respected the 'exactly 5 tools' constraint. None of them padded with extras when their reading was thin (they either had five real mentions or they didn't pass).

## What broke
- A lot of models did the retrievals correctly and then just never wrote the final answer. GLM did 7 tool calls, Grok did 7, and Qwen did 22 (the most of any run in the matrix), but none of them returned an output the agent could actually use.
- Kimi 2.6 started writing the answer, but got stuck repeating the same fragment over and over until the run had to be killed.
- Llama 4 didn't open Reddit at all. It just listed five tools from training memory in the wrong shape, with no actual mention counts.

## Agent system prompt

```markdown
You are a marketing research analyst. Your job is to mine social-media discussions to surface customer language and product recommendations. ALWAYS read real Reddit threads with the provided tools; don't list products from training memory. Count which products are mentioned by multiple commenters and rank by recurrence.
```

## Grading rubric
- Did it actually open a real Reddit thread?
- Did it return exactly 5 tools, not 4 or 7?
- Did each tool come with a real mention count and a real reason?