The pitch is the wrong place to evaluate an advertising agency’s strategic depth because the pitch was designed to impress rather than to inform. A well-run pitch produces creative work that looks good in a presentation room, a team that’s engaged and enthusiastic, and a proposal that addresses the brief in ways the client finds compelling. What it doesn’t reliably produce is an accurate picture of how the agency thinks when the creative brief is harder than the pitch brief, when the campaign isn’t performing the way it was supposed to, or when the client’s business situation changes in ways that require the strategy to be rethought . Evaluating strategic depth before the pitch, through the questions asked and the responses observed before any formal presentation, produces information that the pitch is designed to obscure.

What the Pre-Brief Conversation Reveals

An advertising agency with genuine strategic depth approaches the pre-brief conversation as a diagnostic exercise. The questions they ask before receiving the brief tell you more about how they think than anything they say after receiving it, because questions asked before the brief are driven by genuine curiosity about the business problem.

An agency that asks about the competitive dynamics, the customer’s decision-making process, what’s been tried previously and why it did or didn’t work, and what the business is actually trying to achieve, is building an understanding that will produce better strategy than an agency that listens to the brief and responds with creative directions that address the stated problem without investigating whether the stated problem is the actual one.

The depth of the pre-brief questions also reveals whether the agency has experience with the specific challenges of the client’s category or whether they’re approaching the category as a generalist. Category knowledge changes what gets asked because the person who knows the category knows which questions are most diagnostic, and the questions that reveal genuine category knowledge are different from the ones that reveal general advertising intelligence.

How the Agency Talks About Work That Didn’t Perform

Asking an agency to describe a campaign that didn’t achieve its objectives, and how they responded when the performance data made that clear, produces more useful information about their strategic capability than asking them to describe their most successful work. The most successful work is always available in a portfolio and is always described in terms that make the agency look good. Work that underperformed is described differently by agencies with genuine analytical capability and by agencies whose relationship with their own performance is primarily promotional.

An agency that can describe specifically what the data showed, what diagnosis they made about why the campaign was underperforming, what they changed and why they changed it, and what the result of that adjustment was, is demonstrating an analytical relationship with their own work that the portfolio presentation doesn’t reveal. An agency that describes underperforming work in terms of client factors, market conditions, or budget constraints without any acknowledgment of what they would do differently has described the same campaign in the same way they’d describe a successful one.

What the Strategic Document Quality Tells You Before the Creative

Most agencies produce some form of strategic document before the creative, a brief, a strategy paper, a brand positioning document, and the quality of that document is a more reliable indicator of strategic depth than the creative work it precedes. Creative work is subjective enough that quality is hard to evaluate objectively. A strategy document is analytical enough that its quality, the clarity of the consumer insight, the specificity of the problem definition, the logic of the connection between the insight and the proposed approach, is assessable against a reasonably objective standard.

Asking to see examples of strategic documents produced for previous clients, specifically the briefs or strategy papers that preceded campaigns in the portfolio, gives access to the thinking that produced the creative. The advertising agency that produces rigorous, specific, insightful strategic documents before the creative is working from a different foundation than one whose pre-creative thinking is generic enough to have been written for any client in any category, and that difference shows up in the work and in the results across a sustained engagement.