To benchmark your performance marketing agency before renewing or switching, don't compare your metrics to generic industry benchmarks — your business isn't the average, so those comparisons mislead. Instead benchmark across four dimensions. First, your own trajectory and real business outcomes: is the agency improving your actual revenue, pipeline, CAC, and margin over time, reconciled against your real numbers — not platform-reported ROAS? Second, the predictors of future performance, not just past numbers: creative output and testing velocity, whether you own your measurement and accounts, incentive alignment, and the seniority of attention your account actually gets. Third, the agency's incremental contribution separated from market tailwinds or headwinds: did the agency drive results, or did a rising (or falling) market? Fourth, honesty and transparency: does the agency reconcile, admit what didn't work, and give you data access? Then decide keep, fix, or switch on that clear-eyed assessment — not on inertia (renewing because switching is a hassle) or frustration (switching without knowing the new agency is better). When evaluating a prospective replacement, benchmark it on the same substance and beware being fooled by a better pitch, since pitching skill and delivery skill are different. The goal is an honest judgment of whether your agency is actually delivering.
Key Takeaways
- Before renewing or switching, answer honestly: is my agency actually good, or have I just gotten used to it? Renewing on inertia and switching on frustration are both expensive mistakes.
- Generic industry benchmarks mislead because your business isn't the average — benchmark against your own trajectory and real business outcomes instead.
- Assess the predictors of future performance (creative output, measurement ownership, incentive alignment, seniority of attention), not just past numbers.
- Separate the agency's incremental contribution from market tailwinds or headwinds — a rising market can flatter a mediocre agency and a falling one can mask a good one.
- Weigh honesty and transparency — does the agency reconcile, admit failures, and give data access — as a core benchmark dimension.
- When evaluating a replacement, benchmark it on the same substance and don't be fooled by a better pitch — pitching skill and delivery skill differ.
The Question Behind the Renewal: Is It Actually Good?
Every agency renewal or switch decision comes down to a question that's harder to answer than it looks: is my agency actually good, or have I just gotten used to it? Familiarity makes agencies hard to judge — you've worked with them for a year or two, you know the people, the reports look fine, nothing is obviously broken, and the path of least resistance is to renew. But 'nothing is obviously broken' and 'the reports look fine' are not the same as 'the agency is genuinely delivering strong results,' and the comfort of familiarity can mask an agency that has plateaued, coasted, or was never that good — just as frustration with a rough patch can mask an agency that's actually delivering well in a hard market. Benchmarking is how you replace the gut feeling (comfortable or frustrated) with a clear-eyed judgment of whether the agency is actually delivering.
The trouble is that benchmarking an agency is genuinely hard, and the obvious approaches mislead. The instinct is to compare your metrics against generic industry benchmarks — 'the average CPL in our industry is X, ours is Y, so we're good/bad' — but as we'll see, those comparisons are mostly misleading because your business isn't the average. The other obvious source, the agency's own reporting, is designed (as reassurance documents usually are) to make the agency look fine, so it can't be your benchmark either. So you need a real method for benchmarking that doesn't rely on generic industry averages or the agency's self-flattering reports — one that assesses the agency against the things that actually matter: your own trajectory and business outcomes, the predictors of future performance, the agency's incremental contribution, and its honesty. That method is what this guide provides.
This matters because both failure modes — renewing on inertia and switching on frustration — are expensive. Renew a mediocre agency on inertia and you lock in another year of underperformance and opportunity cost. Switch a good agency on frustration (or on a better pitch from a competitor) and you incur the real costs of transition, the ramp time of a new agency, and the risk that the new one is worse. The way to avoid both is a clear-eyed benchmark that tells you whether your agency is actually delivering, so your keep/fix/switch decision is based on evidence rather than on comfort or annoyance. This guide gives you the dimensions to benchmark across, how to do each without being fooled, and how to benchmark a prospective replacement against your incumbent fairly. Read it before your renewal, because the renewal decision deserves a real assessment, not a gut call.
Why Generic Industry Benchmarks Mislead
The most common way people try to benchmark their agency is against generic industry benchmarks — published average CPLs, CACs, ROAS, or conversion rates for their industry — and it's mostly misleading, for a fundamental reason: your business isn't the average. Industry benchmarks are averages across wildly different businesses with different products, price points, margins, target audiences, brand strength, sales cycles, geographies, and maturity — and your specific business differs from that average on most of those dimensions, often dramatically. A 'good' CAC for the industry average might be terrible for your thin-margin product or excellent for your high-LTV one; an 'average' conversion rate is meaningless when your product, price, and audience determine what's achievable for you specifically. Comparing your metrics to an industry average tells you how you compare to a fictional composite business, not whether your agency is doing well for your actual business, which is the only question that matters.
How to benchmark your performance marketing agency before renewing or switching: the real question is whether the agency is actually good or you've just gotten used to it; don't benchmark against generic industry averages because your business isn't the average and those comparisons mislead in both directions; instead benchmark against your own trajectory and real business outcomes reconciled against your numbers, against the predictors of future performance such as creative output, measurement ownership, incentive alignment, and seniority of attention, and against the agency's incremental contribution separated from market tailwinds or headwinds; then decide keep, fix, or switch on the evidence, and if switching, benchmark the replacement on the same verified substance rather than comparing your incumbent's reality to a newcomer's pitch.
Worse, generic benchmarks can actively mislead your decision in both directions. Your metrics might look bad against an industry benchmark when your agency is actually doing well for your specific, harder-than-average situation — leading you to wrongly switch a good agency because it can't hit a benchmark that was never achievable for your business. Or your metrics might look good against an industry benchmark when your agency is actually underperforming what's achievable for your specific, easier-than-average situation — leading you to wrongly renew a coasting agency because it clears a bar that was low for you. In both cases the industry benchmark, by ignoring what's actually achievable for your specific business, points you toward the wrong decision. This is why 'how do our metrics compare to industry benchmarks' is the wrong benchmarking question, even though it's the most common one.
The right comparison is against benchmarks that are specific to your business, of which there are two good kinds. The first is your own trajectory: how your results have changed over time under this agency — is your real performance (revenue, pipeline, CAC, margin) improving, flat, or declining, controlling for market conditions? Your own history is a far more relevant benchmark than an industry average, because it holds your business constant and asks whether the agency is making it better. The second is what's genuinely achievable for your specific business — which requires understanding your own unit economics, market, and constraints well enough to know what good looks like for you, rather than importing a generic number. Both of these benchmark the agency against your reality rather than a fictional average, which is the only benchmarking that can actually inform your decision. Ask yourself: am I judging my agency against my own trajectory and what's achievable for my business — or against an industry average that has nothing to do with my specific situation?
Benchmark Against Outcomes, Predictors, and Contribution
With generic benchmarks set aside, benchmark your agency across the dimensions that actually predict whether it's delivering and will continue to. The first dimension is your real business outcomes over your own trajectory: is the agency improving your actual revenue, pipeline, customer acquisition cost, and contribution margin over time — reconciled against your real numbers, not platform-reported ROAS? This is the outcome benchmark, and it's the most important: an agency delivering improving real business results for your specific business over time is delivering, regardless of how those results compare to any industry average; an agency whose platform metrics look fine but whose contribution to your actual revenue and margin is flat or declining is not, however good the dashboard looks. Benchmark on your reconciled business outcomes and their trajectory, because that's what you're actually paying for.
The second dimension is the predictors of future performance, not just past numbers — because a renewal is a bet on the future, and past results don't guarantee future ones if the underlying capabilities are weak. The predictors to benchmark: creative output and testing velocity (is the agency producing the volume of fresh creative and running the experiments that drive future performance, or coasting on old winners?); measurement ownership (do you own your accounts, pixel, and data, or has the agency built a dependency?); incentive alignment (does the agency's fee model reward your outcomes or just spend?); and the seniority of attention your account actually gets (are the senior people who won you still involved, or has your account drifted to juniors?). These predict whether the agency will keep delivering, and they're often more informative for a renewal decision than the past numbers, because they tell you about the engine rather than just its recent output. An agency with strong past numbers but decaying predictors (no creative output, drifting to juniors, misaligned incentives) is a worse renewal bet than the numbers alone suggest.
The third dimension is separating the agency's incremental contribution from market conditions, which is essential to benchmarking fairly. Your results are shaped by both the agency's work and the market — a rising market (growing category, favorable conditions) can flatter a mediocre agency whose results look good because the tide lifted them, while a falling market (rising costs, tougher conditions) can mask a good agency whose results dipped because it was swimming against the current. Benchmarking the agency on raw results without accounting for market conditions credits or blames it for things it didn't control. So ask: how much of my result trajectory is the agency's contribution versus the market's movement — would a competent agency have done better or worse in these same conditions? This is hard to answer precisely, but even a rough assessment (are we outperforming or underperforming what the market conditions would predict) dramatically improves the fairness of your benchmark, and incrementality thinking — what would have happened without this agency's work — is the right lens. The table below organizes the dimensions.
| Benchmark dimension | The question it answers | Common mistake it avoids |
|---|---|---|
| Real business outcomes over your trajectory | Is my actual revenue/CAC/margin improving over time? | Judging on platform metrics or industry averages |
| Future-performance predictors | Will it keep delivering (creative, ownership, incentives, seniority)? | Renewing on past numbers with a decaying engine |
| Incremental contribution vs market | Did the agency drive this, or did the market? | Crediting/blaming the agency for market movements |
| Honesty & transparency | Can I trust its numbers and does it admit failures? | Trusting a reassurance report |
Honesty as a Benchmark — and the Keep/Fix/Switch Decision
The fourth dimension to benchmark is the agency's honesty and transparency, which is both a quality signal in itself and the thing that determines whether you can trust the rest of your benchmark. An agency that reconciles its reported numbers against your real revenue, admits what didn't work, and gives you access to the underlying data is one whose results you can actually verify and trust — and that transparency is itself a marker of a good agency. An agency that reports only flattering platform metrics, never admits failures, and resists giving you data access is one whose results you can't verify and whose reassurance you shouldn't take at face value — and that opacity is itself a red flag about the agency's quality. So benchmark the agency on its transparency directly: how honest and verifiable is its reporting? This dimension matters doubly because it gates the others — if the agency's reporting is opaque and self-flattering, you can't accurately benchmark its business outcomes or contribution, so the honesty benchmark is partly about whether you can even trust your other benchmarks.
Having benchmarked across these dimensions, make the keep/fix/switch decision on the evidence. Keep (renew) when the benchmark shows the agency is delivering: improving real business outcomes over your trajectory, strong future-performance predictors, genuine incremental contribution beyond market movement, and honest, transparent reporting. Fix when the agency has real strengths but specific, addressable weaknesses the benchmark reveals — for example, good outcomes but decaying creative output or drifting seniority — which you can raise directly and require the agency to address as a condition of renewal, giving it a defined chance to fix specific issues before you switch. Switch when the benchmark shows genuine underperformance that isn't just a market headwind and isn't fixable — flat or declining real outcomes the agency isn't driving, weak predictors, misaligned incentives it won't change, or opacity that prevents trust. The point of benchmarking is to make this decision on evidence rather than on the inertia that leads to renewing mediocrity or the frustration that leads to switching without cause.
The discipline here is to resist both default failure modes with the benchmark. Inertia says 'renew, switching is a hassle, nothing's obviously broken' — the benchmark counters it by revealing whether the agency is actually delivering or just not obviously failing, which are different. Frustration says 'switch, I'm annoyed, a competitor's pitch looked better' — the benchmark counters it by asking whether the frustration reflects genuine underperformance the agency is responsible for, or a market headwind, a fixable issue, or just a rough patch, and whether a switch would actually improve things. A good benchmark process makes you honest about your incumbent in both directions: it stops you renewing a coasting agency out of comfort and stops you firing a good agency out of pique. That honesty is the whole value of benchmarking — it replaces the emotional default with an evidence-based judgment of whether the agency is delivering for your specific business.
Benchmarking a Replacement — Don't Get Fooled by the Pitch
If your benchmark points toward switching, you then face a second benchmarking challenge: evaluating a prospective replacement against your incumbent without being fooled — which is harder than it sounds, because the thing you're most exposed to when evaluating a new agency is a good pitch, and pitching skill is a different (often inversely correlated) skill from delivery. The danger is that you benchmark your incumbent on real results and hard-won knowledge of its actual delivery, then benchmark the prospective replacement on a polished pitch and impressive-looking case studies — comparing your incumbent's warts-and-all reality to a new agency's best-foot-forward performance, which unfairly favors the newcomer and can lead you to switch to an agency that pitches better but delivers worse. To benchmark fairly, you have to evaluate the prospective agency on the same substance you (now) use for your incumbent: not the pitch, but the real predictors and evidence of delivery.
So benchmark a prospective replacement on substance: verify its claimed results the way you'd verify any agency (how were the numbers measured, reconciled against what, incremental or credited); check references properly, including former clients; assess the same future-performance predictors (creative output, measurement approach, incentive alignment, and who would actually run your account versus who's pitching); and probe its honesty and transparency (does it reconcile, admit limits, offer data access). This is the same evaluation rigor that any agency selection requires, applied specifically to comparing a candidate against your incumbent — and the key discipline is to hold the prospective agency to the same evidentiary standard you now hold your incumbent to, rather than letting its pitch substitute for the evidence you'd demand. A prospective agency that looks better than your incumbent on a pitch but not on verified substance is not actually a better agency; it's a better pitcher.
The complete picture, then, is this: benchmark your incumbent honestly across real outcomes, future predictors, incremental contribution, and transparency — against your own trajectory and what's achievable for your business, not generic industry averages — to decide keep, fix, or switch on evidence rather than inertia or frustration. If you switch, benchmark the replacement on the same substance you use for your incumbent, refusing to let a better pitch substitute for verified delivery. Do this and your renewal or switch decision is a clear-eyed judgment that avoids both expensive mistakes — locking in mediocrity through inertia, or trading a good agency for a better-pitching worse one. The goal throughout is honesty: about whether your incumbent is actually delivering for your specific business, and about whether any alternative is genuinely better on substance rather than on presentation. If you want a rigorous, outcomes-based benchmark of your current agency's performance — reconciled against your real business results and assessed on the predictors that determine whether it will keep delivering — that is exactly the kind of independent assessment our team can help you run before your renewal.
Frequently Asked Questions
- How do I know if my performance marketing agency is actually good?
- By benchmarking it against the things that matter for your specific business, not by gut feel or the agency's own reports. The hard question behind every renewal is 'is my agency actually good, or have I just gotten used to it?' — because familiarity makes agencies hard to judge, and 'nothing's obviously broken' and 'the reports look fine' are not the same as 'genuinely delivering strong results.' To answer it, benchmark across four dimensions. First, your real business outcomes over your own trajectory: is the agency improving your actual revenue, pipeline, CAC, and margin over time, reconciled against your real numbers rather than platform ROAS? Second, the predictors of future performance: creative output and testing velocity, whether you own your accounts and measurement, incentive alignment, and the seniority of attention your account gets. Third, the agency's incremental contribution separated from market tailwinds or headwinds — did it drive the results or did the market? Fourth, its honesty and transparency — does it reconcile, admit failures, and give data access? Crucially, don't benchmark against generic industry averages, because your business isn't the average and those comparisons mislead in both directions. Benchmark against your own trajectory and what's genuinely achievable for your specific business.
- Why shouldn't I compare my agency's results to industry benchmarks?
- Because your business isn't the average, so generic industry benchmarks mostly mislead. Industry benchmarks are averages across wildly different businesses with different products, price points, margins, audiences, brand strength, sales cycles, geographies, and maturity — and your specific business differs from that composite on most dimensions, often dramatically. A 'good' industry CAC might be terrible for your thin-margin product or excellent for your high-LTV one; an 'average' conversion rate is meaningless when your product, price, and audience determine what's achievable for you. Comparing your metrics to an industry average tells you how you compare to a fictional composite, not whether your agency is doing well for your actual business. Worse, it can mislead your decision in both directions: your metrics might look bad against the benchmark when your agency is doing well for your harder-than-average situation (leading you to wrongly switch a good agency), or look good when your agency is underperforming what's achievable for your easier-than-average situation (leading you to wrongly renew a coasting one). The right comparisons are specific to your business: your own trajectory (how your real results have changed over time under this agency, controlling for market conditions) and what's genuinely achievable given your unit economics, market, and constraints. Both hold your business constant and ask whether the agency is making it better.
- What predicts whether my agency will keep delivering, not just what it did?
- Four future-performance predictors that matter more for a renewal decision than past numbers, because a renewal is a bet on the future and past results don't guarantee future ones if the underlying capabilities are weak. First, creative output and testing velocity: is the agency producing the volume of fresh creative and running the experiments that drive future performance, or coasting on old winners? On platforms where creative is the main lever, decaying creative output predicts decaying results. Second, measurement ownership: do you own your accounts, pixel, and data, or has the agency built a dependency that both traps you and signals a certain kind of relationship? Third, incentive alignment: does the agency's fee model reward your business outcomes or just spend — because a misaligned model predicts behavior that serves the agency over you. Fourth, the seniority of attention your account actually gets: are the senior people who won your business still involved, or has your account drifted to juniors as the agency chases new clients? An agency with strong past numbers but decaying predictors (no creative output, drifting to juniors, misaligned incentives) is a worse renewal bet than the numbers alone suggest, because those predictors tell you about the engine rather than just its recent output. Benchmark the engine, not only the results.
- How do I separate my agency's contribution from market conditions?
- By asking, as honestly as you can, how much of your result trajectory is the agency's contribution versus the market's movement — because benchmarking on raw results without accounting for market conditions credits or blames the agency for things it didn't control. Your results are shaped by both the agency's work and the market: a rising market (growing category, favorable conditions) can flatter a mediocre agency whose results look good only because the tide lifted them, while a falling market (rising costs, tougher conditions) can mask a good agency whose results dipped because it was swimming against the current. So the question is: would a competent agency have done better or worse in these same conditions — are we outperforming or underperforming what the market would predict? This is hard to answer precisely, but even a rough assessment dramatically improves the fairness of your benchmark, and incrementality thinking is the right lens: what would have happened to my results without this agency's work? The practical version is to look at your trajectory relative to market indicators (category trends, platform cost trends, competitor movement where visible) rather than in isolation, so you're judging the agency against what was achievable in the conditions it actually faced, not against an absolute number that ignores whether the market was helping or hurting.
- How do I compare a new agency to my current one without being fooled?
- By benchmarking the prospective replacement on the same substance you use for your incumbent, and refusing to let a better pitch substitute for verified delivery — because the thing you're most exposed to when evaluating a new agency is a good pitch, and pitching skill is a different, often inversely correlated skill from delivery. The specific danger is asymmetry: you benchmark your incumbent on real results and hard-won knowledge of its actual delivery (warts and all), then benchmark the newcomer on a polished pitch and best-foot-forward case studies — an unfair comparison that favors the better pitcher and can lead you to switch to an agency that presents better but delivers worse. To benchmark fairly, hold the prospective agency to the same evidentiary standard: verify its claimed results (how measured, reconciled against what, incremental or merely credited); check references properly including former clients; assess the same future-performance predictors (creative output, measurement approach, incentive alignment, and who would actually run your account versus who's pitching); and probe its honesty and transparency. A prospective agency that looks better on a pitch but not on verified substance isn't a better agency — it's a better pitcher. The discipline is to compare incumbent and candidate on the same real evidence of delivery, not incumbent-reality versus candidate-pitch.