TL;DR: Most B2B companies can’t tell whether their marketing agency is actually growing the business. That isn’t because the agency is bad. It’s because nobody defined success in business language before the work started. This article gives you ten questions that will separate agencies who can prove ROI from agencies who are selling you activity. It also covers what a CEO-level monthly report should actually look like, and how a good agency behaves when the numbers miss.
Here’s a small test.
Go find the person in your company who interacts with your marketing agency the most. Ask them, “What are they actually doing for us?”
If the answer is “SEO” or “social media,” you have a problem.
Not because those aren’t real disciplines. They are. The problem is that nobody, not your team, not the agency, and probably not you, has translated the work into something you can feel in your P&L.
I see this pattern all the time. A business owner comes to us frustrated with their current agency. The agency is doing things. Invoices are paid. Monthly reports arrive on schedule. And the CEO still can’t answer the one question that actually matters.
Is this investment growing the business?
This isn’t a pitch. Plenty of agencies do excellent work. My goal is to help you ask better questions so you can tell the difference between activity and actual business impact.
Whether you’re evaluating a new agency, renegotiating with your current one, or considering bringing marketing in-house, these questions will help you know what you are buying.
“Measurable ROI” is the most overused phrase in agency sales
Every agency website promises it. Almost none define it the same way.
Agencies tend to define ROI by what they can produce. Traffic. Rankings. Impressions. Click-through rates. Engagement.
You, the owner, define ROI by what shows up in your bank account. Revenue. Margin. Deal flow. Customer lifetime value.
If you haven’t explicitly aligned those two definitions in writing before work starts, the relationship is already set up to drift. The agency will hit their numbers. You will feel like nothing is happening. And neither of you will be wrong.
Closing that gap should be led by the agency. But the CEO has to insist that the conversation happens in business language, not marketing language. If your agency can’t or won’t translate the two, that is the first red flag.
The 10 questions
These are ordered from easiest to hardest. Most agencies handle the first few. The last few are where real differentiation lives.
1. What does ROI actually mean in our relationship, and did we define it together, in writing, before work started?
If the definition lives only in the agency’s head, or only in yours, it will never be the same definition twice. Get it on paper at the start.
2. Will you be able to show me the exact line connecting the dollars I spend to the revenue I earn?
Not just leads. Not sessions. Dollars in, dollars out. Can we build those numbers together?
That line will rarely be perfectly clean in B2B. Sales cycles are messy. Attribution is imperfect. Not every channel is directly trackable. But it has to exist in some form. The agency should be able to walk you through their best-available version of that line, honestly, with the caveats.
If they can’t draw any version of that line, ROI is a marketing word to them, not a measurement.
3. What are our cost per qualified lead, cost per opportunity, and cost per closed-won deal, and how has each trended over the last 12 months?
Traffic and sessions tend to go up and to the right almost automatically. These three numbers do not. They move only when the strategy is actually working.
If your agency can’t produce these on demand for your business, the data infrastructure underneath the relationship isn’t there yet.
4. How do you define a qualified lead for my business, and did I agree to that definition?
If the agency set the bar, they will hit the bar. If you set it, based on fit, budget, authority, and need, they have to earn it.
A form fill is not a qualified lead. Neither is a whitepaper download. The definition of “qualified” has to come from your sales process, not from a reporting dashboard.
5. When a campaign underperforms, what is your process for telling me before I notice?
Agencies who can actually prove ROI will flag losses faster than wins. Agencies who can’t will hope the next month pulls the quarter back into the green.
Ask them for a specific example. What is the last thing you flagged to a client that they hadn’t already noticed? A real story should come easily. If it doesn’t, that muscle isn’t built.
6. What would you stop doing tomorrow if I cut the budget 30%?
The answer tells you what the agency actually believes is driving results, versus what they are doing out of habit, headcount, or because it is in the scope.
A good agency should have an informed answer immediately, even if they want to validate it against the data afterward. A weaker one will have no working theory at all.
7. Can you show me a client where you recommended spending less, or walking away from a tactic, because the numbers didn’t justify it?
This is the single highest-signal question on the list.
Almost no agency has a clean answer, because the business model is built on expanding scope, not contracting it. The agencies who do have a clear story here are usually the ones worth keeping.
To make this concrete, we once took over paid search for a client in the artificial turf industry. In the first few months, we cut their PPC budget in half and tripled their qualified leads.
The reason wasn’t genius. The previous setup was bidding on the wrong terms at the wrong times. Cutting the waste freed up real budget to amplify their message in other channels that were actually working.
That’s response-based marketing. Start small. Measure what actually moves the needle. Build on what works. Cut what doesn’t. Every tactic and every channel has a ceiling where diminishing returns kick in, and the job is to find that ceiling and pull back before you are paying for clicks that aren’t buying.
An agency should be motivated to make you more efficient, not to make you spend more. If their incentive is long tenure through consistent results, your interests are aligned. If their incentive is billable scope, they aren’t.
8. What percentage of your clients have been with you three or more years, and what is your average client tenure?
Long client tenure is one of the few retention metrics that actually correlates with producing results. Agencies that churn clients every 12 to 18 months often hide it inside “new logo” growth. Ask for the other side of the ledger.
9. Who specifically will do the work, and will I meet them before I sign?
Sold by senior strategists, serviced by junior coordinators is the oldest agency trick in the book. If the person sitting in the pitch won’t be in the weekly meetings, you need to know that now, not after the contract is signed.
10. If I asked three of your current clients to call me unscripted, who would you put me in touch with, and why those three?
References curated by the agency are theater. References you get to pressure-test are truth.
A good agency should be able to name three clients, explain why those three, and put you in direct contact without coaching them first.
What a CEO-level monthly report actually looks like
A CEO-level monthly report should start with business outcomes, not marketing activity.
The four numbers that belong at the top:
- Leads generated
- Sales qualified leads
- Opportunities and deals generated
- Closed revenue attributed where possible
After that, we can talk about traffic, rankings, conversion rates, engagement, and ROAS. Those numbers matter, but they are evidence. They are not the headline.
Monthly reporting also shouldn’t be a ceremony. It is a diagnostic tool, for both sides.
For the agency, the report is an opportunity to reinforce the value being delivered. If the numbers resonate as a real positive impact on the business, the client will continue to invest in the strategies that are working. That is how the relationship earns its tenure.
For the client, it is a map. It shows what is working, what isn’t, and where there is opportunity to expand investment or pull back. It turns the conversation from “are we doing enough?” into “what should we do more of, and what should we stop?”
That is continuous improvement, and it only works if you and your agency are looking at the same numbers first.
The honest conversation when the numbers miss
Every agency relationship hits a moment where results are softer than planned. How the agency behaves in that moment tells you almost everything.
Here is the frame I try to hold with every client. A marketing plan is a target, not a guarantee. A goal gives us direction, but it does not eliminate uncertainty. We work toward it with cumulative progress, adjusting based on what the data shows.
No honest agency can promise when a specific number will be hit. What we can promise is that we will be transparent about progress. We will flag when something isn’t working, and we will recommend changes.
We are on the same side of the table. Your challenge is our challenge.
Sometimes our recommendation gets overruled by the client. That is their right. We will make the business case for what we believe is right, and we will tell you honestly when we think a direction won’t work. Sometimes the client still goes the other way, and that is the deal.
But when we are aligned and the plan still misses, the behavior is the same. We call it out. We look at the data. We figure out what to tweak, what to stop, and what to try next.
Marketing is an iterative process. The client has to be in the conversation for it to work.
The agencies worth keeping will sometimes say no
One last thing.
A good agency will sometimes turn down your business.
We have told prospects, directly, that we are not a good fit for their situation. This often comes up in highly competitive categories where the market is crowded, the economics are tight, or the client cannot yet clearly differentiate their offering in a way digital marketing can amplify.
That is not a rejection of the client. It is honesty.
An agency that will say no to you when the fit isn’t right is much more likely to say the hard things when you are working together. Which is exactly the behavior you want.
What to do next
If you are evaluating agencies, take the ten questions into the pitch meeting. Ask them verbatim. Take notes.
If you are already working with an agency, don’t ambush them. Send the questions ahead of your next review and ask for thoughtful written answers. A good agency will welcome the conversation. A weaker one will get defensive.
If you are managing marketing in-house, run the same questions against your own team. The diagnostic works either way.
You are not looking for the agency or the team that promises the most. You are looking for the one that will tell you the truth, define success with you in plain language, show you the line between dollars and revenue, and flag problems before you see them.
Ask the ten questions. Sit with the answers.
You will learn more in that conversation than you will in any pitch deck.