Most buyers focus on the wrong things during the evaluation process: an impressive website, a confident sales rep, a polished deck. Those things tell you an agency is good at marketing themselves. They tell you very little about whether they are the right fit for your specific situation, your budget, your team, or your buyers.
This post is a practical framework for getting that evaluation right, whether you are hiring a demand gen agency for the first time or replacing one that didn’t work out.
Start With the Right Question
Most companies begin the agency search by asking “who is the best demand gen agency?” That’s the wrong question. The right question is: which agency is the best fit for where we are right now?
A boutique agency that excels at early-stage pipeline building for a 50-person SaaS company may be entirely wrong for a 500-person enterprise with a complex multi-product portfolio. The reverse is equally true. Before you evaluate anyone, get clear on your own situation first:
- What specifically are you trying to accomplish? More leads, better lead quality, a specific channel you do not have in-house, a full program build from scratch?
- What does success look like in 12 months, and how will you measure it?
- What do you have in-house already, and what do you actually need from an outside partner?
- What is your realistic budget, and is it sufficient for what you are asking?
That last point matters more than most buyers want to acknowledge. An agency that tells you your budget is too small for your stated objectives is being honest with you. That honesty is a green flag, not a red one.
What a Good Demand Gen Agency Should Actually Do
The term “demand generation agency” gets applied to a wide range of firms doing very different things. Before you can evaluate anyone, it helps to have a clear picture of what strong demand gen work actually looks like.
At minimum, a B2B demand gen agency should be able to help you build and execute programs across the channels your buyers actually use, and connect those programs to measurable pipeline outcomes. That means:
- Strategy that starts with your ICP. Channel selection and offer strategy should follow from a clear understanding of who you are trying to reach and what motivates them. If an agency leads with channels before understanding your buyer, that is a process problem.
- Creative and messaging that speaks to buyer pain. Content and copy that describes your product’s features is not demand generation. Content that speaks directly to a specific buyer’s specific problem is. There is a significant difference, and it shows up in conversion rates.
- Rigorous program execution. Proper segmentation, suppression, QA, and tracking are table stakes. Sloppy execution wastes budget and produces data you cannot trust.
- Reporting that connects to pipeline. Impressions, clicks, and open rates are not outcomes. A good agency reports on what those activities produced in terms of qualified pipeline and, where trackable, revenue.
- A point of view delivered honestly. You are not just paying for execution. You are paying for judgment. An agency that tells you what you want to hear is less valuable than one that tells you what the data is actually saying.
One thing to probe specifically: ask how work actually gets done and who does it. Some agencies are primarily account management layers that farm execution out to freelancer networks while marking up the cost. That is a legitimate model, but you should know if that is what you are buying.
Five Things to Evaluate When Comparing Agencies
1. Relevant experience in your category
Generic demand gen expertise is table stakes. What you want to know is whether the agency has worked with companies like yours: similar size, similar buyer profile, similar sales motion. Ask for specific examples. If they cannot point to clients in your space or adjacent spaces, ask directly how they would approach the learning curve and what that costs you in time and money during ramp-up.
2. Channel depth vs. channel breadth
Some agencies are genuinely strong across multiple channels. Many are strong in one or two and adequate at best in the rest. Know which channels matter most for your specific situation and probe specifically for depth there, not just familiarity. An agency that lists twelve services may be excellent at three of them. That is fine, as long as those three are the ones you need.
3. How they think about measurement
Ask how they define success for a program like yours. Ask what metrics they would track, how they would report on them, and how they would know if something was not working. An agency with a clear, honest measurement framework is a better partner than one that promises specific results, because anyone promising guaranteed outcomes in demand gen is either guessing or planning to adjust what gets counted.
4. The team you will actually work with
This is the criterion most buyers forget to probe until it is too late. Who will be on your account day to day? What is their experience level? How many accounts does that person manage? The quality of your day-to-day contact matters more to the outcome of the engagement than the credentials of the person who sold you the work.
5. How they handle it when things are not working
Ask directly: tell me about a program that did not perform as expected. What happened and how did you handle it? An agency that has a thoughtful answer to this question, one that involves honest diagnosis, transparent communication with the client, and a clear course correction, is one you can trust with a real budget. An agency that deflects or cannot recall a meaningful example is telling you something important.
Questions Worth Asking in the Evaluation Process
Bring these into any agency conversation. The answers will tell you more than the deck will.
- Who will be working on my account day to day, and what is their background?
- How many clients does my day-to-day contact currently manage?
- Can you show me examples of programs you have run for companies similar to mine?
- How do you define and measure success for a program like ours?
- What does your reporting look like, and how often will we review results together?
- What happens if a program is not performing? Walk me through how you would handle that.
- What do you need from us to be successful, and what happens if we cannot provide it?
- Have you worked in our marketing automation platform and CRM before?
- What does onboarding look like and how long before we expect to see first results?
- Why do clients leave you?
Red Flags Worth Taking Seriously
A few patterns that consistently show up in agency relationships that do not end well:
- Guaranteed results. Demand generation involves too many variables, including market conditions, sales follow-up, product fit, and competitive dynamics, for any honest agency to guarantee specific pipeline numbers. Promises of guaranteed leads or MQLs usually mean one of two things: a loose definition of what counts, or a model that prioritizes volume over quality.
- No clear ownership of your account. If you cannot get a straight answer about who will be working on your account and what their workload looks like, that is a signal about how you will be treated once the contract is signed.
- A proposal that does not reflect your situation. If the proposal you receive looks like it could have been sent to any company in any industry, the agency did not listen carefully during the discovery process. A good agency proposes what you need, not what they sell.
- Reluctance to talk about what has not worked. Every agency has had campaigns that underperformed. The ones worth working with can talk about those experiences honestly, including what they did differently as a result.
- Long contract terms with no performance provisions. A 12-month contract with no mechanism for reviewing results and adjusting scope is a contract that protects the agency, not you. Reasonable agencies build in checkpoints.
A Note on Budget and Timeline Expectations
Demand generation takes time to produce results. Even a well-designed program with strong creative and the right audience targeting typically takes three to six months before you can draw meaningful conclusions about performance. An agency that promises meaningful pipeline impact in the first 30 to 60 days is either working with a very specific short-cycle product or managing your expectations poorly.
Set a realistic budget. Understand what that budget can actually produce. And agree upfront on the timeline for evaluating success. These conversations are uncomfortable to have before an engagement starts. They are significantly more uncomfortable to have six months in, when expectations and reality have quietly diverged.
What the Right Agency Relationship Actually Looks Like
The best agency relationships do not feel like vendor transactions. They feel like a genuine extension of your team: honest about what is working, clear about what is not, and invested in your pipeline as if it were their own.
The markers of that kind of relationship are findable during the evaluation process, if you know what to look for. An agency that asks good questions, gives you honest answers, can talk about what has not worked, and is clear about what they need from you to succeed is worth a serious look. One that tells you what you want to hear probably will, right up until the contract is signed.
The framework in this post is how you tell the difference.