How to Evaluate a New Lead Generation Agency Before Committing Your Budget

You've seen this pitch before: strong lead volume, an attractive cost per lead, case studies from PI firms your size. You sign a six-month contract. Three months and $90,000 later, you have nine signed cases — and no defensible cost per case to show your partners.

This guide gives you a rigorous pre-commitment framework for evaluating new lead generation agencies before you commit meaningful budget. Good agencies exist. The goal is identifying them before the contract, not after it.

Why Agency Evaluation Fails Before It Starts

Most PI marketing directors evaluate agencies on the wrong criteria — presentation quality, responsiveness, references, cost per lead projections. Those things matter. But none of them predict whether the agency will produce signed cases at a sustainable cost for your specific firm.

One question actually matters: at what cost per case will this agency produce signed clients for my firm? Everything else is a proxy, because you won't have real data until 60–90 days in. Build your evaluation to get the best proxy data possible before day one.

The Pre-Commitment Evaluation Checklist

1. Demand Case-Level Performance Data From References

References will tell you how easy the agency is to work with and whether they “delivered.” Those are not the questions that matter. Ask every reference:

• What was your cost per signed case from this agency, specifically?
• What was the lead-to-case conversion rate on their leads?
• How did those numbers compare to your other channels in the same period?
• What percentage of leads were rejected as unqualified?

If their references can't answer those questions, the agency has never built a culture of performance accountability. That's the signal.

2. Ask for a Pilot Commitment, Not a Full Contract

Propose a 90-day pilot at a defined budget — typically $15,000–$25,000 depending on minimums — before committing to a longer engagement. A confident agency accepts this. One that resists and insists on a longer runway to “see results” is protecting itself from accountability, not setting you up for success.

Define success criteria in writing: cost per lead target, rejection rate ceiling, and — most critically — the cost per signed case you expect by day 90. Those numbers determine whether you continue, expand, or walk.

3. Audit Their Lead Source Transparency

Ask exactly where their leads come from — what percentage from Google, Facebook, TV, co-registration networks, or content farms. A reputable agency answers with specifics. Vague answers about “proprietary sources” or “diversified channels” usually mean purchased leads from lower-quality networks, marked up.

Also confirm whether leads are exclusive to your firm. Shared leads in PI convert at a fraction of the rate exclusive leads do — and any cost per lead comparison is meaningless without knowing exclusivity status.

4. Evaluate Their Reporting Infrastructure

Ask to see a sample report before signing. What data do they provide, at what frequency, and in what format? A month-end PDF with lead count and cost per lead is vendor-reported data — no accountability built in. Lead-level data with disposition status, timestamps, and source detail is something you can connect to your own intake records and verify independently.

Reporting format is a proxy for accountability tolerance. Agencies confident in their numbers deliver auditable data. Agencies that aren't send PDFs.

5. Understand Their Case Type Specialization

PI lead gen agencies are not equally effective across all case types. Some excel at auto accidents and underperform on catastrophic injury. Some have deep mass tort expertise but struggle with high-volume slip-and-fall. Case type fit matters as much as volume.

Ask what percentage of their current PI clients focus on your specific case types. Request conversion rate data by case type if they have it. An agency that's never run a mass tort campaign isn't the right partner for your first one. An agency built for catastrophic injury may not be cost-effective for a firm running predominantly auto accident volume.

6. Verify Their Geographic Density

Lead quality varies sharply by market. An agency strong in Texas may underperform in New York — their SEO footprint, media buying relationships, and co-registration networks are geographically concentrated. Ask specifically how many PI firms they currently serve in your state or metro area.

More than three or four active clients in the same market is a yellow flag. If shared-network sourcing is involved, your leads may be competing directly with theirs.

The 90-Day Pilot Measurement Framework

Once you engage on a pilot basis, this measurement framework gives you clean data to act on at day 90.

• Tag all agency leads with a distinct source code.Never bundle them with other aggregator or digital sources in your intake system.
• Track lead-to-intake conversion rate weekly.A rate below 20% by week three signals a targeting or quality problem — address it immediately, not at day 90.
• Track rejection rate by reason.Record why leads are rejected: wrong case type, wrong geography, statute of limitations, already represented. The distribution tells you whether the agency is delivering on their targeting claims.
• Calculate cost per signed case at 60 days, not 90.By then you have enough data to see clear patterns. If the pilot is failing, day 60 lets you cut it before the next billing cycle.

Red Flags That Should End the Conversation Early

• Resistance to pilots:Any agency that won't accept a time-limited pilot is shielding itself from a performance test. Walk away.
• References who can't speak to cost per case:If their best clients aren't tracking that metric, the agency has never demanded that level of accountability.
• Exclusivity claims without verification:If they can't show you how exclusivity is technically enforced, assume it isn't.
• Bundled reporting without source-level detail:If they can't separate leads by source, you can't evaluate which channels are working. And neither can they.

The right agency relationship is a performance partnership, not a vendor transaction. Build your evaluation around that standard, and you'll filter out agencies that aren't ready for that level of accountability — before they cost you $90,000 to find out.

RevenueScale's vendor performance tracking lets you measure new agency pilots against existing vendors in real time — so 90-day agency evaluations are data-driven from day one.