How to Evaluate a New Lead Generation Agency Before Committing Your Budget

Every PI marketing director has been burned by a lead generation agency that performed brilliantly on the pitch and disappointingly in practice. The pitch deck shows impressive lead volume, compelling cost-per-lead numbers, and case studies from firms that look a lot like yours. Three months in, you're spending $30,000 a month and have almost nothing to show for it in signed cases.

This guide gives you a rigorous evaluation framework for new lead generation agencies — before you commit meaningful budget. The goal is not to be cynical about agencies. Good ones exist. The goal is to distinguish them from average ones before you pay to find out which category yours falls into.

Why Agency Evaluation Fails Before It Starts

Most PI marketing directors evaluate agencies on the wrong criteria. They assess presentation quality, responsiveness, references, and cost per lead projections. Those things matter, but they are not predictors of whether the agency will produce signed cases for your firm at a cost you can sustain.

The only criteria that ultimately matter are: at what cost per case will this agency produce signed clients for my firm? Everything else in the evaluation process is a proxy for that number, because you will not have actual data until 60–90 days into the engagement. Your evaluation framework should be designed to get the highest-quality proxy data possible before day one.

The Pre-Commitment Evaluation Checklist

1. Demand Case-Level Performance Data From References

Agency references will tell you how easy the agency is to work with, how responsive the team is, and whether they “delivered.” Those are not the questions you need answered. Ask every reference:

• What was your cost per signed case from this agency, specifically?
• What was the lead-to-case conversion rate on their leads?
• How did those numbers compare to your other channels in the same period?
• What percentage of leads were rejected as unqualified?

An agency whose references cannot provide cost per case data has likely not cultivated client relationships built on that level of accountability. That is itself a signal.

2. Ask for a Pilot Commitment, Not a Full Contract

Propose a 90-day pilot at a defined budget — typically $10,000–$25,000 depending on the agency's minimums — before committing to a longer engagement. A reputable agency that believes in its own product will accept this. An agency that resists a pilot structure and insists on a longer commitment to “see results” is protecting itself from performance accountability, not setting you up for success.

Define the pilot success criteria in the contract. Specify the cost per lead target, the rejection rate ceiling, and — critically — the cost per signed case target you expect by day 90. Make these numbers the basis for whether you continue, expand, or exit the engagement.

3. Audit Their Lead Source Transparency

Ask the agency where their leads come from. Specifically: what percentage come from Google, from Facebook, from television, from co-registration networks, from content farms, or from other aggregator sources? A reputable agency can answer this with specifics. An agency that gives vague answers about “proprietary sources” or “diversified channels” without details is likely purchasing leads from lower-quality networks and marking them up.

Also ask whether leads are exclusive to your firm. Shared leads in a competitive PI market convert at a fraction of the rate of exclusive leads — and the CPL comparison between the two is meaningless without knowing exclusivity status.

4. Evaluate Their Reporting Infrastructure

Before signing anything, ask to see the reporting format the agency uses for active clients. What data do they provide, at what frequency, and in what format? An agency that sends you a PDF with lead count and cost per lead at month-end is giving you vendor-reported data that requires no accountability. An agency that delivers lead-level data with disposition status, timestamps, and source detail is giving you something you can connect to your own intake and case data.

The reporting infrastructure question is a proxy for whether the agency is comfortable with performance accountability. Agencies that deliver granular, auditable data are the ones confident in their numbers.

5. Understand Their Case Type Specialization

Not all PI lead generation agencies are equally effective across all case types. Some agencies excel at auto accident leads and underperform on catastrophic injury. Some have deep mass tort expertise but struggle with high-volume slip-and-fall. Some generate strong workers' comp leads that are useless for a pure-PI firm.

Ask the agency what percentage of their current PI clients focus on the same case types you do. Ask for conversion rate data by case type if they have it. An agency that has never managed a mass tort campaign is not the right partner for your first mass tort. An agency that specializes in catastrophic injury may not be cost-effective for a firm that handles predominantly auto accident cases.

6. Verify Their Geographic Density

Lead quality varies significantly by geographic market. An agency that performs well in Texas may underperform in New York because their lead generation infrastructure — their SEO presence, their media buying relationships, their co-registration networks — is stronger in certain markets. Ask specifically whether they have active client relationships in your state or metro area. Ask how many PI firms they currently serve in your primary market.

More than three or four clients in the same geographic market is a yellow flag — your leads may be competing with their other clients' leads if shared-network sourcing is involved.

The 90-Day Pilot Measurement Framework

Once you engage an agency on a pilot basis, here is the measurement framework that gives you clean data to evaluate at the 90-day mark.

• Tag all agency leads separately in your intake system.Use a distinct source code for this agency. Do not bundle them with other aggregator or digital leads.
• Track lead-to-intake conversion rate weekly.Are the leads engaging with your intake team? A conversion rate below 20% by week three suggests a targeting or lead quality problem worth addressing immediately — not at 90 days.
• Track rejection rate by rejection reason.Record why leads are rejected — wrong case type, wrong geography, statute of limitations, already represented, no injury. The distribution of rejection reasons tells you whether the agency is delivering on their targeting claims.
• Calculate cost per signed case at 60 days, not 90.At 60 days, you will have enough data to identify clear patterns. If the pilot is going badly, you want to know at 60 days — not at 90 — so you can cut the engagement before the next billing cycle.

Red Flags That Should End the Conversation Early

• Resistance to pilot structures: Any agency that will not do a time-limited pilot is protecting itself from a performance test. Walk away.
• References who cannot speak to cost per case:If their best clients are not tracking this metric, the agency has not built a culture of performance accountability.
• Exclusivity claims without verification: Agencies that claim lead exclusivity without being able to show you the technical infrastructure that enforces it may be overstating the guarantee.
• Inability to separate lead-level data by source:If the agency bundles all their lead generation into a single report without source-level detail, you cannot evaluate which of their channels is working — and neither can they.

The right agency relationship is a performance partnership, not a vendor transaction. Build the evaluation process around that expectation, and you will filter out agencies who are not ready to operate at that level of accountability — before they cost you $90,000 to discover.

RevenueScale's vendor performance tracking lets you measure new agency pilots against existing vendors in real time — so 90-day agency evaluations are data-driven from day one.