The Right Way to Evaluate a New Lead Vendor Before You Commit a Full Budget

A new lead vendor shows up with a polished pitch deck, strong references from other PI firms, and compelling cost-per-lead numbers. You want to try them. The question is: how do you evaluate them without committing your full budget to a vendor you don't have performance data on yet?

Most firms either go all-in too early — signing a contract at full volume and discovering the problems three months later — or they move so cautiously that they can't generate enough data in the trial period to make a meaningful assessment. There's a better approach.

Why New Vendor Evaluation Is Different From Ongoing Grading

Your standard vendor scorecard is built on 90 days of performance data. A new vendor doesn't have 90 days of history. If you try to apply a standard grade to a vendor in month one or two, you'll either be evaluating on too little data to be meaningful, or you'll wait so long that you've already spent significant budget before you know whether the investment is sound.

New vendor evaluation requires a distinct framework: a structured ramp period with defined milestones, lower budget exposure, and clear criteria for what it means to “pass” the evaluation and move to standard allocation.

Step 1: Define Your Trial Budget and Duration

Start with a trial budget that is large enough to generate statistically meaningful data but small enough to limit your downside exposure if the vendor underperforms.

A practical trial framework for most PI firms:

• Trial duration:90 days minimum, 120 days preferred. Less than 90 days doesn't give you enough intake-to-sign data if your sign cycle runs 3–4 weeks.
• Trial budget: 20–30% of the monthly budget you would consider allocating at full activation. If your target allocation is $20,000/month, your trial budget should be $4,000–$6,000/month.
• Minimum volume: Ensure the budget generates at least 40–60 leads per month. Below that, your conversion rate data will be too noisy to trust.

The 20–30% trial budget accomplishes two things: it generates enough lead volume to be meaningful, and it limits your exposure to one month of above-average cost per case if the vendor underperforms during the ramp.

Step 2: Set Milestone Benchmarks Before the Trial Starts

Define success criteria before you start the trial, not after. If you set the benchmarks after you see the data, you'll be tempted to rationalize borderline results. Predefined benchmarks keep the evaluation honest.

The benchmarks should include:

• 45-day check:Lead quality indicators — intake contact rate, early rejection rate, and geographic distribution. You won't have signed case data yet, but you can assess whether the leads are meeting basic quality criteria.
• 90-day milestone:First signed case data. A vendor at trial budget should produce at least three to five signed cases in 90 days to generate a meaningful cost-per-case estimate. Define a target CPC range: if this vendor is within 120% of your firm average at 90 days, the trial continues. If they're above 150%, pause and investigate.
• End-of-trial decision: Full evaluation on all scorecard metrics — CPC, conversion rate, rejection rate, trend direction, severity distribution. Assign a grade exactly as you would for an established vendor. A B or better graduates to full budget. A C+ goes to a second 60-day trial at the same budget with defined improvement targets. A C- or below ends the relationship.

Step 3: Track Leading Indicators Before Case Data Arrives

One of the most common frustrations with new vendor evaluation is that the most important metric — cost per signed case — takes 30–60 days to develop because of the intake-to-sign cycle. That doesn't mean you're flying blind in month one.

There are several leading indicators that signal whether a vendor is likely to perform well before you have case data:

Intake Contact Rate

What percentage of the vendor's leads are reachable on first contact attempt? A contact rate below 50% in the first month is a yellow flag. Below 35% is a red flag. It suggests the leads are either stale, poorly qualified, or sourced from channels with low engagement quality.

Early Rejection Rate

Of the leads your intake team does reach, what percentage are being rejected because they don't meet basic case criteria? An early rejection rate above 30% in month one means the vendor isn't filtering leads to your agreed case profile.

Geographic Distribution

Are the leads coming from your priority counties? Even without case data, geographic distribution tells you whether the vendor has meaningful sourcing penetration in your target markets.

Consultation-to-Consultation Show Rate

If your firm conducts intake consultations, what percentage of scheduled consultations from this vendor's leads are actually showing up? A show rate significantly below your firm average is a quality signal worth tracking in month one.

These leading indicators won't replace signed case data. But they give you enough signal to make a “pause and investigate” call at 45 days if the early signs are poor — rather than waiting until 90 days to discover that the vendor was never going to perform.

Step 4: Run the 45-Day Check

At the 45-day mark, schedule a formal review of the leading indicators. This is an internal review — you don't need to involve the vendor yet unless the data warrants a conversation.

If intake contact rate and early rejection rate are both within an acceptable range, and geographic distribution aligns with your targets, continue through the full 90-day trial without changes.

If any leading indicator is significantly outside acceptable range, you have two options: call the vendor immediately to understand the cause and agree on corrections, or pause the trial and wait 30 days to see if the data improves on its own. The latter works if the issue seems temporary (seasonal volume, keyword targeting issue that the vendor acknowledges). If the issue seems structural, the vendor conversation can't wait.

Step 5: Protect Your Existing Portfolio During the Trial

One mistake many firms make when adding a new vendor is reallocating budget from established performers to fund the trial. This is unnecessary and introduces a confounding variable: if your established vendor's case volume drops during the trial period, you won't know if it's a performance issue or a budget reduction effect.

The trial budget should be additive — either from new marketing budget capacity, or pulled from a vendor you already intend to reduce based on existing performance data. Don't reduce an A-grade vendor to fund a new vendor's trial.

What a Successful Trial Looks Like

By the end of a well-run 90–120 day trial, you should have:

• At least 120–180 total leads from the vendor
• At least five signed cases with full source attribution
• 90 days of intake contact rate and rejection rate data
• A preliminary cost per case figure
• A severity distribution estimate (even if based on a small sample)
• A geographic distribution breakdown
• One documented conversation with the vendor about their lead sourcing, targeting methodology, and quality controls

That's enough data to make an informed decision. A vendor who has produced five cases with a below-average CPC, strong geographic fit, and a positive conversion rate trajectory is ready for full budget activation. A vendor who has produced two cases with a high CPC and a 35% rejection rate is not — no matter how good their sales pitch was.

One More Consideration: The Vendor's Own Evaluation of You

The best lead vendors are selective. They have multiple PI firms competing for their inventory, and they allocate their highest-quality leads to the firms that convert them best — because repeat conversions mean repeat revenue for the vendor.

This means your evaluation runs in both directions. During the trial period, work with your intake team to ensure response speed and qualification quality are at their best for this vendor's leads. If your intake process is slow or inconsistent during the trial, your conversion data will understate the vendor's quality — and the vendor's data about your conversion rate will understate your firm's value as a client.

The best outcome for both sides is a trial that accurately reflects what the ongoing relationship will look like. That requires discipline on your end as much as theirs.