BlogPractice & PlaybooksThe Vacancy Was Filled. Did the Supplier Deliver?

    The Vacancy Was Filled. Did the Supplier Deliver?

    11 Nov 2026

    Consider an illustrative case: the monthly report looks healthy, every vacancy is filled on time and fees match the agreement. Three months later, two hires leave during probation. The hiring manager questions the shortlist; the agency points to delayed feedback and a salary range changed mid-search.

    Both sides have evidence. The scorecard does not explain what happened.

    Talent-services performance must connect recruitment activity with hiring outcomes, while separating what the supplier controls from what the client and candidate influence.

    This article focuses on recruitment agencies, executive-search firms and recruitment process outsourcing (RPO) providers. Temporary labour outsourcing requires different operational measures.

    Define the Service Before Setting KPIs

    An agency may source and present candidates; an executive-search firm may map a specialist market; an RPO provider may manage much more of the hiring workflow. They do not control the same work.

    Before agreeing KPIs, define in the contract which roles are in scope, what counts as an accepted requisition and suitable candidate, how candidate ownership is attributed, and how paused or cancelled roles are treated.

    Agree client commitments too: a complete brief, approved salary range, interview availability and timely feedback. Otherwise, the supplier may be blamed for delays it cannot resolve.

    Measure the Match, Not Just the Movement

    Use a small scorecard tailored to the service model and role type.

    Dimension Measures What it shows
    Search delivery Time from accepted brief to qualified shortlist; qualified-submission rate Brief understanding and candidate fit
    Funnel conversion Submission-to-interview; interview-to-offer; offer acceptance Relevance and expectation management
    Hiring outcome Six- or twelve-month retention; probation outcome; time-to-productivity Whether placements remain suitable
    Experience and cost Candidate feedback; hiring-manager satisfaction; fee compliance; total cost per accepted hire Service quality and commercial value

    Define calculations before the first review. Qualified-submission rate is candidates meeting agreed essential criteria divided by eligible candidates submitted. Submission-to-interview is eligible submissions invited to interview divided by eligible submissions. Offer acceptance is accepted offers divided by offers made to supplier-attributed candidates. Agree exclusions for duplicate profiles, cancelled roles and client changes.

    Read the measures together. High submission volume with low interview conversion may indicate weak screening. Fast offers with low acceptance may point to compensation or candidate engagement. Strong placement numbers with weak retention call for a review of role fit and post-offer support.

    CIPS supplier-performance guidance recommends combining objective contract data with customer experience and tailoring measures to the service.

    Separate the Supplier's Clock From the Hiring Process

    Time-to-fill can mislead when its start and end points are unclear. SHRM's 2026 Recruiting Executives Benchmarking, based on more than 4,600 organizations, reports a median 39 calendar days for nonexecutive roles. This is an organization-level benchmark, not an automatic agency SLA.

    Split the timeline into client-owned steps (approval, interview availability and feedback), supplier-owned steps (search, screening and shortlist delivery), and shared or candidate-dependent steps (interviews, offer negotiation and notice period).

    Measure shortlist time from the supplier's acceptance of a complete brief to delivery of candidates meeting agreed criteria. Track client feedback separately. Record role changes and pauses, then adjust the clock under pre-agreed rules.

    Treat Quality of Hire as a Shared Outcome

    Track retention at agreed milestones, probation outcomes and, where reliable data exists, time-to-productivity. SHRM's February 2026 discussion of quality of hire describes it as the immediate and long-term value a new hire delivers, reflected in job performance and sustained tenure. It highlights performance at six and 12 months, time-to-productivity, retention and manager satisfaction.

    Retention also depends on managers, onboarding, workload, compensation and the accuracy of the brief. Segment results by role family, seniority and location where sample sizes allow; a small cohort is not a reliable verdict on a supplier.

    CIPD's September 2026 selection guidance emphasizes fair, transparent assessment and candidate experience. Assess suppliers on the communication they control; the employer remains accountable for its own interview and decision practices.

    Turn the Scorecard Into a Management Decision

    Assign ownership: HR or Talent Acquisition defines roles and validates hiring outcomes; hiring managers assess candidate fit and provide feedback; the supplier account lead supplies funnel data and corrective actions; procurement validates fees, contract commitments and commercial consequences.

    Review frequency should reflect hiring volume, service criticality and contract risk. Triggers include repeated low shortlist conversion, candidate complaints, missed response times, fee exceptions or weak retention across a comparable cohort. Validate the data, locate the cause and agree an action, owner, evidence and review point.

    Close only when evidence shows the issue has been addressed. Depending on the result, HR and procurement may maintain allocation, adjust role coverage, revise the improvement plan or reduce future work. The UK Government's contract-management principles recommend balancing hard KPIs with customer satisfaction and relationship measures.

    Measure suppliers on the work they control, assess them on the outcomes they help create, and make the hiring process visible enough to distinguish one from the other.

    Recommended Reading