How it worksPricingFAQBlogSign inStart free
Start free trial

AI candidate screening: how it works and where it fits in hiring

How AI candidate screening works, where it fits in the hiring funnel, where it fails, and how to set it up, with a copyable rubric for recruiters.

DeepHire Team

8 min read

Key takeaways

  • Use AI candidate screening as a first-pass assistant between the application and the first human conversation, and keep the final decision with a person.
  • Write your scoring rubric before you configure any tool, because the AI can only judge against the criteria you give it.
  • Keep a person on every rejection and spot-check a sample of the candidates the AI ranked low.
  • Tell candidates when AI is part of screening and give them a way to ask for an alternative. Check local rules with your legal team.
  • Review outcomes by group on a regular schedule so you catch bias early instead of after a complaint.

AI candidate screening is software that reads, sorts, summarizes, or scores applicants against criteria you define, so recruiters can spend their time on the people most likely to fit the job. It works best as a first-pass assistant near the top of the funnel. It gives advice, and a person reviews that advice and makes the call.

Used well, it cuts the hours a recruiter spends on first-pass review. Used carelessly, it adds legal and bias risk you did not have before.

What counts as AI candidate screening?

The phrase gets used for several different tools, and it helps to separate them before you buy anything.

Some screening is rule-based. A knockout question like "Do you have a valid forklift certification?" with a fixed yes or no outcome is automation, not AI. It is predictable and easy to explain.

AI screening uses a model to interpret something less structured: a resume, a written answer, a chat conversation, or the transcript of a recorded interview. The model compares that input to the job criteria and produces a score or a written summary. That flexibility is the appeal. It is also where the mistakes come from, because the model is making judgment calls you did not write out line by line.

How does AI candidate screening work?

Most tools follow the same basic flow, even when the inputs differ.

  1. You define what good looks like. That means the skills and must-have conditions the job requires, such as shift availability, along with what a good answer sounds like.
  2. The candidate provides something to evaluate: a resume, chat replies, test results, or recorded answers.
  3. The model compares that input to your criteria and produces an output, such as a score, a rank, a tag, or a written summary.
  4. A recruiter checks the output against the evidence behind it and decides who moves forward.
TypeWhat it looks atWhat it producesBest for
Resume matchingResume text against the job descriptionMatch score or ranked listLarge applicant pools with clear requirements
Chat or text screenerAnswers to scripted questions by text or chatA pass or fail flag, plus schedulingHourly roles with simple must-haves
Video or audio interview analysisTranscripts of recorded answersSummaries and rubric scores per answerRoles where communication matters
Skills assessmentsTest or work sample resultsScores by skill areaTechnical or task-based roles
ATS rediscoveryPast applicants in your databaseSuggested candidates for a new openingTeams with a large existing pipeline

The quality of the output depends heavily on step one. If your criteria are vague, the AI fills the gap with guesses based on patterns in its training, and those guesses are hard to defend later.

Where does AI screening fit in the hiring funnel?

The best spot is between the application and the first real conversation with a person. Volume is highest there and the questions repeat the most, so that is where recruiter time runs out first.

StageUseful AI roleWhat should stay human
Application intakeParse resumes, flag missing must-havesDeciding whether a flag is a true disqualifier
Pre-screenSummarize answers, score against your rubricWho advances and who is rejected
ShortlistSide-by-side summaries for comparisonThe final shortlist and the notes to the hiring manager
Hiring manager interviewsNote-taking and transcripts, if allowedThe interview itself and the evaluation
OfferLittle to noneEverything

A practical setup for volume hiring looks like this. Candidates complete a short one-way video interview with three to five questions. The AI writes a summary and a suggested score for each answer. The recruiter watches the answers that matter at faster playback, then decides. In DeepHire, for example, AI summaries and scores are based on the recruiter's own rubric and are advice only, so the person reviewing stays responsible for the decision.

The further you move down the funnel, the less AI should be doing. By the time a hiring manager is meeting someone, a model's opinion adds little and a wrong call costs more.

What AI screening does well, and where it falls short

It does some things better than a tired recruiter at the end of a long day:

  • Applying the same rubric to the 200th candidate as to the first
  • Summarizing long answers so you can decide which ones to watch in full
  • Catching when a candidate skipped part of a question
  • Surfacing past applicants you forgot were in the database

It also has real blind spots:

  • It can undervalue nonstandard backgrounds. Someone who ran the floor at a family restaurant without ever holding the title shift lead may score low on a leadership criterion.
  • It inherits transcription errors. Background noise or a weak microphone can produce a bad transcript, and strong accents can trip up transcription too. The score carries the mistake forward.
  • It can repeat old patterns. A model that learned from past hiring decisions may reproduce the preferences built into them.
  • Its numbers look more precise than they are. A score of 82 is still an estimate, and two candidates at 78 and 82 are often indistinguishable.
  • It cannot judge what you did not ask. If reliability matters and no question touches it, the AI has nothing to score.

How to set up AI screening, step by step

1. Write the rubric first

List three to five criteria for the role and describe what a strong, acceptable, and weak answer looks like for each. Do this on paper before you open any tool. If two recruiters on your team would score the same answer differently, the rubric is not clear enough yet.

2. Start with one stage and one role

Pick a high-volume role with stable requirements, like customer service or warehouse associate. Run AI screening there for a few weeks before expanding.

3. Ask questions that produce evidence

The AI can only score what candidates say. Ask about specific situations, not opinions. "Tell me about a time a customer was upset and what you did" gives a model and a recruiter much more to work with than "Are you good with people?" This list of pre-screening interview questions explains what each question tends to reveal.

4. Keep a person on every rejection

Let the AI sort and summarize, but do not let it send rejections on its own. A recruiter should confirm each no, even if that review takes only a minute.

5. Calibrate against your own judgment

Before going live, have two recruiters score a batch of 20 to 30 candidates by hand, then compare their scores to the AI's. Look closely at the disagreements. If the tool keeps missing strong candidates for the same reason, adjust the rubric or the questions.

6. Tell candidates, and offer another path

Say in the invitation that AI helps summarize responses and that a person makes decisions. Give candidates a way to ask for an accommodation or an alternative format.

7. Check outcomes on a schedule

Every month or quarter, compare pass rates across groups at each stage. An AI hiring bias audit walks through what to measure and how.

A sample screening rubric you can copy

This example is for an hourly customer service role. Adjust the criteria for your own jobs.

CriterionStrong (3)Acceptable (2)Weak (1)
AvailabilityMatches all required shiftsMatches most, with a clear plan for the restCannot work required shifts
Handling an upset customerSpecific example, clear actions, describes the outcomeGeneral answer with some detailNo example or blames the customer
ReliabilityConcrete example of showing up or covering when it was hardSays they are reliable, gives a light exampleNo evidence offered
Clear communicationEasy to follow, answers the question askedMostly clear, wanders a bitHard to follow or off topic

Give the AI the same descriptions your recruiters use. When the tool and your team score against identical language, disagreements are easier to explain and fix.

Rules on automated tools in hiring vary by location, and they keep changing. Depending on where you hire, you may need to notify candidates, run and publish bias audits, get consent before analyzing recorded interviews, or offer an alternative process. Disability accommodation obligations still apply when a tool is involved. Check with your legal team for the places you hire in.

A few habits help almost everywhere. Keep a written policy on how AI is used, along with records of rubrics and decisions. A person on your team should be able to explain why any candidate was advanced or rejected. If you do not have a policy yet, start from this AI hiring policy template.

Questions to ask a vendor before you buy

  • Does the AI score against criteria I write, or its own idea of a good candidate?
  • Can it reject candidates automatically, and can I turn that off?
  • Can I see the evidence behind each score, such as the transcript or quoted answer?
  • How does it handle poor audio, accents, or answers in other languages?
  • What data was the model trained on, and is my candidate data used for training?
  • What reporting do you provide for bias audits?
  • How long is candidate data kept, and can I delete it on request?
  • Can I export everything if we switch tools?

Vague answers to the first three questions are a reason to keep looking.

When AI screening is not worth it

If you fill only a handful of roles a year, or most of your hires come from referrals, AI screening usually costs more time than it saves. The same goes for a senior search where every candidate gets a personal call. In those cases the setup and oversight take more time than you get back. It pays off when the same role draws dozens or hundreds of applicants and your recruiters are losing days to first-pass review. Start with that role, and expand only if the time saved and the quality of who gets through both hold up.

Frequently asked questions

Is it legal to use AI to screen job candidates?

In many places it is legal, but some jurisdictions require notice to candidates, bias audits, consent for analyzing recordings, or an alternative process. Rules change often and vary by location, so check with your legal team for each place you hire.

Can AI screening replace a recruiter?

No. AI can sort applicants and suggest scores, but it misses context and cannot be held accountable for a decision. It also tends to misread nonstandard backgrounds, so use it to cut review time and keep a person responsible for who moves forward.

How accurate is AI resume screening?

Accuracy depends mostly on how clear your criteria are and how closely resumes follow standard formats and job titles. Test it by having recruiters score a sample by hand and comparing the results before you rely on it.

Do you have to tell candidates that AI is screening them?

Some jurisdictions require it, and it is good practice everywhere. A short line in the invitation saying that AI summarizes responses and a person makes decisions, plus a way to request an accommodation, covers the basics.

Screen your next shortlist this week

Send one link. Candidates record on their own time. You review the whole batch in an afternoon.

Start your free trial

Free for 14 days. No credit card.