
Every resume screening tool demos well. You are shown a clean pipeline, a ranked list, a satisfying score badge next to each candidate. The demo is designed to make the ranking look obviously correct, which it always does when you have not read the underlying resumes.
These are the questions that produce different answers from different vendors.
1. Show me what the parser extracted
Ask to see the structured output for a resume you bring — ideally an awkward one, a two-column design or a resume with a graphic timeline.
You are checking two things. Does the extraction survive a real-world layout? And will the product show you the extraction at all?
The second matters more. Parsing failures are silent: a resume that fails to parse comes out looking like a weak candidate, not like an error. If you cannot inspect what was read, you cannot tell those two apart, ever.
2. What is the score computed against?
There are two families here and the difference is fundamental.
Criteria-based: the system scores against requirements you wrote for this role. Lookalike: it scores similarity to people you have hired or rated well before.
Lookalike models are seductive because they need less setup and they capture tacit preferences. They are also the mechanism that produced the best-known bias failures in the field — a model trained on who you hired before will reproduce whoever you hired before, including the parts you would not defend.
If a vendor is vague on this, that is itself an answer.
3. Can you show me why this candidate scored 74?
The answer should name specific requirements met and missed. "Our proprietary model weighs 200 signals" is a non-answer, and it is a non-answer with legal consequences in jurisdictions that require explainability.
A score you cannot interrogate is a score you cannot override with any confidence, which quietly turns a decision-support tool into a decision-maker.
4. What happens when I disagree?
Every ranking will sometimes be wrong. The question is whether the product treats your override as a first-class action or an inconvenience.
Watch for: can you promote a candidate without deleting the score? Is the override recorded? Does it feed back into anything — and do you want it to? (Override feedback loops are how a lookalike model gets built accidentally.)
5. Can I export the data for a bias audit?
You need applicant-level scores, the cutoff applied, and outcomes, in a form you can analyse. If NYC Local Law 144 applies to you, an annual independent bias audit is a legal requirement, not a nice-to-have.
A vendor who has not been asked this before will say so by how long the answer takes.
6. How does it handle the resumes it cannot read?
Ask directly: what happens to a scanned PDF with no text layer? To a resume in a language the parser does not support?
The right answer flags them for human review. The wrong answer scores them low and files them with the rejections, which means the candidates most likely to be disadvantaged by the tool are exactly the ones nobody looks at.
7. What is the actual integration path?
If you have an ATS, this frequently decides the question regardless of how good the screening is. Native integration, API, or CSV export and re-import — the last of these sounds workable in a demo and becomes the reason the tool goes unused by month three.
8. Where does candidate data live, and for how long?
Resume data is personal data under GDPR and most equivalent regimes. You need to know the hosting region, the retention default, whether deletion is real deletion or a flag, and whether applicant data is used to train shared models. That last one is worth asking explicitly and getting in writing.
9. What does it cost when volume spikes?
Hiring is spiky. A role that goes viral on LinkedIn can bring a month's volume in two days. Ask what happens at the limit: hard stop, overage charge, or silent degradation. All three exist in the market and only one of them is acceptable to discover during a live hiring round.
A short scoring sheet
| Question | Good answer | Walk-away answer |
|---|---|---|
| Parser output visible? | Shown per candidate | "It's handled internally" |
| Scoring basis | Criteria you define | Similarity to past hires |
| Score explanation | Requirements met/missed | "Proprietary model" |
| Override | First-class, recorded | Not supported |
| Audit export | Applicant-level CSV/API | Aggregate only |
| Unreadable files | Flagged for review | Scored low silently |
| Retention | Configurable, real deletion | Unclear |
The thing worth remembering
The best screening tool used badly will produce worse hires than a mediocre one used well. Most of the quality comes from the requirements you write before any software is involved — which is a process problem, not a purchasing one.
If you are choosing a tool, spend a proportionate amount of time on writing criteria that are actually checkable. It is the step with the highest return and the smallest budget line.
Common inquiries regarding this topic.
What should resume screening software actually do?
At minimum: parse resumes into structured fields and show you the extraction, score candidates against criteria you define rather than a lookalike model, explain each score in terms of specific requirements met or missed, let you override any ranking, and export the data needed for a bias audit.
At minimum: parse resumes into structured fields and show you the extraction, score candidates against criteria you define rather than a lookalike model, explain each score in terms of specific requirements met or missed, let you override any ranking, and export the data needed for a bias audit.
The Resume World Team
VerifiedProduct & hiring research, Resume World
We build the screening engine behind Resume World. Everything here comes out of working on resume parsing, scoring and hiring workflows day to day — including the parts that turned out harder than expected.
See more than just keywords.
Resume World extracts verifiable evidence from every applicant against role criteria and delivers an explained, ranked shortlist. 100% free to start with zero card required.



