guides
Manual Accessibility Audits: The Complete Guide
Why manual accessibility audits by people with disabilities catch what automated tools miss — methodology, what to expect, and how to act on the results.
Most teams discover the limits of automated accessibility testing the hard way. A scanner reports a clean bill of health, the team ships, and then a customer who uses a screen reader writes in to say they could not complete checkout — the focus jumped somewhere invisible, a modal trapped them, an error message never announced. Nothing in the automated report flagged any of it, because none of those failures can be detected by a rule that only inspects the DOM. This is the gap a manual accessibility audit fills, and the most reliable way to close it is to put the product in front of people who navigate the web every day with assistive technology.
This guide explains what a manual accessibility audit is, why testing with people with disabilities is the gold standard, exactly what these experts catch that machines cannot, how a rigorous audit is run from scoping to sign-off, and how to turn a report into real fixes. Whether you are preparing for the European Accessibility Act, defending against ADA risk, or simply want a product that genuinely works for everyone, this is the testing layer that decides whether your accessibility effort is real or only on paper.
What a manual accessibility audit actually is
A manual accessibility audit is a structured, human evaluation of a digital product against a recognized standard — almost always WCAG 2.2 at level AA. Unlike a one-click scan, it relies on trained evaluators who operate the interface the way real users do: with a keyboard only, with a screen reader, with screen magnification, with voice control, and with switch devices. Each evaluator works through real tasks — signing up, logging in, searching, filling forms, paying — and records where the experience breaks down.
The defining characteristic of a manual audit is judgment. A machine can confirm that an image has an alt attribute; only a person can decide whether the alt text is meaningful. A machine can confirm a heading exists; only a person can tell whether the heading structure actually describes the page. Manual auditing is where conformance stops being a checklist and starts being an experience.
Manual audit vs. automated scan vs. user testing
These three activities are often confused, but they answer different questions:
- Automated scanning answers “are there any machine-detectable rule violations?” It is fast, cheap, and ideal for catching regressions at scale. QualiBooth’s accessibility scanning software does this continuously.
- Expert manual auditing answers “does this conform to WCAG when a human applies judgment?” It catches the majority of criteria that machines cannot evaluate.
- Usability testing with people with disabilities answers “can real users actually accomplish their goals?” It surfaces friction that may pass WCAG but still defeats people in practice.
The strongest programs combine all three. The most overlooked — and the most valuable — is the middle and final pairing, which is exactly what an audit by people with disabilities delivers: expert WCAG evaluation and lived-experience usability insight in one pass.
Why automated tools only get you part of the way
Independent research has repeatedly found that automated accessibility tools reliably detect only about 30–40% of WCAG success criteria. That is not a knock on the tools — it is a description of the problem space. Roughly two-thirds of WCAG is written in terms of meaning, context, and human perception, none of which a rule engine can assess.
Consider what “passing” an automated scan really proves. It proves that the things a computer can check are in order. It does not prove that:
- The alt text on a product photo describes the product rather than reading “IMG_4821.jpg.”
- The reading order announced by a screen reader matches the visual order on screen.
- A custom dropdown built from
<div>elements can actually be opened and operated without a mouse. - An error message is announced to a screen reader user the moment it appears, not silently inserted into the page.
- The focus indicator is visible against the background a real user sees.
Treating a green automated dashboard as proof of accessibility is one of the most common and most expensive accessibility mistakes. It is also why we are blunt about a related trap: accessibility overlays and “AI widgets” do not fix any of this. They cannot repair the underlying code, they routinely interfere with the assistive technology users already rely on, and no overlay has ever passed a serious manual audit. There is no shortcut around human evaluation. For a fuller picture of what genuine conformance requires beyond the dashboard, see our guide to true digital accessibility.
Why testing with people with disabilities is the gold standard
You can run a competent manual audit with sighted experts who know WCAG and assistive technology well. But the most accurate signal comes from auditors who are the users — people who depend on a screen reader, magnifier, or switch device every day. There are three reasons their input is irreplaceable.
First, fluency. A daily NVDA user hears within seconds when an announcement is wrong, redundant, or missing, because they have an internalized model of what correct sounds like. A sighted tester reading the screen reader output for the first time often cannot tell a confusing experience from a normal one.
Second, realistic strategies. Disabled users develop efficient navigation habits — jumping by headings, by landmarks, by form fields, by links. They expose structural problems that a linear, top-to-bottom tester never reaches.
Third, severity judgment grounded in consequence. When an expert with a disability says a barrier is critical, that rating carries the weight of someone who knows exactly what it means to be locked out of a task. That credibility matters for engineering prioritization and for VPAT and conformance reporting alike.
This is the foundation of QualiBooth’s audits by people with disabilities: every finding is informed by lived experience, not just a specification.
What manual auditing catches that machines miss
It helps to be concrete. Below are the categories of failure that consistently slip past automated tools and require a human — ideally a human who uses assistive technology — to detect.
Meaningful alternative text and labels
A scanner verifies that alt exists and that a control has an accessible name. It cannot tell whether “Submit” describes what a button does, whether a decorative image was correctly hidden with alt="", or whether a complex chart has an adequate text equivalent. Meaning is a human call.
Logical focus order and focus management
Tab through a page and the experience either flows or it doesn’t. Manual testing catches focus that jumps unpredictably, focus that disappears off-screen, focus that gets trapped in a widget with no escape, and — critically — focus that is not moved to a dialog when it opens or returned to the trigger when it closes. These are among the most disabling defects on the web and are essentially invisible to automation.
Screen reader announcements and dynamic content
Does adding an item to the cart announce a confirmation? Does a live validation error reach the user, or is it inserted silently? Does a single-page-app route change tell the screen reader where it landed? Verifying this requires actually listening with NVDA, JAWS, VoiceOver, or TalkBack. Our screen reader testing guide goes deeper, and a dedicated screen reader evaluation isolates exactly these issues.
Custom widgets and ARIA correctness
Comboboxes, tab panels, accordions, sliders, date pickers, and menus built with custom markup are where accessibility most often quietly fails. A scanner may report no errors while a widget is completely unusable by keyboard or screen reader. Human operation is the only reliable test of whether a custom component behaves like the pattern it imitates.
Reading order, structure, and cognitive load
The visual layout and the programmatic structure can diverge. Manual review catches reading sequences that make no sense when linearized, heading outlines that misrepresent the page, instructions that depend on sensory cues (“click the green button”), and flows that overwhelm users with cognitive disabilities.
Documents, media, and email
PDFs, captions, audio descriptions, and HTML email each carry their own barriers that browser-based scanners rarely cover. These often need specialist remediation — see PDF remediation and email remediation.
How a rigorous manual audit is run
A trustworthy audit follows a repeatable methodology so that results are defensible, reproducible, and actionable. Here is the process QualiBooth uses for an audit by people with disabilities, end to end.
- Scoping. Together we identify the journeys, page templates, and platforms that matter most — the flows tied to revenue, compliance, and safety. Auditing every page is rarely necessary; auditing the right representative sample is.
- Defining the assistive technology matrix. We agree on which combinations to test. A typical matrix includes NVDA and JAWS on Windows, VoiceOver on macOS and iOS, TalkBack on Android, Dragon for voice control, switch access, and screen magnification, weighted toward your real audience.
- Expert manual testing. Auditors with disabilities work through each journey using their own assistive technology, exactly as real users do, while documenting every barrier they hit.
- Documentation of findings. Each issue captures the assistive technology used, the precise steps to reproduce, expected versus actual behavior, the affected platform, severity, and the real-world impact on users.
- WCAG 2.2 mapping. Every finding is tied to a specific success criterion and conformance level (A / AA / AAA), so the report doubles as conformance evidence.
- Prioritized report and live debrief. You receive a ranked report plus a walkthrough with the auditors, where the team can hear and see the barriers firsthand.
- Retest and sign-off. After you ship fixes, we retest the resolved items and confirm the barriers are genuinely gone — not just closed in a ticket.
Sampling: how much to test
For most products, a focused audit of a handful of critical journeys takes one to two weeks and delivers the highest return. A full product audit takes longer but is warranted before a major launch, an acquisition, or a regulatory deadline. The right approach balances coverage against the reality that a representative sample of templates and flows usually reveals the systemic issues that recur everywhere.
What you receive and how to read the report
A good audit report is written for the people who have to act on it, not just for the auditor who wrote it. Expect three layers:
- An executive summary for leadership, legal, and procurement — overall conformance posture, headline risks, and recommended priorities.
- A prioritized findings list for designers and developers, each item mapped to WCAG 2.2 with severity, user impact, reproduction steps, and concrete remediation guidance written in plain language.
- A live debrief so questions are answered in context, with the assistive technology in the room.
Severity is the field to read first. Most rigorous reports rank issues from critical (blocks a task entirely for a group of users) down to minor (inconvenient but non-blocking). Resist the urge to sort by “easy to fix” — sort by user impact, and let severity drive the engineering queue.
How to act on the results
A report is only valuable if it changes the product. The teams that get the most from a manual audit follow a consistent pattern.
- Triage by severity, then by reach. Fix what blocks tasks first, prioritizing barriers that appear on shared components and templates, since one fix there resolves the issue everywhere it recurs.
- Fix the root, not the symptom. A broken modal pattern used in twelve places is one fix, not twelve. Push corrections into the design system and shared component library.
- Verify with the same lens that found the issue. Confirm fixes against the assistive technology that exposed them. This is what the retest-and-sign-off step exists for.
- Prevent regressions. Wire automated checks into your pipeline with CI/CD accessibility integration so a fixed issue cannot silently return on the next deploy.
- Build the muscle. Use the audit as a teaching moment. Accessibility consulting and accessibility process improvement turn one-off fixes into durable practices, so the next audit starts from a much higher baseline.
Where manual audits fit in an ongoing program
A manual audit is a deep, point-in-time picture. Products change every sprint, so a single audit ages quickly. The mature pattern is a layered program:
- Continuous automated monitoring — QualiBooth’s accessibility toolkit and scanning software watch for machine-detectable regressions between expert reviews.
- Recurring expert audits — scheduled human reviews keep conformance from drifting as the product evolves. See recurring accessibility audits and the explainer on why recurring audits matter.
- Milestone deep audits by people with disabilities — before major releases, regulatory deadlines, or VPAT/ACR production, the full lived-experience audit gives you the strongest possible evidence and the most confidence.
This layered approach is how organizations satisfy the EAA, ADA, Section 508, and AODA without treating compliance as a one-time event.
Choosing an audit partner
Not all “manual audits” are equal. When evaluating a provider, ask:
- Who actually performs the testing? Insist that people with disabilities are part of the team, not just sighted testers running a screen reader for the first time.
- What assistive technologies are covered, and on which platforms? A credible matrix spans desktop and mobile, and several screen readers.
- Is every finding mapped to WCAG 2.2 with severity and reproduction steps? Vague reports that say “improve accessibility” are not actionable.
- Do they retest after remediation? A fix is not done until it is verified with the technology that found the problem.
- Can they integrate with ongoing monitoring? The best partners hand you a path to prevention, not just a one-time list.
QualiBooth was built to meet every one of these criteria, combining lived-experience audits by people with disabilities with continuous monitoring through Agora and the wider platform.
Frequently asked questions
How is a manual audit different from running an automated scanner?
A scanner checks the ~30–40% of WCAG criteria that a machine can evaluate. A manual audit applies human judgment to the remaining majority — meaning, focus management, screen reader behavior, custom widgets, and reading order — which is where most real barriers live.
Do I still need automated testing if I do manual audits?
Yes. They are complementary. Manual audits give depth and catch what machines miss; automated scanning gives breadth and speed and guards against regressions every day. Use both. You can start for free with a QualiBooth scan.
How long does a manual accessibility audit take?
A focused audit of a few critical journeys typically takes one to two weeks. A full product audit takes longer. After a short scoping call, you get a fixed scope, timeline, and price.
Will a manual audit help with EAA, ADA, and Section 508 compliance?
Manual auditing by people with disabilities is the strongest form of due-diligence evidence under the EAA, ADA, Section 508, WCAG, and AODA. Documented methodology and WCAG-mapped findings directly support your compliance position and feed into VPAT/ACR production.
Are accessibility overlays a substitute for a manual audit?
No. Overlays cannot fix underlying code, frequently break the assistive technology users depend on, and have never passed a serious manual audit. There is no automated substitute for human evaluation.
Conclusion
Automated testing tells you whether the machine-checkable parts of your product are in order — roughly a third of what WCAG actually requires. Everything that determines whether a person with a disability can sign up, search, pay, and succeed lives in the other two-thirds, and the only reliable way to evaluate it is to watch real people use real assistive technology. A manual accessibility audit by people with disabilities is not a nice-to-have on top of automation; it is the layer that makes the rest meaningful. If you want to know not just whether your product passes a scan but whether it genuinely works for everyone, an audit by people with disabilities is where to begin — and talking to a QualiBooth expert is the fastest way to scope one.
Find the barriers automated scans can't see