Agent skill

web-severity-scoring

Severity scoring, scorecard computation, confidence levels, and remediation tracking for web accessibility audits. Use when computing page accessibility scores (0-100 with A-F grades), tracking remediation progress across audits, or generating cross-page comparison scorecards.

Stars 217
Forks 22

Install this agent skill to your Project

npx add-skill https://github.com/Community-Access/accessibility-agents/tree/main/.github/skills/web-severity-scoring

SKILL.md

Web Severity Scoring

Severity Scoring Formula

text
Page Score = 100 - (sum of weighted findings)

Weights:
  Critical (confirmed, all three sources):   -18 points
  Critical (high confidence, both sources):  -15 points
  Critical (high confidence, single source): -10 points
  Critical (medium confidence):               -7 points
  Critical (low confidence):                  -3 points
  Serious (high confidence):                  -7 points
  Serious (medium confidence):                -5 points
  Serious (low confidence):                   -2 points
  Moderate (high confidence):                 -3 points
  Moderate (medium confidence):               -2 points
  Moderate (low confidence):                  -1 point
  Minor:                                      -1 point

Floor: 0 (minimum score)

Score Grades

Score Grade Meaning
90-100 A Excellent - minor or no issues, meets WCAG AA
75-89 B Good - some issues, mostly meets WCAG AA
50-74 C Needs Work - multiple issues, partial WCAG AA compliance
25-49 D Poor - significant accessibility barriers
0-24 F Failing - critical barriers, likely unusable with AT

Confidence Levels

Level Weight When to Use
Confirmed 120% Validated by all three sources: axe-core + agent review + Playwright behavioral testing
High 100% Confirmed by axe-core + agent, or definitively structural (missing alt, no labels, no lang)
Medium 70% Found by one source, likely issue (heading edge cases, questionable ARIA, possible keyboard traps)
Low 30% Possible issue, needs human review (alt text quality, reading order, context-dependent link text)

Source Correlation

Issues found by both axe-core AND agent review are automatically upgraded to high confidence regardless of individual confidence ratings.

Issues found by all three sources (axe-core + agent review + Playwright behavioral testing) are upgraded to confirmed confidence with a 1.2x weight multiplier. This applies when:

  • axe-core reports a violation
  • Agent code review identifies the same issue
  • Playwright behavioral scan confirms the issue at runtime (e.g., keyboard trap confirmed by actual Tab traversal, contrast failure confirmed by rendered CSS computation)

When Playwright is not available, the maximum achievable confidence remains High (100%). The confirmed tier is additive — it never downgrades findings.

Scorecard Format

Single Page

markdown
## Accessibility Score

| Metric | Value |
|--------|-------|
| Page | [URL] |
| Score | [0-100] |
| Grade | [A-F] |
| Critical | [count] |
| Serious | [count] |
| Moderate | [count] |
| Minor | [count] |

Multi-Page

markdown
## Accessibility Scorecard

| Page | Score | Grade | Critical | Serious | Moderate | Minor |
|------|-------|-------|----------|---------|----------|-------|
| / | 82 | B | 0 | 2 | 3 | 1 |
| /login | 91 | A | 0 | 0 | 2 | 1 |
| /dashboard | 45 | D | 2 | 4 | 3 | 2 |
| **Average** | **72.7** | **C** | **2** | **6** | **8** | **4** |

Cross-Page Pattern Classification

Pattern Type Definition Remediation ROI
Systemic Same issue on every audited page Highest - usually layout/nav, fix once
Template Same issue on pages sharing a component High - fix the shared component
Page-specific Unique to one page Normal - fix individually

Remediation Tracking

Change Classification

Status Definition
Fixed Issue was in previous report but no longer present
New Issue not in previous report, appears now
Persistent Issue remains from previous report
Regressed Issue was previously fixed but has returned

Progress Metrics

  • Issue reduction: (fixed / previous_total) * 100
  • Score change: current_score - previous_score
  • Pages improved: count of pages with higher scores than previous audit
  • Trend: improving (score up 5+), stable (within 5), declining (score down 5+)

Issue Severity Categories

Critical

  • No keyboard access to essential functionality
  • Missing form labels on required fields
  • Images conveying critical information have no alt text
  • Color is the sole means of conveying information
  • Keyboard traps with no escape

Serious

  • Missing skip navigation
  • Poor heading hierarchy (skipped levels)
  • Focus not visible on interactive elements
  • Form errors not programmatically associated
  • Missing ARIA on custom widgets

Moderate

  • Redundant ARIA on semantic elements
  • Suboptimal heading structure (multiple H1s)
  • Missing autocomplete on identity fields
  • Links to new tabs without warning
  • Missing table captions

Minor

  • Redundant title attributes
  • Suboptimal button text
  • Missing landmark roles where semantic elements exist
  • Decorative images with non-empty alt text

Expand your agent's capabilities with these related and highly-rated skills.

Community-Access/accessibility-agents

i18n-accessibility

Internationalization and RTL accessibility specialist. Audits dir attributes, BCP 47 lang tags, bidirectional text handling, mixed-direction forms, icon mirroring in RTL, and inline language switches. Ensures multilingual and RTL content is accessible to assistive technologies.

217 22
Explore
Community-Access/accessibility-agents

testing-coach

Accessibility testing coach for web applications. Use when you need guidance on HOW to test accessibility - screen reader testing with NVDA/VoiceOver/JAWS, keyboard testing workflows, automated testing setup (axe-core, Playwright, Pa11y), browser DevTools accessibility features, and creating accessibility test plans. Does not write product code - teaches and guides testing practices.

217 22
Explore
Community-Access/accessibility-agents

pdf-scan-config

Internal helper agent. Invoked by orchestrator agents via Task tool. PDF accessibility scan configuration manager. Use to create, edit, validate, or explain .a11y-pdf-config.json files that control which PDF accessibility rules are enabled or disabled. Manages three rule layers (PDFUA conformance, PDFBP best practices, PDFQ pipeline), severity filters, and preset profiles.

217 22
Explore
Community-Access/accessibility-agents

aria-specialist

ARIA implementation specialist for web applications. Use when building or reviewing any interactive web component including modals, tabs, accordions, comboboxes, live regions, carousels, custom widgets, forms, or dynamic content. Also use when reviewing ARIA usage for correctness. Applies to any web framework or vanilla HTML/CSS/JS.

217 22
Explore
Community-Access/accessibility-agents

Desktop A11y Testing Coach

Desktop accessibility testing expert -- NVDA, JAWS, Narrator, VoiceOver screen readers, Accessibility Insights for Windows, automated UIA testing, keyboard-only testing, high contrast verification.

217 22
Explore
Community-Access/accessibility-agents

lighthouse-bridge

Internal helper agent. Invoked by orchestrator agents via Task tool. Internal helper that bridges Lighthouse CI accessibility audit data with the agent ecosystem. Parses Lighthouse reports, normalizes accessibility findings, tracks score regressions, and deduplicates against local scans.

217 22
Explore

Didn't find tool you were looking for?

Be as detailed as possible for better results