The vendor shall perform digital accessibility testing on its digital products as part of its development and quality assurance processes and prior to delivery to the Commonwealth. Digital accessibility testing includes Automated Accessibility Testing and Manual Accessibility Testing.
Automated Accessibility Testing
Automated Accessibility Testing refers to accessibility testing using a scanning tool that examines code and flags violations of the Web Content Accessibility Guidelines (WCAG) success criteria. Automated Accessibility Testing is limited in its ability to identify Accessibility Violations. Vendors must perform Automated Accessibility Testing of their digital products against WCAG version 2.1 level A and AA or later and remediate any violations prior to delivery to the Commonwealth. Additionally, automated testing should occur as part of the vendor’s quality assurance processes during the development lifecycle. The vendor shall deliver Automated Accessibility Testing results upon request by the Commonwealth.
Manual Accessibility Testing
Manual Accessibility Testing refers to testing performed by a human tester using manual methods including the use of assistive technology. At a minimum, Manual Accessibility Testing must occur within the environments specified in the Digital Accessibility Testing Matrix defined in Table 1. Due to the limitations of Automated Accessibility Testing, vendors must perform Manual Accessibility Testing of their digital products during development, customization, or configuration and prior to delivery to the Commonwealth. The vendor shall deliver Manual Accessibility Testing results upon request by the Commonwealth.
Examples of Manual Accessibility Testing methods include but are not limited to the following:
- keyboard-only operability and navigation
- screen reader operability and compatibility
- use of color
- color contrast
- focus management
- reflow and responsiveness
- text resize
- manual code inspection
- consistent navigation and identification
- error identification and error suggestion for user input