Overview
The objective of including questions for Bidders is so we can understand their ability to support our accessibility requirements and to give us responses that we can evaluate for scoring. Currently, we usually only ask for an Accessibility Compliance Report (ACR), which is almost always created by Bidders using ITIC’s Voluntary Product Accessibility Template® (VPAT®). There are a number of weaknesses in using this as our only measure:
- The quality and reliability of the ACR depends on the expertise of the vendor and/or the third party they used to create the report. You cannot score just ACRs unless you know that all of the vendors have submitted accurate ACRs.
- Evaluating ACRs for quality and reliability as well as what they mean about the accessibility of the product requires technical knowledge that most procurement teams do not have available.
While you absolutely need ACRs for proposed solutions, you also need to gather information that will help you understand the Bidders’ ability to supply and maintain accessible solutions. Does the corporate culture value and support accessibility priorities (policy)? Do they foster accessibility expertise in their staff (training)? Do their standard work processes include building in accessibility from the start rather than a fix-it-after approach (design and development)? Is that supported by robust verification methodologies and processes (testing)? Are accessibility issues treated as priorities (handling of issues, timeline for addressing known issues)?
The sample questions below can help you collect information you can use to evaluate Bidders’ accessibility maturity and their ability to be a strong partner in helping us meet our legal obligations.
Proposed solution accessibility
Is the Bidder’s solution and included documentation completely compliant with the following: Web Content Accessibility Guidelines (WCAG) version 2.1, levels A and AA? If not, in what areas is the solution noncompliant?
Provide a completed Accessibility Conformance Report (ACR) from the latest version of the VPAT 2.1 (Voluntary Product Accessibility Template) or equivalent. The ACR must include reporting for WCAG 2.1 Levels A and AA (AAA optional), Functional Performance Criteria (Section 508 requirements), and information on how the report was created.
How does the Bidder’s solution support users who rely on assistive technology or users with diverse disabilities?
- Blind or visually impaired
- Deaf or hard of hearing
- Intellectual and learning disabilities
- Physical and motor disabilities
- Other disabilities as defined by the ADA
Was manual testing done in-house or by a third-party vendor?
Does or will your solution include third-party software, and have you done integration testing for accessibility?
What identity verification software is part of the Solution? Provide examples of how the verification software was tested by users with disability and provide test results.
If the product generates content (e.g., documents, videos, etc.), was the produced content tested for accessibility? If so, how?
Bidder's accessibility policy
Does the Bidder have an accessibility policy? Include a copy of the Accessibility Policy and a description of the involvement of individuals with disabilities in auditing the accessibility of products.
Please provide a copy of the Bidder’s Accessibility Policy.
Describe the Bidder’s internal commitment to accessibility including a workforce that includes people with disabilities.
Who is responsible for ensuring the accessibility of technology products within the Bidder’s organization?
If you use third-party software in your solutions, describe how you ensure it is compliant with WCAG 2.1 and/or the support it offers for creating accessible products.
Training
Does the Bidder have an accessibility training program for product developers?
Does the Bidder include training certifications in required or preferred qualifications in job descriptions?
Describe how the Bidder’s staff and contractors have the knowledge, skills, and experience to create accessible digital technology.
Design and development
How is accessibility integrated into the Bidder’s design and development process?
In developing the offered product, were the principles of universal design, inclusive design, user-centered design, and human-centered design used? If so, describe the processes and approaches used and how they shaped the solution. If not, describe how and why the proposed solution will provide maximum accessibility and ease-of-use for all user types. During implementation, how will all of the aforementioned principles be applied?
Describe the Bidder’s approach to ensuring accessibility for the solution (e.g., strategy, tools, design, testing, ongoing validation). Include if/how the Bidder incorporates accessibility into the development process (e.g., requirements, design, development, testing, maintenance, bug prioritization). Include how the Bidder ensures accessibility post implementation (e.g., future enhancements).
Does the Bidder employ individuals with accessibility challenges or disabilities who have a role in the solution’s development?
Post go-live how will the Bidder keep supporting accessibility during the entire life of the contract?
Testing methodologies and protocols
Describe your testing protocols, including when, how, and how often accessibility testing occurs in the development cycle.
If using automated testing tools, please list them.
If accessibility is manually tested, what rules govern the manual testing? What protocols are followed? What features, functionality and content was tested during the development cycle? Was manual testing done in-house or by a third-party vendor? What qualifications did the testers have? Were people with disabilities involved in the manual testing program?
Was usability testing conducted? If so, were people with disabilities included?
What testing is done to ensure compatibility with assistive technology?
What is the Bidder’s approach to ensuring that individuals with disabilities test the Solution?
Handling of accessibility issues reported
How are accessibility issues prioritized in the SLA?
How does the Bidder ensure that known accessibility problems are addressed, and new accessibility problems are identified?
What are known accessibility barriers? How do you handle remediating aspects of your product that are not accessible?
How will accessibility issues be documented and remediated after deployment?
How have you handled other clients’ requests to improve/remedy accessibility issues? Please describe at least one such request and how it was handled.
What accessibility issues have been identified in prior implementations of the proposed product/solution and what is the current status of those issues? How are accessibility issues captured, tracked, and scheduled for remediation?
How will the Bidder allow for adjustments to accessibility features based on user feedback, improvements in technology, and changes to legal or policy requirements?
Timeline for addressing known accessibility issues
- Please provide an Accessibility Roadmap (see Attachment 1) describing how accessibility issues described in the VPAT will be addressed.
- What accessibility enhancements are in the pipeline, and what is the expected timeline for completion? Do these enhancements depend on any third-party vendors? If so, what are consequences of a delivery delay?