This document discusses the motivation for and challenges of developing adaptive web accessibility metrics. Traditional metrics measure conformance to general guidelines but do not capture the user's interaction context. The authors propose adaptive metrics that would produce individualized scores based on the user's abilities, assistive technologies, device, and task. However, there are challenges in automatically capturing this context data and quantifying the severity of accessibility barriers for a specific user. Solutions involve using metadata about problems, contexts, and severities, and expressing guidelines in an ontology to allow for interoperability and inference across guideline sets.
1 of 7
Download to read offline
More Related Content
Adaptive web accessibility metrics
1. Adaptive Web Accessibility Metrics
Markel Vigo1 and Giorgio Brajnik2
1 Laboratory
of Human Mobility 2 University of Udine
and Technology
BCS HCI Workshop: The socio‐technological issues of adaptive interfaces and user
profiling for accessibility
September 6, Dundee (Scotland)
2. 1. Motivation for Adaptive Accessibility Metrics
• We’d like to know the answer to this question:
“To what extent is accessible a web page…
- for a determined user with their own abilities
- using a determined Assistive Technology and user agent
- operating a specific device
- and carrying out a determined task”
• …equals to measuring accessibility in use or contextual accessibility
• There are some scenarios that could benefit
- As a way to measure interface adaptations
- Adaptive hypermedia techniques
- Accessibility observatories and QA
• Traditional web accessibility metrics aim at measuring accessibility
wrt to conformance
Adaptive Web Accessibility Metrics Vigo &Brajnik, 2010
3. 1. Motivation for Adaptive Accessibility Metrics
• Why adaptive accessibility scores?
- Do conformance scores capture the accessibility perceived by users?
- Traditional metrics are based on general purpose guidelines
- Assuming metrics are adequate and valid many error-rates are introduced
- Trusting in guidelines is risky
- Guidelines do not capture all users’ needs and interaction context
• We need accessibility scores that capture the interaction context
• Metrics are tied to evaluation process
• Adaptive evaluation would produce user-tailored scores
• Better if scores are automatically obtained
Adaptive Web Accessibility Metrics Vigo &Brajnik, 2010
4. 2. Challenges and Engineering solutions
Challenge 1: how to capture interaction context data (non intrusively)
• Select only those guidelines that impact on a determined user group
• Not enough
• Context is key for adaptive evaluations
•Detecting installed Assistive Technology and user agents is a step
forward
• Evaluation tools need a user profile as an input
Adaptive Web Accessibility Metrics Vigo &Brajnik, 2010
5. 2. Challenges and Engineering solutions
Challenge 2: quantify severity of violated accessibility barriers
• Weight barriers for a specific user context
• Application scenarios require real-time scores
• How to quantify barriers automatically?
• Make use of infrastructures such as Accessibility Commons
• Accessibility metadata stored beforehand
• Triples: <accessibility problem, context, severity>
Adaptive Web Accessibility Metrics Vigo &Brajnik, 2010
6. 2. Challenges and Engineering solutions
Challenge 3: reasoning over guidelines
• Not to tie the metric to a determined guideline set
• No matter which guideline set is used the metric should adapt to it
• Guidelines have to be specified in a common language so that
evaluation tools can understand them interoperability
• Metrics require parameters such as number of applied
guidelines, severities, etc inference
• Interoperability + inference = ontologies?
Adaptive Web Accessibility Metrics Vigo &Brajnik, 2010
7. Adaptive Web Accessibility Metrics
Markel Vigo1 and Giorgio Brajnik2
1 Laboratory
of Human Mobility 2 University of Udine
and Technology
BCS HCI Workshop: The socio‐technological issues of adaptive interfaces and user
profiling for accessibility
September 6, Dundee (Scotland)
Editor's Notes
#3: Accessibility in use: the property of a site to support the same level of effectiveness for people with disabilities as it does for non-disabled peopleUser context and would consist of the user profileCheck the effectiveness of interface adaptationsprecisely in numeric/qualitative terms. It is useful to meet laws that enforce inclusive design
#4: BUT why we need adaptive metrics?There is a plethora of research stating that guidelines conformance does not necessarily ensure accessibilitySome scenarios require real time scoresBefore we obtain user-tailored scores there are some challenges that should be faced by both adaptive evaluation/measurement
#5: To do so we need to address the following challenges Intuitive solution and initial approachwe need a dynamic selection of guidelines that do applyencapsulating in a CC/PP profile
#6: Some proposed methods can weight violations applying human intervention
#7: As a conclusion,Do we need an adaptive evaluation method and then apply common metrics?or we need traditional methods and apply adaptive accessibility metrics?Do we need both?What do you think?