Presentation
Human-AI Teaming: Design and Evaluation
DescriptionIn this workshop, participants will learn how to design and evaluate autonomy, automation, and AI that partners successfully with humans. Participants will learn about the many facets of human-machine teaming (HMT) as relates to systems with autonomy and practice a set of methods for designing team-based interaction with these emerging systems. Through examples, the instructors will describe the research-based HMT Framework that addresses the need for appropriate observability, cognitive assistance, and coordination. This HMT Framework has ten themes with supplemental design guidelines that can be leveraged to construct a successful partnership between humans and autonomy.
Participants will learn methods to develop design guidance that is specific to their system or application. They will practice techniques for gathering human-AI teaming (HAT) information from experts, analyzing interview data, applying findings to design, and conducting evaluations. They will learn when and how to apply these methods.
The workshop will be highly interactive with lively discussions and exercises to practice HAT methods in context. Upon completing the workshop, participants will be able to:
1. Understand the wealth of research in HAT and how to use it towards effective design;
2. Identify when an opportunity exists to leverage HMT/HAT systems engineering methods;
3. Apply HMT/HAT systems engineering methods to their problem domain.
Prospective students should be familiar with basic usability concepts and usability research or design methods. This workshop is applicable to researchers, engineers, designers, and project leaders looking to better understand human-AI teaming research, design guidelines, and methods. Participants will gain familiarity with the aspects of HMT/HAT design and evaluation. The morning will be spent dissecting the HMT Framework for design. This involves examples, myths, and general requirements, with lots of facilitated class discussion so participants can learn from each other’s experiences and achieve deeper understanding. The afternoon puts that learning into practice. Participants will learn methods for gathering, analyzing, designing, and evaluating. They will then practice using those techniques in the context of an interactive exercise around a use case. Participants should bring their own laptop computers.
Participants will learn methods to develop design guidance that is specific to their system or application. They will practice techniques for gathering human-AI teaming (HAT) information from experts, analyzing interview data, applying findings to design, and conducting evaluations. They will learn when and how to apply these methods.
The workshop will be highly interactive with lively discussions and exercises to practice HAT methods in context. Upon completing the workshop, participants will be able to:
1. Understand the wealth of research in HAT and how to use it towards effective design;
2. Identify when an opportunity exists to leverage HMT/HAT systems engineering methods;
3. Apply HMT/HAT systems engineering methods to their problem domain.
Prospective students should be familiar with basic usability concepts and usability research or design methods. This workshop is applicable to researchers, engineers, designers, and project leaders looking to better understand human-AI teaming research, design guidelines, and methods. Participants will gain familiarity with the aspects of HMT/HAT design and evaluation. The morning will be spent dissecting the HMT Framework for design. This involves examples, myths, and general requirements, with lots of facilitated class discussion so participants can learn from each other’s experiences and achieve deeper understanding. The afternoon puts that learning into practice. Participants will learn methods for gathering, analyzing, designing, and evaluating. They will then practice using those techniques in the context of an interactive exercise around a use case. Participants should bring their own laptop computers.
Presenters
Principal Cognitive Engineer
Lead Human Factors Engineer
Event Type
Workshop
TimeMonday, September 9th9am - 4:30pm MST
LocationFLW Salon I