BEGIN:VCALENDAR
VERSION:2.0
PRODID:Linklings LLC
BEGIN:VTIMEZONE
TZID:America/Phoenix
X-LIC-LOCATION:America/Phoenix
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0700
TZNAME:MST
DTSTART:19700101T000000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTAMP:20241014T203102Z
LOCATION:McArthur Ballroom
DTSTART;TZID=America/Phoenix:20240912T173000
DTEND;TZID=America/Phoenix:20240912T183000
UID:HFESAM_ASPIRE - Presented by HFES_sess108_POS336@linklings.com
SUMMARY:34. Evaluation Approaches for Human-AI Teaming: Guidance for Pract
 itioners
DESCRIPTION:Poster\n\nPatty McDermott (MITRE) and Katja Sednew (The MITRE 
 Corporation)\n\nAre you a practitioner who needs to understand how well hu
 man-AI teaming is supported in your tool? This poster provides actionable 
 lessons learned, level of effort, and appropriate development lifecycle ph
 ase for a range of user engagement methods. We describe three types of use
 r engagements: Co-design with subject matter expert (SME) teammates, Round
 tables with a larger group of SMEs, and a human-in-the-loop experiment. We
  present the metrics and techniques used and the insights they provided ab
 out human-AI teaming. This human-AI teaming research was conducted in the 
 domain of the FAA’s Traffic Flow Management (TFM). The problem dynamics ar
 e complex; the forecast uncertainties are high; and the final decisions ar
 e made through a de-centralized, multi-stakeholder, collaborative process.
  As such, it is not sufficient to build an AI solution. The AI automation 
 must be designed to partner with human collaborators so that the TFM plann
 ers trust it appropriately and use it effectively.\n\nTrack: Aging, Augmen
 ted Cognition, Children's Issues, Communications, Cybersecurity, Education
 , Environmental Design, General Sessions, Human AI Robot Teaming (AI), Mac
 roergonomics, Occupational Ergonomics, Student Forum, Surface Transportati
 on, Sustainability, System Development
END:VEVENT
END:VCALENDAR