Presentation
Using Eye-Tracking to Evaluate Novel Augmented Reality Applications for Maritime Operations
DescriptionMaritime operations play a large role in the global economy with over 80 percent of goods transported by sea (United Nations, 2023). Furthermore, ocean-related activities including natural resource utilization (e.g. fishing and aquaculture, offshore energy, underwater mining, etc.), surface and sub-sea exploration, transportation of people, tourism and pleasure activities make oceans and waterways integral to our current way of life. Maritime ship operations are complex socio-technical systems consisting of interconnected entities that need to work together in order to provide safe and efficient outcomes. Like other complex and safety-critical industries, the importance of human performance in creating and maintaining safe and efficient processes is critical. The system of maritime and maritime-related operations encompasses a diverse set of goals, roles, jobs and tasks for which a diverse and varied set of individuals are trained and work to conduct functions of large supply-chains. For example, from shipbuilding and maintenance to port operations and traffic control, logistical planning to class, legal and business aspects, to the actual sharp-end operators in ports and onboard ships working hands-on with cargo handling and deck work, navigation and engine room operators, only represent a sample of differing occupations and tasks that required to achieve overall system goals.
Sharp-end operations and onboard operators of ships and marine structures require particular focus on increasing and supporting Situation Awareness and reducing physical and cognitive workloads, especially during critical parts of a voyage or specific operations (e.g. sailing in high traffic areas, challenging weather or environmental conditions, arriving/departing port or specialty operations such as Dynamic Positioning, convoying, ice breaking, etc.). With increased digitalization and automation found within maritime operational systems sharp-end operators are constantly required to familiarize themselves and retrain with new equipment that have new and differing capabilities, requiring differing work procedures and knowledge. Thus, supporting these operators through differing human-centred initiatives, including organizational, technological, design and training efforts is critical.
From a technological perspective, emerging capabilities in Augmented Reality (AR) have been shown to have a wide range of applications to facilitate sharp-end operators across differing industries (de Souza Cardoso et al., 2020) and safety-critical operations (Li et al., 2018; Vávra et al., 2017). In the maritime domain, AR applications have been proposed or utilized across different areas, including shipbuilding (thyssenkrupp Marine Systems, n.d.; Vargas et al., 2020), maintenance (Grundmann et al., 2021; MAN Energy Solutions, 2019), training (Balcita and Palaoag, 2020), traffic monitoring (von Lukas et al., 2014), and navigation operations (van den Oever et al., 2023). Despite the varied potential for added value across differing applications in the maritime domain, there remains limited empirical data and evidence-based research and development on AR applications in maritime operations. As with implementing any new technology into complex systems there is likelihood for both planned and unplanned outcomes in how new technologies positively and negatively affect differing elements of a system. This paper presents the developments in a multi-year research and development project designing and testing novel Augmented Reality solutions from a human-centred perspective for differing maritime operations and work tasks.
Sharp-end operations and onboard operators of ships and marine structures require particular focus on increasing and supporting Situation Awareness and reducing physical and cognitive workloads, especially during critical parts of a voyage or specific operations (e.g. sailing in high traffic areas, challenging weather or environmental conditions, arriving/departing port or specialty operations such as Dynamic Positioning, convoying, ice breaking, etc.). With increased digitalization and automation found within maritime operational systems sharp-end operators are constantly required to familiarize themselves and retrain with new equipment that have new and differing capabilities, requiring differing work procedures and knowledge. Thus, supporting these operators through differing human-centred initiatives, including organizational, technological, design and training efforts is critical.
From a technological perspective, emerging capabilities in Augmented Reality (AR) have been shown to have a wide range of applications to facilitate sharp-end operators across differing industries (de Souza Cardoso et al., 2020) and safety-critical operations (Li et al., 2018; Vávra et al., 2017). In the maritime domain, AR applications have been proposed or utilized across different areas, including shipbuilding (thyssenkrupp Marine Systems, n.d.; Vargas et al., 2020), maintenance (Grundmann et al., 2021; MAN Energy Solutions, 2019), training (Balcita and Palaoag, 2020), traffic monitoring (von Lukas et al., 2014), and navigation operations (van den Oever et al., 2023). Despite the varied potential for added value across differing applications in the maritime domain, there remains limited empirical data and evidence-based research and development on AR applications in maritime operations. As with implementing any new technology into complex systems there is likelihood for both planned and unplanned outcomes in how new technologies positively and negatively affect differing elements of a system. This paper presents the developments in a multi-year research and development project designing and testing novel Augmented Reality solutions from a human-centred perspective for differing maritime operations and work tasks.
Event Type
Lecture
TimeFriday, September 13th9:10am - 9:30am MST
LocationFLW Salon I
Extended Reality