Inception of Perception – Augmented Reality in Virtual Reality: Prototyping Human-Machine Interfaces for Automated Driving

This publication is a chapter in the book: User Experience Design in the Era of Automated Driving

Editors: Andreas Riener, Myounghoon Jeon and Ignacio Alvarez
Category: Engineering / Control Engineering / Studies in Computational Intelligence

About the book:

This book is dedicated to user experience design for automated driving to address humane aspects of automated driving, e.g., workload, safety, trust, ethics, and acceptance.
Automated driving has experienced a major development boost in recent years. However, most of the research and implementation has been technology-driven, rather than human-centered. The levels of automated driving have been poorly defined and inconsistently used. A variety of application scenarios and restrictions has been ambiguous.
Also, it deals with human factors, design practices and methods, as well as applications, such as multimodal infotainment, virtual reality, augmented reality, and interactions in and outside users.
This book aims at 1) providing engineers, designers, and practitioners with a broad overview of the state-of-the-art user experience research in automated driving to speed-up the implementation of automated vehicles and 2) helping researchers and students benefit from various perspectives and approaches to generate new research ideas and conduct more integrated research.read more

Chapter Abstract:

Augmented Reality in vehicles through Head-Up or Windscreen Displays offer numerous opportunities to develop road safety or user experience applications or both. These opportunities are further expanded in the context of automated driving, where human drivers are partially freed of the safety-critical driving task to attend to other activities, so-called non-driving related tasks. This brings new human factor challenges, such as lack of situation awareness when the driver is asked to take control of the driving vehicle.
There are methodological challenges when undertaking user experience design or human factors research in this domain because of the current development status of future technologies. Prototypes of windscreen displays and automated vehicles are difficult to access and expensive. Therefore, we have developed an affordable virtual reality automated driving simulator that implements real-world driving videos for interface prototyping and testing.
In this chapter, we discuss two concepts (dynamic windshield tinting to communicate certainty and an Augmented Reality video screen movements to communicate intention) to extend the windshield with additional driving relevant information, which were rapidly prototyped and evaluated in our Virtual Reality simulator. Following the user experience design approach, we report on qualitative findings from a user study design iteration (N=16) about those concepts. We reflect on the identified strengths and weaknesses of our design concepts, which were critically influenced by participants’ experience and trust in vehicle automation, as well as the methodological process. Lastly, we report on valuable lessons learnt from developing, improving and implementing our prototyping, simulation and evaluation tool for Augmented Reality applications in automated driving.

Michael A. Gerber, Mohammad Faramarzian and Ronald Schroeter. 2022. Inception of Perception – Augmented Reality in Virtual Reality: Prototyping Human-Machine Interfaces for Automated Driving. In User Experience Design in the Era of Automated Driving. Studies in Computational Intelligence. Springer, Doi: 10.1007/978-3-030-77726-5, Source: https://www.springer.com/gp/book/9783030777258

(In Press)