From lab to industry: lessons learned from the evaluation of augmented and virtual reality use cases in the Austrian manufacturing industry

For evaluation of industrial augmented and virtual reality (AR/VR) applications, a comprehensive knowledge of their impact on productivity, process metrics, and human factors is critical to facilitate the transition from lab-scale research to industrial settings. While laboratory-scale evaluations have been extensively researched, successful implementation in industrial settings has fallen short. This paper presents a multi-criteria evaluation model using a mixed methods approach to study thirteen industrial use cases of AR/VR applications in manufacturing over two years. Semi-structured interviews were conducted with companies about the impact of the application. A human factors questionnaire was completed by 69 participants, including in-house users, industry experts, and inexperienced novices. The results of the use cases show an average reduction of 23.61% in process and 25% in cycle time. Process quality indicators improved significantly compared to baseline. The evaluation found no significant differences in workload and ease of use between age groups.