Design and Experimental Validation of an Augmented Reality System With Wireless Integration for Context Aware Enhanced Show Experience in Auditoriums

Abstract

[Abstract] The development of multiple cultural and social related activities, such as shows related with the performing arts, conferences or presentations rely on facilities such as auditoriums, theatres and conference sites, which are progressively including multiple technological features in order to enhance user experience. There are still however situations in which user experience is limited owing to lack of environment adaption, such as people with disabilities. In this sense, the adoption of Context Aware paradigms within auditoriums can provide adequate functionalities in order to comply with specific needs. This work is aimed at demonstrating the feasibility in enhancing user experience (e.g., improving the autonomy of disabled people) within auditorium and theatre environments, by means of an Augmented Reality (AR) device (HoloLens smart glasses) with wireless system integration. To carry out the demonstration, different elements to build AR applications are described and tested. First, an intensive measurement campaign was performed in a real auditorium in the city of Pamplona (Baluarte Congress Center) in order to evaluate the feasibility of using Wi-Fi enabled AR devices in a complex wireless propagation scenario. The results show that these environments exhibit high levels of interference, owing to the co-existence and non-coordinated operation of multiple wireless communication systems, such as on site and temporary Wi-Fi access points, wireless microphones or communications systems used by performers, staff and users. Deterministic wireless channel estimation based in volumetric 3D Ray Launching have been obtained for the complete scenario volume, in order to assess quality of service metrics. For illustration purposes, a user-friendly application to help hearing impaired people was developed and its main features were tested in the auditorium. Such an application provides users with a 3D virtual space to visualize useful multimedia content like subtitles or additional information about the show, as well as an integrated call button.