Augmented Reality Integrated with Flexible Electronic Skin: Multi-Sensory Experience for Digital Inheritance of Hong Kong Yulan Festival Intangible Cultural Heritage
DOI:
https://doi.org/10.65638/2978-8811.2025.01.05Keywords:
Augmented Reality, Flexible Electronic Skin, Haptic Feedback, Intangible Cultural Heritage, Hong Kong Yulan Festival, Digital Inheritance of ICH, User ExperienceAbstract
This study proposes a multi-sensory Augmented Reality (AR) system integrated with custom flexible electronic skin technology, focusing on addressing the lack of haptic feedback in the digital inheritance of the Hong Kong Yulan Festival (Hungry Ghosts Festival) intangible cultural heritage (ICH). The goal is to enhance the authenticity of user experience and cultural perception when interacting with virtual cultural relics of the Yulan Festival. By integrating AR's scene reconstruction capabilities with customizable haptic feedback technology, the system simulates the vibration physical properties and material pressure sensations of characteristic cultural relics of the Yulan Festival, compensating for the deficiency of physical interaction experience in the digital communication of ICH by traditional AR technologies. The flexible electronic skin adopts a modular design, featuring excellent wearing adaptability and environmental compatibility. Combined with the audio-visual immersion brought by AR technology, it constructs an efficient augmented reality interaction framework for technology-empowered traditional culture. Comparative experiments were conducted using the interaction with virtual cultural relics of the Hong Kong Yulan Festival as a standardized scenario, verifying the key role of haptic feedback in improving users' spatial presence, sense of participation, and cultural authenticity. This research provides an extensible technical solution for the digital inheritance of ICH, which can be widely applied to ICH interactive exhibition scenarios requiring enhanced haptic experience.
References
Boboc, R. G., Băutu, E., Gîrbacia, F., Popovici, N., & Popovici, D. M. (2022). Augmented reality in cultural heritage: an overview of the last decade of applications. Applied Sciences, 12(19), 9859.
https://doi.org/10.3390/app12199859
Chan, S. C. (2015) 'Chaoji Yulan Shenghui: Feiwuzhi wenhua yichan, jiti huiyi yu shenfen rentong' (Chiu Chow Hungry Ghosts Festival: Collective memories, intangible cultural heritage, and identities.) Hong Kong: Chung Hwa Book Co.
Chan, S. C. (2018). Heritagizing the Chaozhou hungry ghosts festival in Hong Kong. Chinese heritage in the making, 145.
https://doi.org/10.2307/j.ctt2204rz8.9
Chan, S. C., & Cai, S. (2023). Preserving and exhibiting intangible cultural heritage via virtual museum: A case study of the Hungry Ghosts Festival in Hong Kong. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 48, 405-411.
https://doi.org/10.5194/isprs-archives-XLVIII-M-2-2023-405-2023
Faulkner, L. (2003). Beyond the five-user assumption: Benefits of in-creased sample sizes in usability testing. Behavior Research Methods, Instruments, & Computers, 35(3), 379-383.
https://doi.org/10.3758/BF03195514
Gheorghiu, D., & Ștefan, L. (2020). Immersing into the past: an augmented reality method to link tangible and intangible heritage. PLURAL. History, Culture, Society, (2), 91-102.
https://doi.org/10.37710/plural.v8i2_9
Hou, Y., Kenderdine, S., Picca, D., Egloff, M., & Adamou, A. (2022). Digitizing intangible cultural heritage embodied: State of the art. Journal on Computing and Cultural Heritage (JOCCH), 15(3), 1-20.
https://doi.org/10.1145/3494837
Huang, Y., Zhou, J., Ke, P., Guo, X., Yiu, C. K., Yao, K., ... & Yu, X. (2023). A skin-integrated multimodal haptic interface for immersive tactile feedback. Nature Electronics, 6(12), 1020- 1031.
https://doi.org/10.1038/s41928-023-01115-7
Ke, P., Lin, G., Zhou, J., & Chan, S. C. (2025). Augmented Reality System with Flexible Electronic Skin for Intangible Cultural Heritage Preservation: A Case Study of Hong Kong Yu Lan Festival. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 48, 667-672.
https://doi.org/10.5194/isprs-archives-XLVIII-M-9-2025-667-2025
Ke, P., Yang, X., & Zhu, K. (2023). SoftVibe: Enhancing On- Body Haptic Feedback in VR using Rapid-Prototyping Toolkit with Modularized Flexible Vibrotactile Device. In 16th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia 2023): Emerging Technologies (p. 17). Association for Computing Machinery, Inc.
https://doi.org/10.1145/3610541.3614575
Labadi, S. (2013). UNESCO, cultural heritage, and outstanding universal value: Value-based analyses of the World Heritage and Intangible Cultural Heritage Conventions.
https://doi.org/10.5771/9780759122574
Lang, Y., Deng, X., Zhang, K., & Wang, Y. (2019, February). Construction of intangible cultural heritage spot based on AR technology—taking the intangible cultural heritage of the li nationality in the Areca Valley as an example. In IOP Conference Series: Earth and Environmental Science (Vol. 234, No. 1, p. 012119). IOP Publishing.
https://doi.org/10.1088/1755-1315/234/1/012119
Macefield, R. (2009). How to specify the participant group size for usability studies: a practitioner's guide. Journal of usability studies, 5(1), 34-45.
Skublewska-Paszkowska, M., Milosz, M., Powroznik, P., & Lukasik, E. (2022). 3D technologies for intangible cultural heritage preservation—literature review for selected databases. Heritage Science, 10(1), 3.
https://doi.org/10.1186/s40494-021-00633-x
Slater, M., & Sanchez-Vives, M. V. (2016). Enhancing our lives with immersive virtual reality. Frontiers in Robotics and AI, 3, 74.
https://doi.org/10.3389/frobt.2016.00074
Tong, C., & Hee-Gyun, K. (2022). Intangible cultural heritage based on AR technology. Journal of Applied Data Sciences, 3(3), 118-127.
https://doi.org/10.47738/jads.v3i3.64
Valentini, F., Calcaterra, A., Antonaroli, S., & Talamo, M. (2018). Smart portable devices suitable for cultural heritage: a review. Sensors, 18(8), 2434.
https://doi.org/10.3390/s18082434
Wang, Y., Deng, X., Zhang, K., & Lang, Y. (2018, June). The intangible cultural heritage show mode based on AR technology in museums-take the Li nationality non-material cultural heritage as an example. In 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC) (pp. 936-940). IEEE.
https://doi.org/10.1109/ICIVC.2018.8492843
Yu, X., Xie, Z., Yu, Y., Lee, J., Vazquez-Guardado, A., Luan, H., ... & Rogers, J. A. (2019). Skin-integrated wireless haptic interfaces for virtual and augmented reality. Nature, 575(7783), 473-479.
