Digital twin of the stage space

The article examines a conceptual approach to creating and utilizing a digital twin of stage space, which enables the implementation of higher-level control methods through synchronization with the physical space, employing automation of stage processes and their intelligent analysis. A model of stage space is proposed, encompassing static stage objects, dynamic actors, and controllable equipment, as well as intermediate software and hardware interaction systems. Based on this model, a method for constructing a digital twin is introduced, relying on bidirectional real-time synchronization between the model and the automation object. Potential applications of the resulting hardware-software system are discussed, focusing on the development of new methods for managing stage equipment and integrating immersive technologies into the stage environment. The architecture and process of developing a digital twin and a control system based on it are described. New control methods based on intelligent data analysis are proposed, including automated targeting of lighting fixtures, scene switching via triggers, and the integration of augmented reality technologies. These methods significantly streamline control processes and enhance the immersiveness of events.

1. Prokhorov A., Lysachev M. Tsifrovoi dvoinik. Analiz, trendy, mirovoi opyt. Moscow: Al'yansPrint; 2020. 401 p. (In Russ.).

2. Khmyrov A.V. Modern Technologies in the Creation of Theater Settings. Problemy sovremennoi nauki i obrazovaniya. 2020;(4–1):90–93. (In Russ.).

3. Baineva I.I. Lighting Management Systems in Modern Manufacture. In: Priborostroenie i avtomatizirovannyi elektroprivod v toplivno-energeticheskom komplekse i zhilishchno-kommunal'nom khozyaistve: materialy IV Natsional'noi nauchno-prakticheskoi konferentsii: Volume 2, 06–07 December 2018, Kazan, Russia. Kazan: Kazan State Power Engineering University; 2019. P. 589–595. (In Russ.).

4. Madni A.M., Madni C.C., Lucero S.D. Leveraging Digital Twin Technology in Model-Based Systems Engineering. Systems. 2019;7(1). https://doi.org/10.3390/systems7010007

5. Sukhomlin V.A., Namiot D.E., Gapanovich D.A. Analysis of Development Trends of New Generation Digital Twins. International Journal of Open Information Technologies. 2024;12(7):119–130. (In Russ.).

6. Lapina M.A., Bagautdinova A.R., Lapin V.G., Lapin V.V. Digital Twins: Overview of Solutions and Technology Development Prospects. Auditorium. 2024;(3):88–93. (In Russ.).

7. Redmon J., Divvala S., Girshick R., Farhadi A. You Only Look Once: Unified, Real-Time Object Detection. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 27–30 June 2016, Las Vegas, NV, USA. IEEE; 2016. P. 779–788. https://doi.org/10.1109/CVPR.2016.91

8. Kutsakov A., Maximenko A., Gospodinov G., Bogomolov P., Minkin F. GigaAM: Efficient Self-Supervised Learner for Speech Recognition. [Preprint]. arXiv. URL: https://arxiv.org/abs/2506.01192 [Accessed 1st March 2025].

9. Cadena R. Automated Lighting: The Art and Science of Moving Light in Theatre, Live Performance, Broadcast, and Entertainment. New York: Routledge; 2006. 496 p. https://doi.org/10.4324/9780080464534

10. Jin T., Wu Sh., Dasari M., Apicharttrisorn K., Rowe A. StageAR: Markerless Mobile Phone Localization for AR in Live Events. In: 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR), 16–21 March 2024, Orlando, FL, USA. IEEE; 2024. P. 1000–1010. https://doi.org/10.1109/VR58804.2024.00119

11. Dorohin V.A., Teryaev L.N., Nechaevskiy A.V. Technology for Indoor Extended Reality Meta-Spaces Creation Without Pre-Scan. Informatsionno-tekhnologicheskii vestnik. 2024;(2):14–35. (In Russ.).