Development of Virtual Production Camera Control System based on Arduino

February 28, 2023  |  Vol.9, No.2  |  PP. 457-466  | PDF

AUTHORS:

Li Penghui, Department of Visual Contents, Dongseo University, Korea

Ki-Hong Kim, Department of Visual Contents, Dongseo University, Korea

David-Junesok Lee, Department of Visual Contents, Dongseo University, Korea

Hou Zhengdong, Department of Visual Contents, Dongseo University, Korea

Zhang Gaohe, Department of Visual Contents, Dongseo University, Korea

KEYWORDS:

Virtual Production, Arduino, Camera control system, Internet of Things, Unreal Engine 5

Abstract

Virtual production technology is becoming more mature and is widely used in the production of video content such as movies, drama series, and advertisements. In the two solutions of virtual production (Live LED Wall Cinematography and Live Compositing), the virtual camera and the real camera are required to be identical, that is, after the synchronization of the intrinsic hardware parameters of the real camera and the virtual camera, the exposure parameters of the real camera are changed during shooting, the corresponding parameters of the virtual camera must also be changed to ensure the consistency of the picture. At present, most virtual production studios use camera control systems that are transformed from broadcast camera consoles usually require cumbersome accessories and high prices. During the actual production process, a camera control system using the Arduino development board is found, which inherits the characteristics of easy-to-operate and strong adaptability of the Arduino development board. The serial digital interface camera control protocol provided by Blackmagic Design (BMD SDI CCP), allows the virtual camera (CineCamera) in the virtual production engine Unreal Engine 5 (UE5) and the real camera to communicate in real-time through the use of serial communication. This paper uses literature analysis to explore the necessity and functional requirements of virtual production camera control systems and the feasibility of the virtual production camera system proposed in this study through analysis of academic journals, industry white papers, professional practitioners, and organization presentations. Descript the hardware requirement and design code for the camera control system, verify the feasibility of the system through empirical research, and provide a camera control system that can be customized for individuals or teams who want to make video content through virtual production.

Menu

APJCRI

    The purpose of this journal is to share and exchange the results of recent research by Asia-Pacific national researchers, and the purpose of the project is to publish the results of convergence research with the humanities and social sciences, including advanced research in specific fields.

References:

[1] M. Kavakli and C. Cremona, The Virtual Production Studio Concept – An Emerging Game Changer in Filmmaking, 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), IEEE, pp.29-37, (2022)
DOI: https://doi.org/10.1109/VR51125.2022.00020
[2] Kim Mi Ra, Post Coronavirus, a shift of Video Contents Production Technology, Journal of the moving image technology associon of korea, (2021), Vol.1, No.35, pp.27-44.
DOI: https://doi.org/10.34269/mitak.2021.1.35.002
[3] N. Kadner, The Virtual Production Field Guide. Volume 1, Epic Games, (2019)
Available from: https://cdn2.unrealengine.com/Unreal+Engine%2Fvpfieldguide%2FVP-Field-Guide-V1.2.02-5d28ccec9909ff626e42c619bcbe8ed2bf83138d.pdf
[4] https://www.youtube.com/watch?v=-gX4N5rDYeQ&ab_channel=IndustrialLight%26Magic, Nov 1 (2022)
[5] https://www.bilibili.com/video/BV15r4y1E7ip/?spm_id_from=333.880, Nov 1 (2022)
[6] https://drive.google.com/drive/folders/1fRMyWr88IZG6xfje3CQ7kqlmYKBI_puf?usp=sharing, Nov 1(2022)
[7] Patnaik Patnaikuni, R. Dinkar, A Comparative Study of Arduino, Raspberry Pi and ESP8266 as IoT Development Board, International Journal of Advanced Research in Computer Science, (2017), Vol.8, No.5, pp.2350-2352.
DOI: https://doi.org/10.26483/ijarcs.v8i5.3959
[8] M. Karami, G. V. McMorrow, L. Wang, Continuous monitoring of indoor environmental quality using an Arduino-based data acquisition system, Journal of Building Engineering, (2018), Vol.19, pp.412-419.
DOI: https://doi.org/10.1016/j.jobe.2018.05.014
[9] Asadullah, Muhammad, Khalil Ullah, Smart home automation system using Bluetooth technology, International Conference on Innovations in Electrical Engineering and Computational Technologies (ICIEECT), IEEE, (2017)
Available from: https://ieeexplore.ieee.org/abstract/document/7916544
[10] Agus Kurniawan, Arduino Uno: A Hands-On Guide for Beginner, PE Press, (2015)
[11] https://www.blackmagicdesign.com/developer/product/arduino, Nov 1 (2022)
[12] https://github.com/videofeedback/Unreal_Engine_SerialCOM_Plugin, Nov 1 (2022)
[13] N. Nourani-Vatani, J. Roberts, Automatic camera exposure control, Proceedings of the Australasian Conference on Robotics and Automation, Australian Robotics and Automation Association (ARAA), (2007)
Available from: https://eprints.qut.edu.au/82536/

Citations:

APA:
Penghui, L. Kim, K. H., Lee, D. J., Zhengdong, H., Gaohe, Z. (2023). Development of Virtual Production Camera Control System based on Arduino. Asia-pacific Journal of Convergent Research Interchange (APJCRI), ISSN: 2508-9080 (Print); 2671-5325 (Online), KCTRS, 9(2), 457-466. doi: 10.47116/apjcri.2023.02.37

MLA:
Penghui, Li, et al. “Development of Virtual Production Camera Control System based on Arduino.” Asia-pacific Journal of Convergent Research Interchange, ISSN: 2508-9080 (Print); 2671-5325 (Online), KCTRS, vol. 9, no. 2, 2023, pp. 457-466. APJCRI, http://fucos.or.kr/journal/APJCRI/Articles/v9n2/37.html.

IEEE:
[1] L. Penghui, K. H. Kim, D. J. Lee, H. Zhengdong, Z. Gaohe, “Development of Virtual Production Camera Control System based on Arduino.” Asia-pacific Journal of Convergent Research Interchange (APJCRI), ISSN: 2508-9080 (Print); 2671-5325 (Online), KCTRS, vol. 9, no. 2, pp. 457-466, February 2023.

Information

Guidelines

Article

Copyright © 2023 APJCRI. All Rights Reserved