Blending real and virtual elements on set: part 1
Design AR elements with the hard set in mind
Not so long ago Augmented Reality (AR) was considered a gimmick in studio presentation, but it is now becoming an integral part of many productions. AR elements are becoming part of the workflow, with integration to NRCS systems, triggered by the switcher or controlled by studio automation systems. Continuous improvements in computing technologies and camera tracking method will also contribute to the future growth of AR usage during production. This three part report looks at the challenges in working with real and virtual elements. For part one we turned to the insight of Orad Hi Tec System’s studio and tracking product manager, Haim Halperin.
A key challenge is to ensure that all the elements look natural and an inherent part of the hard set. “From a design point of view it is important to design the AR elements with the hard set in mind,” says Halperin. “From a technology stand point, blending real and virtual elements requires high performance of rendering to render the graphics while the cameras are tracking.
“One of the best approaches to designing with AR in mind is to create elements that look natural, visually appealing and work well with the set’s motif. As AR elements are immersed into the scene they are an excellent tool to captivate the audience.”
When does AR / VR not work?
Halperin: The short answer is when it's not properly planned. “To be effective, accurate tracking is essential,” says Halperin. “Care must be given to the virtual elements to ensure that they are properly placed within the studio, and the elements themselves serve their purpose. It is also essential that the elements are designed in a way that can best used; transparent, realistic, and multi-dimensional and so on. Orad’s experience in the field enables us to ensure that the broadcaster maximizes their use in virtual /augmented reality.
How do you best prepare talent to work with AR?
Halperin: The best way to prepare the talent is to include them in the process itself and to provide them with the capability to rehearse with the elements in the set, ensuring that the talent incorporates the virtual elements are part of the real set. In addition, by being part of the process, the talent can give some suggestions of additional elements, placement of the elements, etc.
How important is lens calibration?
Halperin: Accurate lens calibration is essential for accurate placement of AR elements in the studio. As part of the lens calibration process, it is important to take into account the lens distortion and the lens abrogation for precise placement. The Orad lens calibration process takes into account all those elements for both digital and analog lens, 16x9 and 4x3 aspect ratio, ENG and box lens.
You might also like...
HDR & WCG For Broadcast: Part 3 - Achieving Simultaneous HDR-SDR Workflows
Welcome to Part 3 of ‘HDR & WCG For Broadcast’ - a major 10 article exploration of the science and practical applications of all aspects of High Dynamic Range and Wide Color Gamut for broadcast production. Part 3 discusses the creative challenges of HDR…
IP Security For Broadcasters: Part 4 - MACsec Explained
IPsec and VPN provide much improved security over untrusted networks such as the internet. However, security may need to improve within a local area network, and to achieve this we have MACsec in our arsenal of security solutions.
IP Security For Broadcasters: Part 3 - IPsec Explained
One of the great advantages of the internet is that it relies on open standards that promote routing of IP packets between multiple networks. But this provides many challenges when considering security. The good news is that we have solutions…
The Resolution Revolution
We can now capture video in much higher resolutions than we can transmit, distribute and display. But should we?
Microphones: Part 3 - Human Auditory System
To get the best out of a microphone it is important to understand how it differs from the human ear.