XR-Extended Reality, Video Tiles,Video Walls,Virtual Production, Film Making, Live Studios, Stage, TV Studio,Green Screen   

What Is XR Extended Reality?

XR, called "extended reality," is a 3D visual interaction system that integrates virtual reality (VR), augmented reality (AR), and mixed reality (MR) technologies, and immersive experiences that change the way people access information, experience, and connect with each other.

XR technology, which integrates virtual and augmented reality technologies, can eliminate the distance of reality and "reset" people's relationship in space and time. Through the lens and virtual reality technology, in front of the screen to present a full sense of technology visual effects, in film and television, broadcasting, live entertainment production also has a special meaning.

When XR Meets LED Display

LED screens can provide a more immersive and realistic background for film making, with virtual production technology can greatly save production time and costs. In the past two years, XR technology has come into the public eye, and more and more concerts, virtual production, film making and TV studio programs are using high-tech and realistic extended reality technology to achieve more possibilities for creation. It achieves a perfect integration of virtual and reality by building a virtual world and interacting with the real world.

LED display combined with XR technology virtual film production technology has changed the traditional way of film production, bringing more possibilities and innovations for the production of films.

The Advantages Of XR Solutions In Film Making And Virtual Production

Freedom To Achieve Scene Transitions

The shooting scenes are generated by LED display, supporting conventional pictures, 360° panoramic pictures and videos, 3D models, and external camera signals into the studio to achieve free switching of scenes at any time. Actors can perform in the virtual shooting scene composed by LED screen with realistic feeling. In the application of LED display in the virtual studio, the scene can be made and the shooting picture can be changed at any time.

Achieving Freedom Between Reality And The Virtual

XR video production with LED display as background, the first is the use of real-time rendering technology to photo-level dynamic digital scenes, restored on the LED display, build shooting scenes, through the media server output synthesis, the use of camera tracking system to locate space, location information, real-time mapping of the spatial relationship between the character and the scene, real-time presentation and output of a dead-end virtual scene, and in this real-time rendering of the shooting scene, the actor can interact directly with the virtual visible scene, this scene with physical reference compared to the traditional physical performance more realistic sensory performance environment for actors to experience.

Low Post-Production Costs

With the application of LED in the virtual studio, the director can synchronize the filming process on the monitor to see the shooting effect on the spot, saving the subsequent reshoot time. LED display stage technology and playback technology for the visual effects department greatly reduces the time and difficulty of post-production, the time cost of video production, shooting costs are also greatly reduced. In addition, virtual production solves the cost of transportation and environmental waiting costs for the crew of location shooting.

Achieving Freedom Of Experience And Perception

The combination of XR technology and high-definition LED display reduces the workload of post-production scene construction and reshoots, triggering more empathetic performances by actors, improving production efficiency while creating more magical scenes according to the director's needs and giving performers an immersive scene experience with a more realistic simulation of the real scene.

Advantages Of LED Video Wall Solution

Replace The Green Screen To Avoid Green Overflow Problems

In the traditional green screen shooting environment, it often takes a lot of time for fine keying processing, while fixing the color overflow problem. One of the disadvantages of green screen is the green spill problem and poor lighting of the interaction of the characters in the film production.

With LED wall lights, reflections are more natural and the camera begins to move around the real and virtual elements that are seamlessly combined within the LED environment, giving the viewer looking through the camera's perspective the illusion of fused immersion.

Get Back Control

Directors and cinematographers will be able to see, modify, and sign off on background locations and visuals (and even location recon for virtual production) from pre-production, so there will be less need for reshoots or iterations in post-production.

Actors can see the actual scenery and realize where they are on stage to better adjust their performance. It avoids fatigue and particular disorientation. which is caused by watching green screens for long periods of time. They no longer need to imagine the last movie with only a green screen as a reference. Their eyeline will be more accurate when they view computer-generated (CG) elements.

Perfect Lighting Environment, Better Visual Performance

The right lighting is crucial to creating the right environment for digital photography. Digital LED walls feature accurate dimming to provide appropriate highlights and reflections for the actors. Cinematographers easily leverage their expertise to get perfect real-world lighting from the surrounding LED screens in the scene to meet all needs.In the past, the film may need a lot of lighting, but now because the LED display itself can emit light, it can replace a part of professional film lighting.

More Efficient Workflow, Lower Cost LED Walls

Virtual production moves many characters from post-production to post-production. Many VFX can be done before the photography is completed. Artists can prepare the frame and visualize the scene before shooting. While some animation may still be required after principal photography, many post-production corrections are reduced. These assets are cross-compatible and are available from preview to final output.

The Principle And Step-By-Step Breakdown Of XR Extended Reality Virtual Shooting

XR extended reality virtual shooting is the use of perspective principles, through the LED display as a carrier, in the plane to reproduce a sense of space, three-dimensional methods and related science to achieve a comprehensive technology of real 3D scene effects. After the epidemic era, XR-based film and television dramas and advertising shooting is becoming increasingly popular; its shooting steps are as follows.

1. Playing the produced scenes on LED screens instead of traditional green screens, virtual real scenes.

2. Actors perform directly on a shooting site with a virtual background composed of LED screens.

3. Use the camera to shoot directly, the director can synchronize on the monitor to see the shooting effect.

What Are The XR Virtual Shooting Application Scenarios?

Film Making And Broadcast

Virtual Production LED Wall is a new film production technology that has emerged in recent years and is gaining more and more attention. It is an innovative and revolutionary concept that combines XR, state-of-the-art film production technology, LED display walls and more,The new virtual production solution relies on filming and arranging on phases surrounded by LED video walls, displaying dynamic advanced scenes. LED walls for virtual production are changing Hollywood and the entire film and broadcast industry.

Commercial Advertising

XR technology will play an important role in future marketing, advertising and storytelling. Technology continues to become cheaper and more advanced. XR helps directors and creative personnel to easily accept new technologies, which can be more flexible in the process of advertising shooting, and at the same time, make customers curious and excited about it.

Live Event

Milestrong uses virtual extended reality technology to create the live stage&event globally, combining our LED display technology and expertise with our virtual production experts, we can create any environment you can imagine. For film, television or live events, we have the engineering, technical solutions and creative know-how to make any scene real time.

Instead of a green screen, the XR virtual stage screen can create vivid video conditions for broadcasting. The virtual production of the led wall enables presenters and audiences to see the live interactive scenes around them. This new innovation is a testament to how led wall virtual productions can make broadcasting so enjoyable.

Virtual Teaching

The application of virtual reality technology can create natural and intuitive learning scenarios, change the traditional PPT-based text, images and other two-dimensional flat educational environment, use a realistic three-dimensional interactive environment to display teaching content, change passive transmission learning into active exploration learning to stimulate learning interest and maintain student attention, and effectively improve the quality of education and teaching. In addition to virtual classrooms, there are virtual laboratories, virtual libraries, virtual gymnasiums, etc.

What Are The Core Technical Issues That Need To Be Solved For XR Virtual Shooting?

Color Reproduction

From the video source to the display to the camera is an E2E process, one of the core technical elements of the entire product is the color restoration, and color restoration is the first problem to solve the entire production process color space changes brought about by the color gamut restoration is the standard problem, each color channel restoration spectrum is very pure, whether the large viewing angle has the problem of color temperature shift, whether the color temperature is uneven when the hot screen, these are There are very high technical requirements.

Dragging And Tearing Phenomenon

Professional cameras are often used to shoot high-speed motion picture, to avoid high-speed motion picture asynchronous and tearing phenomenon, LED display must do high frame rate, before requiring 60Hz, 120Hz, now requires up to 240Hz, the future may be higher.

High Dynamic Contrast

Because the camera is an optical imaging device, how to restore more image details of the display in the camera, it is necessary to LED display throughout the dynamic contrast is very high, that is, from the brightest to the darkest area range is very wide, otherwise it may be day and night scenes can not be both, that is, HDR function.

The Moire Problem

Moire pattern is actually the camera imaging light sensor resolution and LED display itself light-emitting device spacing caused by different, then need to optimize the mask design, optimize the LED light design, adjust the camera's focal length, depth of field, perspective these to reduce.

How To Achieve Perfect Virtual Production With LED Video Wall?

Main Components Of XR System

Video Processor

Equipped with XR control system. Control rendering of camera data and LED colour data.

Rendering Server

Rendering and extending live footage. Consists of single and multiple rendering nodes.

l Technology of Rendering Server

Real-time rendered content from the rendering server is accessed via a high-speed network to the video processor so that it can be composited and output.

1. Uncompressed 4K/compressed 4K video streaming.

2. Synchronisation across multiple nodes.

3. Transferring metadata for interactive rendering controls.

Camera

Consists of 1 or more cameras and tracking system. Capture footage and track data.

Camera Tracking

The camera tracking system calculates the relative coordinates of the camera in virtual and real space in real time by using the camera’s external infrared high-speed camera to capture the infrared positioned reflection points on the floor or ceiling and feedback to the server so that it can continuously render images with the correct perspective relationship and sent to the LED screen.

LED Studio

Including LED wall, LED floor and LED controller. Display of live rendered screen.

Screen Display Requirement:

l Low Latency

Low latency between source and output screen. Ensures a perfect fit between the display and the camera tracking system and the movement of the person.

l Wide Colour Gamut

LED screens need to meet the colour gamut standards of their application so that there is no colour distortion, shift or loss when outputting and colour mixing after shooting. In the virtual filming, we can customize the LED colour gamut to suit actual requirements.(DCI-P3 for digital cinema, Rec. 709 for advertising TV programs.

Then relative products recommendations

About Milestrong Service

About Milestrong Service Milestrong Display Co. Ltd. customizes various types of LED digital display, Flexible LED Screen,Interactive LED Floors,Holographic LED Screen ,Immersive LED Displays， creative LED displays etc，our company has a relatively complete production chain and professional technicians, engaged in indoor and outdoor and other display production. After obtaining the design scheme from the customer, we provide one-stop service, customize the finished product of the scheme, deliver it to the customer, and provide good after-sales service

If you want to know more details about sphere led display, please do not hesitate to contact us! Be sure to follow us on LinkedIn and Youtube channel to get the latest news, information and all our new technology solutions