Virtual Production | 모션테크놀로지

Motion capture tracking system

We develop motion capture-based virtual production technology and solutions, and provide a complete solution for a realistic and easy-to-use content creation environment.

It is used in many fields such as games, motion analysis, movies, animations, and metaverses.

Virtual production and motion capture

What is Virtual Production?It refers to the system and space where shooting environment space (background) and elements (characters, props, etc.) are virtually created and filmed for video production. Among the various elements that make up this virtual space, motion capture equipment is used for camera movement (tracking) and creation of virtual characters . Motion capture is essential equipment to express the movement of various elements in virtual space.

virtual production element

Camera

(Camera)

lens

(Lens)

synthesis

(Composite)

virtual character

(Virtual Character)

matching

(Matching)

Virtual production involves a combination of different elements.It can be considered as a basic function and element to implement the elements of the filming site in virtual space, but the most important element is the camera tracking system to match the virtual camera and the real camera, angle of view and distortion of the camera lens, focus and zoom, etc. A lens system for measuring changes is the most basic and minimal component.

Another element is chroma keying to synthesize a person in real space or various real-life elements and a virtual element, such as a background. Recently, the chroma keying part is being developed into a system that creates a background through an LED video wall and simultaneously shoots it.

In addition to this, an important element in virtual production is matching virtual characters such as robots or monsters, or virtual objects that do not exist in reality.

Types of Camera Tracking Systems

It is a camera tracking system for camera tracking in real space through camera creation in virtual space.

In order to track all the various movements of the camera, a sensor is attached to the camera to track the movement of the camera.

Tracking methods mostly use optical cameras, but tracking methods using them are different. Advantages arise from this difference.

An optical cameraIt uses a camera that is widely used for existing motion capture. This method tracks the camera by attaching a marker to the camera. This method can be used for various purposes, not just for cameras, so it is more versatile than other methods and can implement almost all functions (virtual character, image matching, object tracking,...)._cc781905-5cde- 3194-bb3b-136bad5cf58d_

Tracking system used by mo-sysIt is also a method using an optical camera, but in the optical method mentioned above, if the marker attached to the camera is tracked, in this method, the optical camera for tracking is attached to the camera for shooting and the markers (ceiling or floor) around it are tracked. This is how you measure your movement.

The advantage of this method is that it is easy to use, but the disadvantage is that only the camera can track.

<Mo-sys Camera Tracking System>

In this case, called SLAM,This is a method using RealSense made by Intel. This method calculates the distance to the surrounding objects through the binocular camera and obtains the rotation value through the built-in IMU sensor to track the camera.

Compared to the previous two methods, this method has the advantage of being very inexpensive.

However, there is a disadvantage of low reliability of data according to the surrounding environment.

Lens calibration and tracking

A lens that operates like a camera works in conjunction with a camera, but requires another set-up and process to use in virtual production. In the case of camera tracking, if you only need to obtain the movement of the camera, in the case of a lens, you need to set a lot more factors such as the lens's field of view (FoV), distortion, and sensor (CMOS sensor).

The types of lenses are largely divided into prime lenses (prime lenses) and

It is distinguished by zoom lens.

There are about 3 ways to get data (Focus, Zoom) from the lens.First of all, there is a way to obtain data from a lens controller (aka Follow Focus) that uses a servo motor, which has been widely used, and a lens encoder that obtains data by attaching an encoder next to the lens. Recently, data can be obtained from the lens itself. There are lenses etc.

Synthesis (LED Wall, Chroma Key)

As another important hardware element in virtual production, there is a method that has been using the video synthesis method using the previously used chroma key (aka green screen) method. However, in recent years, with the development of LED technology and quality improvement, the background image is projected directly onto the LED, and the method of shooting together rather than synthesizing is used.

In the case of an LED video wall, the image quality is superior to that of the composite method, and the lighting settings are not complicated due to the composite method, so it is easy to use.

Virtual characters and matching

Due to the nature of virtual production, which requires real-time processing of all elements in the video,

Virtual characters are also an important element. For this, existing motion capture technology

Produces virtual character animation. Many elements exist in the virtual space as CG.

Matching the exact location of this space is also a necessary element.

Virtual production is already used in many fields such as games, motion analysis movies, animations, and metaverses.

Motion Technology is developing various hardware and technology for virtual production.

If you are interested in building a solution for virtual production with us, please contact our sales team.