Camera Track

Estimated reading: 3 minutes

Camera Track, also known as match moving or camera motion tracking, is a VFX element in Wonder Studio that matches the movement of a virtual camera in 3D space with the movement of a real camera used in live-action scenes.

The camera track will be estimated only on shots that have actors.

Camera Track influence on Character Motion: When using Camera Track, the character’s motion is confined within the camera’s space, while the camera itself moves in the world space. This approach effectively integrates the character motion into the world space.
Manual Override Option: If needed, you can detach the character from the moving camera, reverting to a state as if the camera tracking feature wasn’t enabled. This flexibility allows for precise control over character placement and movement within the scene.
Focal Length Considerations: Accurate camera tracking requires knowledge of the focal length of the camera used during shooting. Our system is capable of automatically estimating the video’s focal length, but for optimal results, manually providing this information is recommended.
- The supported focal length range is from 13mm to 180mm.
- ⚠️ Our virtual camera uses a full-frame (35mm) sensor! Please ensure to input a full-frame equivalent focal length for your project. This data is commonly available in the documentation of your mobile phone, camera, or lens.
Exporting with Camera Data: When Camera Track is enabled, exported scenes from Wonder Studio come with an estimated camera. Camera track will be present in the AI MoCap export element as well. Additionally, a separate camera FBX file is provided, offering versatility and ease of integration into your existing workflow. ⚠️ Camera Track is not supported in the AI MoCap project type.
Ground Plane leveling: In shots where camera motion is detected and processed, characters and the camera will be aligned with the ground plane. The beginning of the shot will be aligned so that the character is grounded and the camera track and motion capture will drive the rest of the motion from that point on.

Tips

Good to have for successful camera tracking:

Wide shots
Visible feet
Motion that produces a change of perspective (parallax)
Surfaces with distinctive features
Consistent lighting

Some of the following scenarios could potentially lead to incorrect or no camera tracking estimations at all. For shots with no camera tracking estimations, a static camera will be provided.

Try to avoid for best results:

Variable zoom inside the shot
Extreme closeups
Overcrowded scenes
Moving vehicles or other moving objects
Too mch motion blur
Fast camera motion