3D Body Tracking for Compositing | SceneForge 0.7.3

Aug 30, 2022 5:36 pm

Hello there, !

One of the things that set SceneForge's live compositing system apart from other entry-level virtual studio apps is its "smart" functionality, such as content-aware clipping ("Auto-Matte"), Body Tracking, and garbage matte generator.


Now, that feature-set has expanded, with a new 3D Body Tracking option!

Read on and check out the video below for more info:


image


3D Body Tracking?

If you had chromakey footage of someone walking farther from the camera, when projected onto a 3D quad in the scene, it will look like your actor is getting smaller and floating in the air.

To combat this problem, SceneForge now has the ability to compensate for that change in position/scale by translating that 2D movement into real 3D depth through your scene.


This means that if you have an actor walking around a green screen area, with this new system, he can accurately be placed inside your 3D scene, moving in front and behind CG elements not present in the real world -- all with a single, regular 2D camera, entirely in real-time.


How is this different from the old body tracking system?

The existing body tracking system only works on the X-axis, for adjusting the pivot point of your actor as they move left or right. This system does that for the Y and Z axis as well, allowing them to move through your 3D scene, maintaining the illusion of depth.

Of course, you can switch between these modes at any time.


Anything Else?

Aside from the major new feature, there are a few bug fixes that you should be aware of:

  • When loading video surfaces back in, the properties menu now updates properly.
  • When opening the floor plan editor, the camera will now snap to the position of the active camera for easier editing.
  • You can now control the shadow-casting and light-influence of video surfaces independently of each other.


For a list of Known Issues, as well as other in-development features, see this product roadmap board.

This new release will be available by the end of the day today.


If you have any questions, don't hesitate to reach out or reply right to this message!


Thanks for reading!

  • Judah Mantell, Founder @ SceneForge.app
Comments