Applicator Kit for Modo

Applicator Kit for Modo allow you to apply Apple ARKit Face Tracking data from your iPhone or iPad with a TrueDepth camera to your characters in Modo. Apple ARKit Face Tracking enables your iPhone or iPad to track a performer’s head location as well as over 50 unique Blend Shape coefficients (Morph Targets in Modo), all at 60 frames per second. With Applicator Kit for Modo, you can take this data and apply it to your characters in Modo in 4 Easy Steps:

Define your mapping file
Record your face capture performance
Transfer the data to your computer
Apply the data to your character

Overview Videos:

Installation:

Open Modo
System > Open User Folder
Copy the Applicator folder into the Kits folder
Restart Modo

Key Features:

Item Hierarchy Target: apply the data to all mapped targets within a hierarchy of items in a scene
Actor and Action Target: apply the data to an Actor, and optionally as an Action (new or existing)
Mapping File: allows you to configure the target Morph Maps and Items to apply tracking data to
Multi-Target: allows you to apply a single Blend Shape tracking data to multiple Morph Maps
Independent Enable/Disable: gives you full control over which data points to apply to your scene
Multiplier: sometimes the capture is just too subtle (or too extreme) and not giving you the performance, you need. The multiplier allows you increase (or decrease) the value of the tracking data to your scene
Value Shift: like the multiplier, the value shift allows you to tweak the performance, but rather than multiplying the tracking data, it shifts the value up or down using a constant value (super handy for adjusting head rotation data)
Smoothing Algorithm: optionally apply a smoothing algorithm to the tracking data
FPS Conversion: automatically converts the 60fps recording data to scene’s fps. Support fps options: 60, 50, 48, 30, 29.97, 25 and 24.
Neutral Algorithm: by optionally providing a neutral facial capture (~5 seconds recording of the performer’s face in a neutral state), the algorithm adjusts the capture data to cater for the unique facial shape of the performer.
Start Frame: specify which frame to start the data application to
Skip Capture Frames: specify how many frames from the recording you’d like to skip

Supported Face Tracking Apps:

Note: Applicator Kit does not capture face tracking data, it only applies the data to your scenes in Modo. Please use Live Link Face (free courtesy of Unreal Engine) to capture the facial performance.