iFacialMocap

iFacialMocap offers the capability to capture facial expressions using an iOS application and seamlessly communicate with 3DCG software on your PC in real-time. The tool enables FBX export via email, while the PC-side software facilitates VRM model imports.

To export FBX content, users must activate REC mode to record. By clicking the mail button, a version selection screen for FBX appears. Upon pressing OK, the FBX file is saved in the File folder and triggers the email client.

For more detailed instructions on how to utilize the software, full usage guidelines are provided at the following URL: iFacialMocap Website.

This application excels in generating face animations through real-time interactions with Maya, Unity, 3dsMax, and Blender. Additionally, animations created in real-time can be preserved through baking.

The app supports the loading of VRM avatars directly within the iOS application and integrates smoothly with VMagicMirror, as well as other VRM-related applications like Luppet and HANA_APP on PCs.

To utilize the tool effectively, users should initiate the mobile app and then launch "iFacialMocap to Software app" on their PC, entering their iPhone's IP address accordingly. The software download link for PC usage is available at: iFacialMocap Download Link.

Furthermore, users can create up to 52 morph targets (BlendShape or ShapeKey) following a specific naming convention. Subsequently, users need to employ 3DCG software to load the script/add-on and establish the connection for seamless functionality.

This app ensures highly accurate facial motion capture capabilities in an easily manageable manner.

Please note that this application is solely compatible with models featuring FaceID technology. Camera images and resultant depth data are utilized exclusively to transmit motion capture data to the user's PC; this data is never stored on the iPhone. Access to the camera is necessary to leverage Apple's API for acquiring depth data.

iFacialMocap strictly operates for communication within a local network and does not transmit information to external entities.

Compatibility of this application is limited to iOS devices equipped with FaceID technology. Supported devices include but are not limited to:

• iPhone 13 mini, 13 Pro Max, 13 Pro, 13, 12 Pro Max, 12 Pro, 12
• iPhone 11 Pro Max, 11 Pro, 11
• iPhone XS Max, XS, XR, X
• iPad Pro 12.9-inch (5th generation), 12.9-inch (4th generation), 12.9-inch (3rd generation), 11-inch (2nd generation), 11-inch

It is worth noting that although Face ID is absent in the new iPhone SE 2nd generation launched in 2020, users can access iFacial Mocap by updating to iOS 14 or later. In general, iFacial Mocap can be utilized on any device with an A12 chip or higher if it has been upgraded to iOS14 or beyond.