Sarah Amsellem is a lead engineer for Faceshift, which uses a 3D camera to capture facial animations. She talks about the workflow for getting Faceshift up and running, and says that having a good 3D model is key.
Faceshift is being used for High Fidelity, as well as throughout the animation and gaming industry to bring more human emotion and expression into characters through facial animation. At the moment though, it’s difficult to do full facial tracking while wearing a virtual reality HMD. Sarah suggests that eventually they might be able to fuse eye tracking with other facial tracking technologies in order to bring more human expression into realtime social interactions in virtual environments.
For more information on Faceshift, then check out this product page.
Here’s a demo reel that was running at GDC 2015:
Theme music: “Fatality” by Tigoolio