FaceFX is a

facial animation Computer facial animation is primarily an area of computer graphics that encapsulates methods and techniques for generating and animating images or models of a character face. The character can be a human, a humanoid, an animal, a legendary creatu ...

software developed by OC3 Entertainment. It was designed to create realistic Lip synchronization from audio files in

computer games A video game or computer game is an electronic game that involves interaction with a user interface or input device (such as a joystick, game controller, controller, computer keyboard, keyboard, or motion sensing device) to generate visual fe ...

. It was used in Bethesda games such as the Elder Scrolls series and Fallout.

Description

The central component of the program is the face graph. It combines bone poses and morph targets to a single target which is driven by animation curves. These are created by a

speech recognition Speech recognition is an interdisciplinary subfield of computer science and computational linguistics that develops methodologies and technologies that enable the recognition and translation of spoken language into text by computers. It is also ...

system but can also be manually edited. The facial animation is then outputted to the game engine either as bone transformation or morph target frame by frame. To create a realistic animation curve, the program recognizes 42

phonemes A phoneme () is any set of similar speech sounds that are perceptually regarded by the speakers of a language as a single basic sound—a smallest possible phonetic unit—that helps distinguish one word from another. All languages con ...

and tries to take co-articulation rules into account. It also tries to create head movement, blinks, and eyebrow raises from emphasis points in the audio file.

References

{{Reflist Computer animation Animation software Audio to video synchronization Anatomical simulation

Description

See also

References