Presentation

<
Lip-Sync ML: Machine Learning-based Framework to Generate Lip-sync Animations in FINAL FANTASY VII REBIRTH
SessionLips Don't Lie
DescriptionWe present a machine learning-based framework called Lip-Sync ML to generate lip-sync animations from audio input. In "Final Fantasy VII Rebirth", we used audio clips and animations from our previous game title as training data and created high quality lip-sync animations efficiently with Lip-Sync ML.
Contributors
Masato Nakada
Square Enix Co., Ltd.
Leandro Graciá Gil
Square Enix Co., Ltd.
Akira Iwasawa
Square Enix Co., Ltd.
Ryo Hara
Square Enix Co., Ltd.
Event Type
Talk
TimeTuesday, 30 July 20242:00pm - 2:22pm MDT
LocationBluebird 3D
Session TimeTuesday, 30 July 20242:00pm - 3:30pm MDT
LocationBluebird 3D
Interest Areas
Gaming & Interactive
Recordings
Livestreamed
Recorded
Keywords
Animation
Machine Learning
Registration Categories
Full Conference
Full Conference Supporter
Virtual Access
Exhibitor Full Conference
Tuesday
Next PresentationNext PresentationAudio2Rig: Artist-oriented Deep Learning Tool for Facial and Lip Sync Animation