How to do Automatic Lipsyncing in Blender with Papagayo
147This is a comprehensive tutorial on how to use automatic lipsyncing in Blender through the program Papagayo.
Dead By Daylight Rendering Discord Server: https://discord.gg/rkkWSH2EMz
Important: The blender plugin no longer works please use the google drive link below with an updated plugin or this plugin instead: https://github.com/AnimNyan/io_import_lipSync-blender2.8
Papagayo link: http://lostmarble.com/papagayo/
Google Drive Link to Finished Blender File: https://drive.google.com/file/d/1ktOrBxPzFTHebOW1Ikp2u0OJu480A_rE/view?usp=sharing
How to import Survivors from Dead By Daylight into Blender: https://www.youtube.com/watch?v=LGdQWUsJLnk
Important note: You only need to do the setup for the Pose Library once. So once you have done it you only need to do the Papagayo timings for any other lipsyncing you wish to do.
Credit goes to Levonotion Studios who made a tutorial from where I learnt how to do this method. However, I wanted to make a fully comprehensive tutorial on how to make the shape keys and pose library and share some of the experience I gained from learning this process.
For your convenience I have also included timecodes of all the different sections and steps in the video.
Timecodes:
00:00 - Final Product Preview
01:13 - Dead By Daylight Rendering Discord
01:28 - 0. Prerequisite Software
03:40 - 1. Importing a Viseme Reference Image
04:45 - 2. Creating Shape Keys with Proportional Editing + Sculpting
11:58 - 3. Key Mouth Shapes for English Speech
13:10 - 4. Moving Bones onto a Separate Bone Layer
14:29 - 5. Creating Viseme Shape Keys through Posing the Skeleton
44:15 - 6. Creating Drivers on Each Shape Key
48:30 - 7. Connecting Drivers to Driver Armature
52:30 - 8. Creating the Lib_Phonemes Pose Library
1:09:26 - 9. Opening Papagayo
1:10:02 - 10. Trimming Audio in Audacity
1:11:40 - 11. Setting Timings for Speech in Papagayo
1:25:45 - 12. Importing the Papagayo Timings into Blender
1:27:30 - 13. Importing Audio into Blender
1:30:25 - 14. Adding Animations on Top of Lipsync
This video is under the creative commons zero license.
-----------------------------------------------------------------
Music featured in this video:
Nier Automata OST | Peaceful Sleep - Keiichi Okabe