AudioFollower is a free program that helps animators in the process of lip-syncing.
It consists of a stand-alone application and a Blender add-on.
The program is intended for languages in which each letter corresponds to exactly one sound.
Extract it (usually by right-clicking)
Double click on AudioFollower.exe
Extract it (usually by right-clicking)
Run file AudioFollower located in bin directory by typing ./AudioFollower
Download AudioFollower-2023-02-07-a.py
Install it as an add-on via Edit -> Preferences -> Add-ons -> Install
AudioFollower panel should appear in the Object properties window
The program will store its configuration data in a directory AudioFollower-[version] in the user's home directory.
Make a text file containing the text that should be spoken. It's advisable to double the space characters.
Record yourself speaking.
Save your recording to a wav file, and to another wav file containing the slowed-down version of the same recording.
Create an AudioFollower project, set input text and input audio.
AudioFollower will divide the text into syllables.
Listen to the recording and advance forward by pressing a key whenever you hear the next syllable (NumPad_5) or silence (NumPad_1).
Check other shortcuts by pressing F12 or selecting Help -> Show shortcuts.
You can click on a syllable to move the audio to another position.
Export project to *.auf (AudioFollower) format.
Optionally tweak Project settings (F10):
scale = how much audio is slowed down
spacing = timing for consonants
hold = maximum time for a consonant (but it's not used anymore)
Create a character and its mouth in Blender.
The mouth should consist of shape keys for its outline (a, e, i, o, u, b, m, p, v, f, _).
Use the AudioFollower add-on located in the object properties window to import exported auf file and to automatically create keyframes.
Music: "Balada o Pišonji i Žugi" by Zabranjeno Pušenje
Animation: Goran Svitlica
This is the old example, since the support for tongue has been abandoned.
New version has been used in some of my animations on TikTok.