Professional Documents
Culture Documents
10 Lip Syncing
10 Lip Syncing
Lip-syncing
Introduction – Lip-Syncing
• Lip-Syncing
○ Also known as lipsyncing or lip syncing
○ Movement of a character’s mouth in sync with the audio being heard
▪ Phonetic sounds
- Dialogue or monologue, essentially any time a character is speaking
- Main type of lip-syncing that is created
▪ Pre-life
- Sounds that tend to communicate emotion
- Used to accentuate actions before, during, or after a primary action is being created
- Mouth codes tend to be created outside of the normal mouth chart
- Example: breathe in / out, gasp, grunt, moan, etc.
▪ Diegetic music
- Music that exists within the world
- For lip-syncing, it is mostly music that is sung by any of the characters visible in the shot
- Another type of diegetic music is music that is heard in the radio, or when a character is
in beat with a certain music
- Employs some ideas similar to lip-sync
▪ Sound effects / background noise
- Any other type of sound that is created by the mouth created by a visible character
○ Purposes
▪ Makes the animation more immersive
- Gives the audience the idea that the character owns the voice, rather than a voice
actor dubbing over the character
- Simple opening / closing of the mouth can create this immersion; but it becomes better
if the different mouth codes match the sounds heard from the character
▪ Gives movement to character
- Lip-syncing is a great way to give movement for a character if they are standing still
- Makes the character look like they are alive and not just like an image
• Types of Sync
○ Sound Sync
▪ Syncing the motion (mouth code) exactly to when the sound comes out
▪ Allows for more accurate syncing between the animation and audio
▪ Used in conjunction with more exaggerated mouth codes
▪ Used for:
- Long sounds (especially vowels)
- Exaggerated / articulated sounds
- Stressed syllables in a conversation
- Dialogue with very high intensity
Page 1 of 16
ANIMATION NCII – Animation 12b
Governor Pack Road, Baguio City, Philippines 2600
Tel. Nos.: (+6374) 442-3316, 442-8220; 444-2786;
442-2564; 442-8219; 442-8256; Fax No.: 442-6268 Grade Level/Section: ICT Ani 12 A, B, C, and D
Email: email@uc-bcf.edu.ph; Website: www.uc-bcf.edu.ph
○ Picture Sync
▪ Offset the animation to one frame from the audio
▪ Sound is heard first, then the animation catches up one frame later
▪ Allows for readability
▪ Used for:
- Normal conversation
- Whispering
- Shorter sounds (especially consonants)
- Unstressed syllables in a conversation
- Blending of sounds
- If the animator does not know which frame to place it on
• Materials and Equipment
○ Audio Recording
▪ Basis for the lip-syncing and all necessary preparations
▪ Done during the pre-production stage with a team including the voice actor(s), sound
director, sound engineers, and director of the animation
▪ All necessary audio must be recorded during this stage
- In some cases, the audio may be rerecorded during the production stages
▪ Audio is processed to create the final output, which will then be used by the production
team to analyze and attempt to sync
- Removal of background sounds and noise
- Removal of unnecessary dead air
- Addition of silence
- Voice modulation
- Addition of equalizers and effects
▪ During the voice recording, a nat pause may be done as well
- Video recording of the voice actor doing their session(s)
- Utilizes the quirks and facial expressions done by the voice actor, which can be used as
reference for the actual character’s action
○ Exposure Sheet
▪ Sheet that provides detailed instructions on an animation
- Actions - Timing
- Dial - Camera instructions
- Layers
▪ Usually used for lip syncing that came from the audio recording
▪ Also used for any animation that requires precise timing, such as:
- Musical numbers / performances - Syncing character movements to
- Playing musical instruments beats / music
- Dancing - Animations with very strict time
- Music videos restraints
▪ Interactions with other aspects of the animation are placed here
- If timing does not need to be very precise, then a time chart would suffice
○ Model Sheets
▪ Reference drawings of how a character looks
▪ Different model sheets would be required for different instances
▪ Used to ensure accuracy and consistency in the design and modeling of the character
during animation
▪ Could also be used in the exposure sheet to determine camera instructions and the style
for the mouth codes
Page 2 of 16
ANIMATION NCII – Animation 12b
Governor Pack Road, Baguio City, Philippines 2600
Tel. Nos.: (+6374) 442-3316, 442-8220; 444-2786;
442-2564; 442-8219; 442-8256; Fax No.: 442-6268 Grade Level/Section: ICT Ani 12 A, B, C, and D
Email: email@uc-bcf.edu.ph; Website: www.uc-bcf.edu.ph
○ Mouth Codes
▪ Series of mouth movements and shapes that correspond to a phonetic sound created by
a character
▪ Sounds are created beforehand or created based on the exposure sheet (which is based
off the audio recording)
▪ Placed in a mouth chart
- Mouth chart – collection of mouth codes for a certain character; allows for easier
referencing
▪ How mouth codes are used for:
- Traditional – placed in a cheat sheet for easier tracing
- Digital – placed as individual PNG / GIF files; transparency is required
• Software Options
○ Animation Software with Available Audio Import Feature
Animation Software Platform and Payment Scheme Characteristics
Adobe Photoshop Desktop (Windows, Mac, Linux) • Import existing audio only
Monthly subscription • Can be viewed in either frame or
timeline view
• Placed in a separate layer
• Can technically be edited, but is
not recommended
Animation Desk Desktop (Windows) • Import existing audio only
Mobile (Android, iOS) • Can only be added once the
Free animation is complete
• Cannot be edited once placed
in the animation
FlipaClip Mobile (Android, iOS) • Can be recorded immediately,
Free from a (paid) set pack, or by
importing audio (paid)
• Has a separate interface
• Cannot be edited once placed
in the animation
Krita Desktop (Windows, Mac, Linux) • In beta version
Free • Import existing audio
• Audio doesn’t sync properly
when listening to select frames in
the animation
• Requires ffmpeg extenstion
OpenToonz Desktop (Windows) • Import existing audio
Free • Has x-sheet view, which allows for
easier syncing with frames
• Cannot be edited once placed
in the animation
• Requires ffmpeg extension
TV Paint Desktop (Windows, Mac) • Import existing audio
One-time payment • Has x-sheet view, which allows for
easier syncing with frames
• Cannot be edited once placed
in the animation
Page 3 of 16
ANIMATION NCII – Animation 12b
Governor Pack Road, Baguio City, Philippines 2600
Tel. Nos.: (+6374) 442-3316, 442-8220; 444-2786;
442-2564; 442-8219; 442-8256; Fax No.: 442-6268 Grade Level/Section: ICT Ani 12 A, B, C, and D
Email: email@uc-bcf.edu.ph; Website: www.uc-bcf.edu.ph
Note: For the activity, students may use a combination of different techniques that would best
suit their current skills and equipment. However, it is recommended to do the lip-syncing by
copy-pasting available mouth codes to prevent any redrawing. As such, there is also a need to
point out of the importance of preparation, particularly the outputs from Modules 8 and 9.
Steps in Lip-Syncing
• Preparation
○ Record Audio
▪ For best results, the audio must be created before the actual production stages
▪ Audio must be edited to be in its final format before going on the next step:
- Removal of outtakes
- Removal of unnecessary background noise
- Timing and splicing
- Addition of white noise
- Noise and background noise removal
- Voice modulation settings (pitch, volume, tuning)
- Effects (layering)
- Equalizer settings and final touches
▪ It is recommended to only using one audio file for the entire animation
- If there are multiple audio files that need to be used, it is recommended that they all be
collated into one audio file with the proper timing
▪ Utilize a separate audio editing software to finalize and export it to its final format:
- MP3 (MPEG-3) – recommended format; usually compatible to all devices
- WAV (Waveform Audio File) – Windows
- M4A (MPEG-4 Part 14) – Mac / iOS devices
Page 4 of 16
ANIMATION NCII – Animation 12b
Governor Pack Road, Baguio City, Philippines 2600
Tel. Nos.: (+6374) 442-3316, 442-8220; 444-2786;
442-2564; 442-8219; 442-8256; Fax No.: 442-6268 Grade Level/Section: ICT Ani 12 A, B, C, and D
Email: email@uc-bcf.edu.ph; Website: www.uc-bcf.edu.ph
Page 5 of 16
ANIMATION NCII – Animation 12b
Governor Pack Road, Baguio City, Philippines 2600
Tel. Nos.: (+6374) 442-3316, 442-8220; 444-2786;
442-2564; 442-8219; 442-8256; Fax No.: 442-6268 Grade Level/Section: ICT Ani 12 A, B, C, and D
Email: email@uc-bcf.edu.ph; Website: www.uc-bcf.edu.ph
Page 6 of 16
ANIMATION NCII – Animation 12b
Governor Pack Road, Baguio City, Philippines 2600
Tel. Nos.: (+6374) 442-3316, 442-8220; 444-2786;
442-2564; 442-8219; 442-8256; Fax No.: 442-6268 Grade Level/Section: ICT Ani 12 A, B, C, and D
Email: email@uc-bcf.edu.ph; Website: www.uc-bcf.edu.ph
• Lip-Syncing Proper
○ Notes:
▪ For this part, Krita shall be used as the main animation software for this tutorial
▪ But any animation software with available audio will do
▪ The steps placed here is also applicable for those who will be using video editing tools and
traditional animation
○ Add Audio
▪ Add in the audio first before anything in the animation software
- This is because the audio will be the basis for the lip-syncing and other movements
- Ensure that the audio has been refined to its final version
- Ensure that the audio is only one
▪ In the Timeline docker, a very small icon of a speaker located at the top left corner
indicates the available audio options
Page 7 of 16
ANIMATION NCII – Animation 12b
Governor Pack Road, Baguio City, Philippines 2600
Tel. Nos.: (+6374) 442-3316, 442-8220; 444-2786;
442-2564; 442-8219; 442-8256; Fax No.: 442-6268 Grade Level/Section: ICT Ani 12 A, B, C, and D
Email: email@uc-bcf.edu.ph; Website: www.uc-bcf.edu.ph
Page 9 of 16
ANIMATION NCII – Animation 12b
Governor Pack Road, Baguio City, Philippines 2600
Tel. Nos.: (+6374) 442-3316, 442-8220; 444-2786;
442-2564; 442-8219; 442-8256; Fax No.: 442-6268 Grade Level/Section: ICT Ani 12 A, B, C, and D
Email: email@uc-bcf.edu.ph; Website: www.uc-bcf.edu.ph
- A new window will pop out at the center of the canvas. Click on the “Add Images”
button at the lower left corner to import the necessary mouth codes
Page 10 of 16
ANIMATION NCII – Animation 12b
Governor Pack Road, Baguio City, Philippines 2600
Tel. Nos.: (+6374) 442-3316, 442-8220; 444-2786;
442-2564; 442-8219; 442-8256; Fax No.: 442-6268 Grade Level/Section: ICT Ani 12 A, B, C, and D
Email: email@uc-bcf.edu.ph; Website: www.uc-bcf.edu.ph
- After importing, notice how the mouth codes will appear in reverse alphabetical order.
Click on the OK button afterwards
- Once imported, the mouth codes will appear at a new layer that is at the foreground
- Take note of naming conventions per layer to prevent confusion
Page 11 of 16
ANIMATION NCII – Animation 12b
Governor Pack Road, Baguio City, Philippines 2600
Tel. Nos.: (+6374) 442-3316, 442-8220; 444-2786;
442-2564; 442-8219; 442-8256; Fax No.: 442-6268 Grade Level/Section: ICT Ani 12 A, B, C, and D
Email: email@uc-bcf.edu.ph; Website: www.uc-bcf.edu.ph
- Go to the reference mouth codes layer and find the correct mouth code
Page 12 of 16
ANIMATION NCII – Animation 12b
Governor Pack Road, Baguio City, Philippines 2600
Tel. Nos.: (+6374) 442-3316, 442-8220; 444-2786;
442-2564; 442-8219; 442-8256; Fax No.: 442-6268 Grade Level/Section: ICT Ani 12 A, B, C, and D
Email: email@uc-bcf.edu.ph; Website: www.uc-bcf.edu.ph
- Turn on visibility of the mouth codes layer and character animation layer
Additional Tips
• Exposure sheet greatly helps with the planning of the animation
○ It helps give a good idea as to the location of each dial more specifically
○ Allows better planning of the character and camera movements in line with the lip-syncing
○ Can give as much detail as possible before doing the actual animation
• Exposure sheet may not be in sync with the actual animation
○ This can be due to:
▪ Change of the audio during the production stages (and the exposure sheet is not
updated)
▪ Error in placement of the dial (by the keyframe animator)
• Improvise based on the audio
○ Use the exposure sheet as a means to detect the mouth code for the given audio
○ However, if it does not connect, then there is a need to improvise
○ If unsure of the placement of the mouth code based on the sound, either
▪ Delay the frame by one (aka picture sync)
▪ Remove the mouth code from the animation
• No need to animate every syllable
○ Animating every syllable removes any nuances from the voice acting since the stressed
sounds are not as stressed as desired
○ Times when a syllable can be forfeited:
▪ Blending sounds
▪ Sounds that last only one frame or less (especially if animating on 2s and 3s)
• Exaggerate if possible
○ Ensure that the exaggeration is in accordance with the character design and audio
References
• Blair, P. (1994). Animation. Walter Foster Publishing: California.
• Krita Docs. (n.d.). Audio for Animation. Retrieved from
https://docs.krita.org/en/reference_manual/audio_for_animation.html
• Technical Education and Skills Development Authority (2018 February 27). Training Regulations for
Animation NCII – Version 02. Quezon City
• Williams, R. (2001). Animator’s Survival Kit. Faber and Faber: United States.
Page 14 of 16
ANIMATION NCII – Animation 12b
Governor Pack Road, Baguio City, Philippines 2600
Tel. Nos.: (+6374) 442-3316, 442-8220; 444-2786;
442-2564; 442-8219; 442-8256; Fax No.: 442-6268 Grade Level/Section: ICT Ani 12 A, B, C, and D
Email: email@uc-bcf.edu.ph; Website: www.uc-bcf.edu.ph
Page 15 of 16
ANIMATION NCII – Animation 12b
Governor Pack Road, Baguio City, Philippines 2600
Tel. Nos.: (+6374) 442-3316, 442-8220; 444-2786;
442-2564; 442-8219; 442-8256; Fax No.: 442-6268 Grade Level/Section: ICT Ani 12 A, B, C, and D
Email: email@uc-bcf.edu.ph; Website: www.uc-bcf.edu.ph
• Sample Output