Panim LipSync Addon - For Blender
Transform Your Characters with Intelligent Lip Sync Animation in Minutes 🎬✨
Stop spending hours on tedious keyframing! PAnim LipSync automatically generates lip sync animations from any audio file using advanced AI technology.
Lip sync in minutes. Get great results immediately, polish only what you want to make perfect.
Works with Shape Keys AND Rigs! The easiest way to turn any audio into lip sync animation. Set up your character, load audio, process and get amazing results!
Perfect for Individual Characters: Watch how to create lip sync animation for a single character using facial shape keys. This quick video covers audio import, automatic phoneme detection and generating smooth lip sync animation in under a minut.
If your Shape Keys don't have the default names for it to work, Don't worry at all! Learn how to apply shape keys with different names to your characters. This quick video shows manual mapping setup.
Learn how to use PAnim LipSync with armature-based facial rigs. This quick video demonstrates bone pose mapping and action-based lip sync
See the power of batch processing in action! Process lip sync for multiple characters with different audio clips simultaneously. This quick video shows character setup, audio management, and timeline markers, perfect for saving time on dialogue-heavy scenes!
Works with both Shape Keys and Armature modes! (Only one shown in this video)
A walkthrough of each feature included in Panim LipSync, everything is here!
There’s also a Lite version available, a more basic edition designed for single-character workflows using Shape Key mode only, with a reduced set of phonemes (A,E,I,O,U,M)
Note: Currently the Lite version works with windows.
- 🔧 Blender 4.1 to 4.5 (Current Last Version). (!) Results can be shared with older Blender versions by copying keyframes.
- 🌐 Internet Connection. One-time requirement for AI model download during setup.
- 💾 5 GB Free Space. for AI models and dependencies.
Known Limits
This addon was primarily developed and tested on Windows. While some compatibility issues may appear on other operating systems, results created on Windows can be shared and used across different platforms. Cross-platform improvements are in progress.
There’s currently a dedicated patch for Mac Silicon, along with a custom video guide to help you set it up. This is required due to certain compatibility and security restrictions specific to macOS on Apple Silicon.What does this addon do?
PAnim LipSync automatically creates lip-sync animations for your 3D characters in Blender using AI speech recognition. Simply load an audio file and the addon generates mouth movements that closely match the speech.
What are the system requirements?
Blender 4.1 to 4.5 (Current Last Version), 8GB+ RAM recommended, Up to ~5GB storage space for AI models (PRO Version).
Do I need an internet connection?
Only for the initial setup to download dependencies and AI models. After that, everything works offline locally on your computer.
What audio formats are supported?
WAV, MP3, OGG, FLAC, M4A, and AAC files are all supported.
What shape keys do I need on my character?
The addon needs these shape keys: Mouth_Shape_A/E/I/O/U/M/B/P/F/L.
What if my character doesn't have the standard shape keys?
If your character has no shape keys, the addon can auto-create them. If you have shape keys with different names, use the custom mapping feature to connect your existing shape keys to the standard phonemes.
Can I use it with rigged characters (bones)?
Yes! The addon supports both shape key animation and bone-based animation modes (using actions).
Can I animate multiple characters at once?
Yes, the batch processing mode lets you animate multiple characters with different audio clips simultaneously.
How long does processing take?
Depends on your hardware, model size, and audio length. First-time processing is slower as it loads the AI model, then subsequent processing is much faster. Times can range from seconds to minutes depending on your system.
Does it work with different languages?
Yes, it supports 20+ languages including English, Spanish, French, German, Chinese, Japanese, and many more.
The "Install Dependencies" button fails. What should I do?
A: Run Blender as Administrator, check your internet connection.
* "character_02" (https://skfb.ly/oysZF) by BuuMya is licensed under Creative Commons Attribution (Sketchfab).
* ""2D" mouth with shape keys phonemes" - By myname, From BlendSwap.com (BlendSwap)
* "Ellie - Character Rig" From Blender Studio (Character Link)
* "Victoria - Character Rig" From Blender Studio (Character Link) (Temporarily displayed in the video)
To allow characters to be used for demonstration of the tool.
- Important: The characters used in demonstrations and examples are not included with this addon. If you want to test with similar characters, you can download them from the sources listed in the "Thanks to" section above.