LectorLips

KO | EN

gitlite — search

#python #typescript #llm #android #machine-learning #deep-learning #linux #docker #macos #cli #openai #ios #mcp #open-source

(★ 11)

A cool script that converts Adobe Character Animator mouth animation into Blockbuster mod Sequencer Morph NBT data.

LectorLips Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

![LectorLipsWhite-2](https://github.com/Chryfi/LectorLips/assets/71967555/68e6df4f-682b-4c06-97eb-16150c311566)
 
A cool script that allows to convert Adobe Characte Animator mouth animation data into a sequencer morph for the Minecraft Blockbuster Mod.
 
# Now available with a UI [https://lectorlips.com/](https://lectorlips.com/)

## Setup
First you need to install Python, for example, via Microsoft Store. You probably need to restart your computer after installing it. Test ouf if the command `python` works in the CMD. It should look something like this:

![Screenshot_658](https://user-images.githubusercontent.com/71967555/206724791-961cb012-f198-4d24-b31d-5acb22da707b.png)

Now you need to tell the script how your mouth textures are named like and which Character Animator mouth they belong to. The image [visemeMapping.jpg](./visemeMapping.jpg) shows the mouth shapes used by Adobe Character Animator. The numbers indicate the order in which you have to define your image file names.

Type `cmd` into the file explorer in the LectorLips folder like this to open the CMD in that folder:

![Screenshot_659](https://user-images.githubusercontent.com/71967555/206726526-122a93c3-4212-41e6-927b-7faf01becd76.png)

Now you need to enter the command to setup the names of your mouth textures.
```
python __init__.py -create_viseme_mapping 0.png 1.png 2.png 3.png 4.png 5.png 6.png 7.png 8.png 9.png 10.png 11.png 12.png 13.png 14.png
```
You can name those image files however you want.
 
## Adobe Character Animator
First import your audio file. If you have the transcript of the audio, you can use it to increase the accuracy of the mouth animation. Therefore paste your transcript into the transcript text box in the properties context.![transcript](https://user-images.githubusercontent.com/71967555/207728582-b28859d4-70ac-4269-a2f3-ec6d6a8942f5.png)

Now you need to generate the mouth animation. For this go to `Timeline -> Compute Lip Sync Take from Audio and Transcript` as seen in the image. If you didn't enter a transcript, choose the option without the transcript.

![generatemouthanimation](https://user-images.githubusercontent.com/71967555/207729241-3f082bfd-d09f-4df8-ba54-9e3e4213312e.png)
 
## Convert Character Animator mouth animation into sequencer morph
To convert your mouth animation, you first need to convert it into After Effects Visemes. To do this, right click on your audio and click `Copy Visemes for After Effects`.

![copyvisemes](https://user-images.githubusercontent.com/71967555/207731794-44059f09-9e81-441c-829c-5f5464af86e8.png)

Now you need to paste the copied data into a .txt file. It's simplest if you just create the .txt file in the LectorLips folder.

Then you can execute the command to convert the pasted keyframes into a sequencer morph:
```
python __init__.py -create_sequencer full/path/to/AfterEffects_keyframes.txt "b.a:path/to/blockbuster/mouth/textures/"
```

With the argument `full/path/to/AfterEffects_keyframes.txt` you define the path to the file where you copied the keyframe data to. If you created the .txt file in the LectorLips folder, you can just enter the name of your file.

With `"b.a:path/to/blockbuster/mouth/textures/"` you define the texture path that should be used in the Blockbuster mod (this does not include the full system path, only the path inside the models folder). The texture files in that folder need to have the same names as the ones you defined in your setup. Your mouth textures need to be in a folder under `../config/blockbuster/models/`. Example: Your textures are in the folder `../config/blockbuster/models/mouth_steve/` then your blockbuster path needs to be `"b.a:mouth_steve"`.

The command will create a .txt file with the current date as name, where it writes the generated sequencer morph NBT data into.

You need to copy all of the NBT data and paste it into a user category of the morph menu like this: 
![Screenshot_11](https://user-images.githubusercontent.com/71967555/214431313-d3f498b2-343f-4180-8fb8-e71dad6940af.png)

That's it!
 
## List of commands

`-help`

```
-create_sequencer
arguments: <path to After Effects keyframe.txt> <Blockbuster path to the mouth textures folder>
optional: <duration of the last mouth in ticks> <different viseme_mapping_filename>
```

```
-create_viseme_mapping
arguments: <15 image file names according to visemeMapping.jpg>
optional: <new viseme_mapping filename>
```

LectorLips

LectorLips Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

LectorLips

LectorLips Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README