Animation clip generator

The animation clip generator is a tool that, thanks to the Kimodo model, can generate animation clips from a text prompt.

Requirements

Windows:

Nvidia GPU 16GB or more VRAM

Linux:

Nvidia GPU with 17GB or more VRAM

Kimodo uses the Meta-Llama-3-8B-Instruct model that requires 16GB of VRAM. Is it possible to run the model on a separate machine and run the kimodo_textencoder service. In this way, it is possible to generate animation clips also on a machine with less than 16GB of VRAM. Check the Kimodo documentation for more information: Quick Start — Kimodo

Installations

Atoms uses the Kimodo model to generate animation clips.

To install it, please follow the instructions here: Installation — Kimodo

You can install directly in the system-wide Python folder or in a conda environment. By default, the clip generation looks at the system Python folder or the conda “kimodo” environment. If you are using a different conda environment name, please set the env variable ATOMS_CONDA_KIMODO_ENV. If conda is not inside the PATH environment, please set the environment variable ATOMS_CONDA_PATH with the full path to the conda executable.

If you are using AtomsHoudini on Linux, you need to create a conda wrapper shell script like this:

#!/usr/bin/env bash
unset PYTHONPATH
unset PYTHONHOME
exec conda "$@"

Then set the ATOMS_CONDA_PATH env to point to this script. If you don’t use the wrapper script, conda will use the PYTHONPATH and PYTHONHOME set by Houdini instead of the system envs, returning some import errors.

Generate an animation clip

Open the AtomsUI
Switch to the Animation tab.
Press the Generate clip button. It will open the clip generator dialog.
Insert in the prompt section the description of the motion that you want to create.
You can set the clip's duration and the number of variations.
Set the output path.
Press the “Generate clip” button. On an average machine, it takes about 1.5 minutes to generate 1 second of animation.

The animation generated by Kimodo uses the SOMA skeleton. Make sure the “soma” agent type is set in the AtomsUI. If you are using a scene created before Atoms 7.3.0 you can find the soma skeleton, characterization and skin file inside the $ATOMS_DATA folder. If you want to use the animation on your skeleton remember to set a valid characterization on your agent type.

Properties

Prompt: Description of the motion.
Duration: Duration of the animation clip.
Variations: Number of clips/variations.
Seed: seed used to generate the clip.
Num transition frames: number of frames used to blend from one action to another if the prompt contains multiple actions.
Output path: output path of the bvh file generated.