unity-2dmocap

KO | EN

gitlite — search

#python #java #python3 #arduino #golang #machine-learning #rust #html #flask #javascript #seismology #nodejs

★ 11 Open GitHub ↗

Python application for Unity Asset of 2D motion capture

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

2D Motion Capture for Unity
-------

[![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](https://opensource.org/licenses/MIT)
[![PyPI version](https://badge.fury.io/py/unity-2dmocap.svg)](https://badge.fury.io/py/unity-2dmocap)

**2D Motion Capture for Unity** is a python application designed to be a complement of the Unity asset, 2D Motion Capture.
This asset enables an easy construction of 2D sprite animations in Unity by a completely device-less motion capture technique,
and this application plays a role in analyzing a video file to capture the posture of a human in the video. The extraction of the 
posture from the human image is implemented using [OpenCV](https://opencv.org/) and [torchvision](https://pytorch.org/docs/stable/torchvision/index.html).
With this application, you can easily build a sophisticated animation clip for 
your Unity project without any need of special equipments, and once the animation is
generated, you can freely modify the clips the same way you deal with generic Unity animation.

### Features
* Commandline tool for video analysis and a direct connection to Unity Project
* Simple video editor used for preparation of source video
* Extracts human posture using a deep learning model of keypoint RCNN in torchvision
* Exports posture information to a json file
* Generates Unity animation clip on the editor environment
* Easy save & load system for the sprite rigging on Unity

### Installation
```{commandline}
$ pip install unity-2dmocap
```
To update the application to the latest version, you can run:
```{commandline}
$ pip install --upgrade unity-2dmocap
```
To check if the application is installed properly, you can try the following:
```{commandline}
$ python
```
```{python}
>>> import mocap2d
>>> mocap2d.__version__
```
If it prints out something without an error, the application is installed properly.

### Unity Asset

To use this package, you need a 2D Motion Capture asset, which is a counterpart of 
this package. You can download the package below.

[2d_motion_capture.unitypackage](./2d_motion_capture.unitypackage)

### Usage

Once you have installed the package, you can use the features through a commandline.

```{commandline}
$ 2dmocap-unity [-h] { detect, send } -f FILE [-g] [-i INTERVAL] [-s] [-o OUT]
```
The commands you can use are "detect" and "send". "detect" will analyze the video file
and connect to the Unity project. "send" will read the pre-generated json file
to the Unity Project without an analysis.

If you are using "detect", the arguments are:
* -h, --help: show the help message
* -f FILE, --file FILE: a path to the video file that you want to analyze
* -g, --gpu: with this argument, the program will run on the gpu instance for a faster analysis
* -i INTERVAL, --interval INTERVAL: a target interval between animation keyframes in seconds
* -s, --show: with this argument, the program will show the resulting skeleton during the analysis
* -o OUT, -output OUT: a directory in which you will save result.json file for the later use

If you are using "send", the arguments are:
* -f FILE, --file FILE: a path to the json file you want to send

### QuickStart

Suppose you want to analyze the video file named "ballet.mp4," and you want to quickly 
analyze it using the gpu of your machine. In addition, you want to have 0.2 seconds of intervals 
between keyframes. Then, the following command will start the program.

```{commandline}
$ 2dmocap-unity detect --file=ballet.mp4 --gpu --interval=0.2 
```

Once you type the command, the program will initiate the analysis as follows.

You can wait until the analysis is over, and if you used the argument -s or --show, 
an external window will show up to show the progress of analysis by drawing a skeleton 
on the original image. After the analysis is complete, the program will address you to connect to 
the Unity project.

To connect to your Unity project, open your project on the Unity editor. If you have have 
successfully imported the "2D Motion Capture" asset, the menu will appear on 
Window/2D Motion Capture.

If you click on the menu, the following editor window will show up.

As addressed by the program, if you click on "Connect to the Detector" button, the unity will
connect with your python session and receive information about the result of the analysis. Then, 
the window will let you preview the generated animation. If you click on the button "Save Animation Clip", 
the generated animation clip will be saved to the directory you specify.

Once the animation is generated, you can edit the clip just the same way you
 edit generic unity animation clips.
 
### Community and Feedback

2D Motion Capture for Unity is an open-source project and we encourage and welcome contribution. 
We are waiting for the active participation of game developers, animation artists, and the fans of machine learning technology, so 
if you wish to contribute, please feel free to send pull requests or report issues.

For any further feedback or bug report, please you github's issue template or make a review 
on the Asset Store page.

Your participation matters a great deal to us.

unity-2dmocap

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README