human-bjs-vrm

KO | EN

gitlite — search

#javascript #ai #golang #machine-learning #deep-learning #linux #nodejs #macos #java #awesome #kubernetes #vue #pytorch #openai

(★ 14)

Realtime VRM Humanoid Avatar Animation using Human Library and BabylonJS

human-bjs-vrm 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Human: 3D Detection to VRM Avatar

WIP!!!

- Input  
  **Video file**  
  **Live webcam**  
- Analyze and track all keypoints in a *web worker* thread  
  Using [**Human**](https://github.com/vladmandic/human) library  
  **Face**, **Body**, **Hands**
- Display  
  **Video Overlay** with keypoints  
  **VRM Avatar** with *pan/zoom/rotate* functionality

<br>

## Run

<br>

### Online

> [**Live Demo**](https://vladmandic.github.io/human-bjs-vrm/src/index.html)

### Offline

- Clone or fork the repository
- Install dependencies: `npm install`
- Start HTTPS server using precompiled code: `npm start`
- Navigate to <https://localhost:8001>

### Development Mode

- Clone or fork the repository
- Compile code on-demand & start HTTPS server: `npm run dev`
- Navigate to <https://localhost:8001>

## Notes

- All heavy-lifting (machine learning processing) is performed using [**Human**](https://github.com/vladmandic/human) library  
- **2D** visualization is performed using built-in draw methods in `Human` library  
- **3D** visualization is performed using [BabylonJS](https://www.babylonjs.com/)

## Processing

Process flow is separated into two loops:
- **Process loop**  
  Runs in web-worker so its not blocking the main thread  
  Supports `WASM`, `WebGL` and `WebGPU` backends  
  Runs as fast as possible: frame is submited to worker and as soon as results are available a new frame is submitted  
- **Render loop**  
  Runs at fixed 60 FPS  
  Draws both **2D** canvas overlay and **3D** GL mesh  
  Uses intepolated (for smoother output) results based on last known processed results from process loop

human-bjs-vrm

human-bjs-vrm 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

human-bjs-vrm

human-bjs-vrm 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README