KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#developer-tools #typescript #dsh #dsh-plugin #ai-agent #codex #ai-agents #deepseek-harness #claude-code #cli #react #mcp

posenet-sketchbook

★ 217 Open GitHub ↗

PoseNet Sketchbook is a collection of open source, interactive web experiments designed to allude to the artistic possibilities of using PoseNet (running on tensorflow.js) to create a relationship between movement and machine.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

<table>
  <tr>
    <td>
      This project is no longer actively maintained by the Google Creative Lab but remains here in a read-only Archive mode so that it can continue to assist developers that may find the examples helpful. We aren’t able to address all pull requests or bug reports but outstanding issues will remain in read-only mode for reference purposes. Also, please note that some of the dependencies may not be up to date and there hasn’t been any QA done in a while so your mileage may vary.
      <br><br>
      For more details on how Archiving affects Github repositories see <a href="https://docs.github.com/en/github/creating-cloning-and-archiving-repositories/about-archiving-repositories">this documentation </a>.
      <br><br>
      <b>We welcome users to fork this repository</b> should there be more useful, community-driven efforts that can help continue what this project began.
    </td>
  </tr>
</table>

#### PoseNet Sketchbook is a collection of open source, interactive web experiments designed to allude to the artistic possibilities of using PoseNet (running on tensorflow.js) to create a relationship between movement and machine.

[Try out the live demos](https://googlecreativelab.github.io/posenet-sketchbook/).

These prototypes exemplify a wide range of interactions that PoseNet can enable. Together, they make up a raw starter kit that is built to be used by dancers and developers alike.

This is not a library or code repository that intends to evolve. Instead, it is an archive of where [Body, Movement, Language](https://experiments.withgoogle.com/billtjonesai) first began. You can use this collection of code as a starting point to create your own wacky or wild or just plain useful PoseNet experiments.

To read more about the journey from PoseNet Sketchbook to Body, Movement, Language in the blog post [here](https://medium.com/@mayaman/mixing-movement-and-machine-848095ea5596).

## Install and Run

First, clone or download this repository. For more information on how to do this, check out [this article](https://help.github.com/en/articles/cloning-a-repository).

Next, Make sure you are in the project folder:
All of the commands below should be run from your terminal on your machine.

```sh
cd posenet-sketches
```

Install dependencies:

```sh
yarn
```

To watch files for changes, and launch a dev server:

```sh
yarn watch
```

The server should be running at **localhost:1234**.

### File structure
All sketches use PoseDetection.js, a wrapper class I created to handle the PoseNet data.

Each individual sketch is hosted in the 'sketches' folder.
- index.html: 
- style.css: Styling for the sketch.
- assets/: The thumbnail, gif, and any additional assets used in the sketch.
- js/: The soure files.
    - main.js: Set up the camera, load the video, and initialize Pose Detection and the sketch.
    - sketch.js: This is where the ~ magic ~ happens. Some functions to note:
        - setup: Initializes the the canvas width and height.
        - initSketchGui: Sets up the GUI elements that will affect the sketch and adds them to the GUI structure.
        - draw: Looping at 60 fps. Renders and updates elements on canvas with each call.

## The Sketches
### Basic
*How does PoseNet interpret your pose?*

#### Movement Multiplier
*How might we allow past motion to linger?*

#### Text Trailer
*How might movement history affect text on screen?*

#### Shape Shifter
*How might movement be translated and abstracted into new forms?*

#### Collage Creator
*How might a variety of elements collage to recreate a figure on screen?*

#### Body Transcriber
*How might spoken words manifest on screen in relation to the body?*

#### Color Mapper
*How might body poisition be used as a controller?*

#### Image Mapper
*How might body position surface and highlight content?*

#### Audio Controller
*How might body position manipulate an audio experience?*

## Contributors
Built by [Maya Man](https://github.com/mayaman) at the Google Creative Lab.

## Notes
This is not an official Google product.

We encourage open sourcing projects as a way of learning from each other. Please respect our and other creators’ rights, including copyright and trademark rights when present when sharing these works and creating derivative work. If you want more info on Google's policy, you can find it [here](https://www.google.com/permissions/). To contribute to the project, please refer to the [contributing](CONTRIBUTING.md) document in this repository.

posenet-sketchbook

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README