KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#dsh #dsh-plugin #ai-agent #developer-tools #codex #typescript #cli #deepseek-harness #claude-code #ai-agents #mcp #rust

caffe2_bhtsne

★ 39 Open GitHub ↗

This is a demo project that shows how you can utilize Caffe2's modular design and build a library on top of it.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Caffe2 TSNE example

## What's this?

[Caffe2](https://github.com/caffe2/caffe2) is an open-source deep learning library that is designed to be modular in nature. For many deep learning libraries, especially those earlier ones such as [Caffe](https://github.com/BVLC/caffe), one either only sticks with only the operators provided by the framework, or has to do non-trivial modifications to the codebase in order to compile custom implementation into the library.

This repository gives an example on how you can develop your custom operators and functionalities independent from the main Caffe2 codebase, and "plug-in" these into Caffe2 by dynamically loading your operators. The benefits are that

- You can maintain your own library at your own pace.
- You have a better control over the codebase.
- It becomes easier to share code instead of having to merge and constantly upstream changes from the main Caffe2 library.

## How should I use this?

Imagine you are developing a new deep learning algorithm, and in your method you have some new layers / operators that existing frameworks do not cover. At the same time, you still want to take advantage of the existing framework functionalities. What you can do is to write them as standard Caffe2 operators, build your code as a shared library, and then load it either from C++ or Python.

We will demonstrate the mechanism using a popular software package, T-SNE, and show how one can create a Caffe2 operator that produces T-SNE embeddings from an input Tensor, living under the Caffe2 runtime.

## Getting started

To build the library, install the most recent version of Caffe2. Then, follow the standard cmake installation protocol. Usually what people do with cmake is like `mkdir build && cd build && cmake .. && make`.

To run the ipython notebook, simply do `ipython notebook` in the root folder of this repository. If your Caffe2 install is not in the default python path, you might need to add `PYTHONPATH=/path/to/your/caffe2/install` before the ipython command. You will also need to download the MNIST dataset [here](http://yann.lecun.com/exdb/mnist/).

caffe2_bhtsne

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README