edgerunner

KO | EN

gitlite — search

#hacktoberfest #react #typescript #golang #go #rust #linux #docker #nodejs #awesome #cli #kubernetes #security #open-source

(★ 76)

Simplified AI runtime integration for mobile app development

edgerunner 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

<h1 align="center">
    <a href="https://runlocal.ai">
        <img src="./images/large-logo.png" width="300">
    </a>
    <br><br>
    Edgerunner
</h1>

<h4 align="center">
    Simplified AI runtime integration for mobile app development
</h4>

<div align="center">
    <a href="https://runlocal.ai">Website</a> |
    <a href="https://runlocal.ai#contact">Contact</a> |
    <a href="https://discord.gg/y9EzZEkwbR">Discord</a> |
    <a href="https://x.com/Neuralize_AI">Twitter</a> |
    <a href="https://neuralize-ai.github.io/edgerunner">Docs</a>
    <br><br>
    <img src="https://github.com/neuralize-ai/edgerunner/actions/workflows/ci.yml/badge.svg"/>
    <a href="https://codecov.io/gh/neuralize-ai/edgerunner" >
        <img src="https://codecov.io/gh/neuralize-ai/edgerunner/graph/badge.svg?token=W05G243LIK"/>
    </a>
</div>

## 💡 Introduction

The purpose of Edgerunner is to facilitate easy integration of
common AI model formats and inference runtimes
([TFLite](https://ai.google.dev/edge/lite), [ONNX](https://github.com/onnx/onnx),
[QNN](https://www.qualcomm.com/developer/software/qualcomm-ai-engine-direct-sdk),
etc.) for
consumer mobile devices (smartphones, laptops, tablets, wearables, etc.).

Edgerunner removes the complexities of deploying an off-the-shelf model into
your app, with NPU acceleration, regardless of the model format or target devices.
Platform-specific NPU SDKs are managed for you and can be leveraged with a
device-agnostic API. Edgerunner exposes a boilerplate-free API with sane defaults.

Kotlin bindings to create AI applications in Android with Edgerunner can
be found at
[edgerunner-android](https://github.com/neuralize-ai/edgerunner-android). We are
also creating specific use cases built upon Edgerunner (Llama, Stable
diffusion, etc.) which will come with their own Android bindings.

Please request additional features or desired use cases through Github issues or
on our [Discord](https://discord.gg/y9EzZEkwbR).

## 🔌 Support

### OS

|  Android |  iOS  | Linux |  MacOS  | Windows |
|:--------:|:-----:|:-----:|:-------:|:-------:|
|    ✅    |   ⏳  |   ✅  |    ⏳   |   ⏳    |

### NPU

| Apple  | Qualcomm | MediaTek | Samsung | Intel | AMD |
|:------:|:--------:|:--------:|:-------:|:-----:|:---:|
|   ⏳   |    ✅    |    ⏳    |   ⏳    |  ⏳   | ⏳  |

## 🛠 Building and installing

Edgerunner is in its early development stages. Refer to the
[HACKING](/HACKING.md) document to get setup.

## 🕹 Usage

Edgerunner is designed around the following usage pattern;

```cpp
#include <edgerunner/edgerunner.hpp>
#include <edgerunner/model.hpp>

auto model = edge::createModel("/path/to/model");

model.applyDelegate(DELEGATE::NPU);

auto input = model.getInput(0).getTensorAs<float>();

/* overwrite input data */

model.execute();

auto output = model.getInput(0).getTensorAs<float>();

/* interpret output data */
```

See [examples](example/README.md) for more detailed usage.

See [model.hpp](/include/edgerunner/model.hpp) and
[tensor.hpp](/include/edgerunner/tensor.hpp) for complete API.

## 🏆 Contributing

See the [CONTRIBUTING](CONTRIBUTING.md) document.

Join our [Discord](https://discord.gg/y9EzZEkwbR) for discussing any issues.

## 📜 Licensing

See the [LICENSING](LICENSE.txt) document.

edgerunner

edgerunner 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

edgerunner

edgerunner 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README