FluxBench.jl

KO | EN

gitlite — search

#python #java #python3 #arduino #golang #machine-learning #rust #html #flask #javascript #seismology #nodejs

★ 15 Open GitHub ↗

Benchmarks for the FluxML ecosystem for deep learning, scientific machine learning, differentiable programming etc including AD and CUDA accelerated workloads

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# FluxBench.jl

[![][buildkite-img]][buildkite-url] [![bench-img]][bench-url]

[buildkite-img]: https://badge.buildkite.com/560460043f33dc6a23b4bc7379e7dd120a2dc10b350d7021ca.svg
[buildkite-url]: https://buildkite.com/julialang/fluxbench-dot-jl

[bench-img]: https://img.shields.io/badge/Benchmarks-speed.fluxml.ai-blue
[bench-url]: https://speed.fluxml.ai

This is a repository that backs the results generated for https://speed.fluxml.ai

It is a collection of benchmarking runs for a subset of modeling done in the FluxML ecosystem and also serves as a means of tracking progress.

### Running Locally

To run the benchmarks locally:

* clone this repository
* `cd` in to the local copy via `cd FluxBench.jl`
* open Julia and call `] instantiate`

And finally:

```julia
julia> using FluxBench

julia> FluxBench.bench()
```

## Adding Benchmarks

To contribute benchmarks one needs to:
* add in the script(s) to the `src/packages` directory with the required dependencies and code needed to run the benchmarks
  - Note: remember to add a `group` to the `SUITE` variable via the `addgroup!(SUITE, "name/of/benchmark/group")`
  - Treat `group` as a dictionary and new benchmarks can be added via assigning results to group as: `group["name_of_benchmark"] = @benchmarkable ...`
  - Please use the macro `@benchmarkable` to set up the benchmarks (see BenchmarkTools.jl for a reference)
  - Please follow the performance, profiling and benchmarking guides of the different packages used in the benchmark. Examples include - [Julia's](https://docs.julialang.org/en/v1/manual/performance-tips/), [Flux's](https://fluxml.ai/Flux.jl/stable/performance/), [CUDA's](https://cuda.juliagpu.org/stable/development/profiling/), [BenchmarkTools](https://juliaci.github.io/BenchmarkTools.jl/stable/manual/)
* include the benchmarks in the top level file `src/FluxBench.jl`
* call the benchmarks in the `bench` function located in file `src/bench.jl`

FluxBench.jl

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README