turnilo - GitLite

KO | EN

gitlite — search

#python #ai #typescript #llm #go #machine-learning #docker #macos #awesome #cli #kubernetes #security #ios #open-source

turnilo

(★ 769)

Business intelligence, data exploration and visualization web application for Druid, formerly known as Swiv and Pivot

File Explorer

Download Latest Version (.zip)

- - ci.yml
  - deploy.yml
  - release-beta.yml
  - release-final.yml
  - reports.yml
  - undeploy.yml
- dependabot.yml
- - 2019-weather.json
  - lax-flights.csv
  - owid-covid-data-2021-01-29.json
  - palmer-penguins.csv
  - rio2016-athletes.csv
  - unemployment-2016-02-18.csv
  - wikiticker-2015-09-12.json
- - android-chrome-192x192.png
  - android-chrome-512x512.png
  - apple-touch-icon.png
  - browserconfig.xml
  - favicon-16x16.png
  - favicon-32x32.png
  - favicon.ico
  - mstile-144x144.png
  - mstile-150x150.png
  - mstile-310x150.png
  - mstile-310x310.png
  - mstile-70x70.png
  - safari-pinned-tab.svg
  - site.webmanifest
- turnilo
- webpack.common.js
- webpack.dev.js
- webpack.prod.js
- - bar-chart.cy.ts
  - boolean-filter-menu.cy.ts
  - csv-data-source.cy.ts
  - fixed-time-filter-menu.cy.ts
  - grid.cy.ts
  - home-page.cy.ts
  - legend.cy.ts
  - line-chart.cy.ts
  - mkurl.cy.ts
  - pinboard.cy.ts
  - relative-time-filter-menu.cy.ts
  - scatterplot.cy.ts
  - split-tile.cy.ts
  - string-split-menu.cy.ts
  - table.cy.ts
  - totals.cy.ts
- - example.json
- - index.js
- - commands.js
  - e2e.js
- index.d.ts
- tsconfig.json
- - toc.html
- - page.html
- _config.yml
- configuration-cluster.md
- configuration-customizations.md
- configuration-datacubes.md
- extending-turnilo.md
- Gemfile
- Gemfile.lock
- generating-links.md
- health-checking.md
- index.md
- oauth.md
- release-management.md
- security.md
- webperf.md
- - drag-drop-polyfill.css
  - drag-drop-polyfill.min.js
- - _open-sans.scss
  - _reset.scss
  - _sanity.scss
- - README.md
  - turnilo-logo.svg
- - _imports.scss
  - drag-and-drop-polyfill.ts
  - index.d.ts
  - main.scss
  - main.tsx
  - polyfills.ts
  - tsconfig.json
- - tsconfig.json
- - app.ts
  - cli.ts
  - tsconfig.json
  - version.ts
  - views.ts
- - mocha.js
.dockerignore
.gitignore
.npmignore
.npmrc
.npmrc-publish
.release-it.json
.sass-lint.yml
babel.config.js
CODEOWNERS
config-examples.yaml
CONTRIBUTING.md
cypress.config.ts
Dockerfile
LICENSE
lighthouserc.js
NOTICE
package-lock.json
package.json
README.md
tsconfig.json
tslint.json

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Turnilo

[![npm version](https://img.shields.io/npm/v/turnilo.svg)](https://www.npmjs.org/package/turnilo)
[![build status](https://github.com/allegro/turnilo/workflows/Build/badge.svg)](https://github.com/allegro/turnilo/actions)
[![Join our Slack chat](https://img.shields.io/badge/slack-chat-purple.svg?logo=slack)](https://join.slack.com/t/turnilo/shared_invite/enQtOTI4ODcxMjcyNjU2LTFlOTk5YWZlOGMyZDZhZWU3MGNjNDRhZmI1Y2UzNDlkZmY3YzYxYTJhYzIzMzc0MTc3MzA3OTE1NmQ5NDI1M2I)

> [!WARNING]
> **This project is archived and no longer maintained.**
>
> Allegro no longer uses Turnilo internally and is stepping back from its development.
> The repository is now read-only: there will be no further releases, bug fixes, or support,
> and issues and pull requests are no longer being reviewed or merged.
>
> Thank you to everyone who contributed code, reported issues, shared ideas, and used Turnilo
> over the years. This project would not have been what it is without you.

Turnilo is a business intelligence, data exploration and visualization web application for [Apache Druid](https://druid.apache.org).
Turnilo is a fork of [Pivot](https://github.com/implydata/pivot) which is currently available under commercial licence only.
This repository was forked from the stalled repository [Swiv](https://github.com/yahoo/swiv)
with the latest version of Pivot under Apache license.

## Motivation

[Druid](https://github.com/druid-io/druid) is heavily used as business intelligence platform at [Allegro](https://allegro.tech/).
In order to gain wide adoption of non-technical users, Druid requires simple yet powerful user interface.
In Allegro we have decided that we are going to continue Pivot development as an open source software,
this is how Turnilo emerged.

## Manifesto

* High usability for non-technical users over sophisticated but rarely used features.
* Focus on interactive data exploration over static predefined dashboards.
* Self-describing reports for users without deep domain expertise.
* Outstanding integration with Druid over support for other data sources like SQL databases.
* Focus on data visualizations over Druid cluster or data ingestion management.
* Data cubes configuration as a code over UI editor backed by non-versioned database.
* Stateless over stateful server-side architecture.
* Support for most recent versions of standards compliant browsers.

## Features

* Intuitive, drag and drop, gorgeous user interface to visualize Druid datasets.
* Fully dedicated to low latency Druid
[Timeseries](https://druid.apache.org/docs/latest/querying/timeseriesquery.html),
[TopN](https://druid.apache.org/docs/latest/querying/topnquery.html) and
[GroupBy](https://druid.apache.org/docs/latest/querying/groupbyquery.html) queries.
* Unified view for historical and real-time data.
* Blazingly fast.

![Turnilo UI](https://github.com/allegro/turnilo/raw/master/docs/assets/images/showcase.gif)

## Try it

You can try an online demo with example datasets (Covid-19 and Wikipedia) at [https://turnilo.app](https://turnilo.app).

## Join us

Feel free to ask on [GitHub Discussions](https://github.com/allegro/turnilo/discussions)
or join the chat on [Slack](https://join.slack.com/t/turnilo/shared_invite/enQtOTI4ODcxMjcyNjU2LTFlOTk5YWZlOGMyZDZhZWU3MGNjNDRhZmI1Y2UzNDlkZmY3YzYxYTJhYzIzMzc0MTc3MzA3OTE1NmQ5NDI1M2I).

## Pre-requisites

* [Node.js](https://nodejs.org/) - 14.x or 16.x version

:warning:
Do not use `yarn` command for dependency management and project build, use `npm` instead.
With `npm` builds are reproducible (thanks to package-lock.json) and even faster than with `yarn`.

## Usage

Install Turnilo distribution using [npm](https://www.npmjs.com/).

```
npm install -g turnilo
```

Start off by running Turnilo with example datasets
and open [http://localhost:9090/](http://localhost:9090/).

```
turnilo run-examples
```

Use `connect-druid` command to connect to the existing Druid broker.
Turnilo will automatically introspect your Druid broker and figure out available datasets.

```
turnilo connect-druid http[s]://druid-broker-hostname[:port]
```

## Documentation

Learn how to configure and customize Turnilo:
[https://allegro.github.io/turnilo/](https://allegro.github.io/turnilo/)

## Development

### Install project dependencies

```
npm install
```

### Build the project

```
npm run build
```

### Run project

Run example datasets.

```
npm run start:examples
```

Connect to the existing Druid broker.

```
npm run start -- connect-druid http[s]://druid-broker-hostname[:port]
```

Connect to the existing Druid broker using your config file.

```
npm run start -- run-config path/to/config.yml
```

### Run project in developer mode

Every change in frontend code would recompile project and reload page.

Run example datasets.

```
npm run start:dev:examples
```

Connect to the existing Druid broker.

```
npm run start:dev -- connect-druid http[s]://druid-broker-hostname[:port]
```

Connect to the existing Druid broker using your config file.

```
npm run start:dev -- run-config path/to/config.yml
```

## Testing

### Unit tests

Run all unit tests.

```
npm run test
```

Or run tests separately for common, client and server modules.

```
npm run test:common
npm run test:client
npm run test:server
```

### End to end tests

Run all e2e tests. It will start Turnilo with example datasets in background.

```
npm run e2e
```

### End to end tests development

Run server

```
npm start:dev:examples
```

Run cypress interactive tools for e2e testing

```
npm run e2e:dev
```

## Debugging

### Server module

In WebStorm\IntelliJ open "Run/Debug Configurations", click "Add New Configuration".
Next choose "Node.JS", set "JavaScript file" to "./bin/turnilo"
and "Application parameters" to "--examples".

You can find more infrmation [here](https://www.jetbrains.com/help/webstorm/running-and-debugging-node-js.html)

## Generating documentation locally

### Prerequisites

* [Ruby](https://www.ruby-lang.org/en/documentation/installation/)
* [Bundler](https://bundler.io)

Go to the docs folder and:

1. Install `bundle install` or `update bundle` update dependencies
2. Run `bundle exec jekyll serve --livereload`
3. Open [http://localhost:4000/](http://localhost:4000/)

## License

**Turnilo** is published under [Apache License 2.0](http://www.apache.org/licenses/LICENSE-2.0).