esq

KO | EN

gitlite — search

#python #java #python3 #arduino #golang #machine-learning #rust #html #flask #javascript #seismology #nodejs

★ 11 Open GitHub ↗

Event streaming queue

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# esq - event streaming queue
This implements the publish-subscribe pattern as a set of commands (esq-server, esq-tail, esq-write, esq-drop). A client application may directly access esq-server (esq-tail, esq-write, esq-drop are just that).

Topics are stored forever, using [lmdb](https://symas.com/lmdb/).

Async I/O is done through [libev](http://software.schmorp.de/pkg/libev.html).

## building
`$ make`

## run server
`$ ./esq-server`

## tail topic
`$ ./esq-tail topic_a`

`$ ./esq-tail -n -10 topic_a` (w/ last 10 events)

`$ ./esq-tail -n +0 topic_a` (from start)

## write event
`$ echo "hello" | ./esq-write topic_a`

## load newline-delimited data
`$ ./esq-write topic_a < data.ndjson`

## compose
`$ ./esq-tail topic_a | jq .foo | ./esq-write topic_b`

## drop topic
`$ ./esq-drop topic_b`

## tests
`$ make test`

## benchmark
`$ ./esq-bench`

## bundled external libraries
* [freebsd tailq](https://github.com/freebsd/freebsd-src/blob/master/contrib/sendmail/include/sm/tailq.h)
* [libev](http://software.schmorp.de/pkg/libev.html)
* [lmdb](https://symas.com/lmdb/)
* [lz4](http://lz4.github.io/lz4/)
* [tinycthread](https://github.com/tinycthread/tinycthread)
* [munit](https://github.com/nemequ/munit) for tests

## TODO
* code cleanup
* client library
* esq-drop

esq

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README