kappa-streaming

KO | EN

gitlite — search

#javascript #typescript #golang #go #android #deep-learning #linux #docker #macos #nodejs #java #awesome-list #security #open-source

kappa-streaming

(★ 8)

Implementation of Kappa Architecture, using Vert.x reactive libraries and Apache Flink to process large file using stream and Kafka immutable append log. Data is stored finally in Cassandra DB.

kappa-streaming 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# kappa-streaming

Kappa Architecture streaming project, that is based on a immutable log appender model. This project provides an implementation of streaming a very large file using vert.x client to a vert.x server. Parsing data on server and sending the records to Kafka Queue.

Then records are read by Kafka queue and processed by Apache Flink framework.

It is a maven multi-module project. It contains following modules

*  vertx-reactive-client - reads a very large file and streams it to server
*  vertx-reactive-server - non-blocking server, that reads stream of data from client, parses data and sends it to Kafka queue.
*  flink-kafka-processor - uses streaming data processing framework Apache Flink to read data from Kafka and in this project it uses Cassandra DB to store the processed data.
** This project also uses Spring Data Cassandra APIs for CRUD operations to Cassandra DB.

###To Run a Docker Cassandra DB image
`$ docker run --name cassandraapp -p 0.0.0.0:9042:9042  -d cassandra:2.2.5`

We are using cassandra 2.x version because Spring data APIs currently support Cassandra DB 2.x version.

###Licence

Read [Licence](https://github.com/tuhingupta/kappa-streaming/blob/master/license.md) information.

kappa-streaming

kappa-streaming 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

kappa-streaming

kappa-streaming 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README