debezium-server-iceberg

KO | EN

gitlite — search

#python #ai #go #golang #machine-learning #rust #linux #macos #java #cli #awesome-list #security #ios #open-source

debezium-server-iceberg

(★ 327)

Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake

File Explorer

Download Latest Version (.zip)

- - build.yml
  - codeql-analysis.yml
  - deploy-documentation.yml
  - release.yml
  - stale.yml
- dependabot.yml
- clean,install.run.xml
- dependency_tree.run.xml
- IcebergChangeConsumerTest.run.xml
- IcebergChangeConsumerTest.testSimpleUpload.run.xml
- package.run.xml
- spotless_apply.run.xml
- spotless_check.run.xml
- Whole project.run.xml
- pom.xml
- README.md
- pom.xml
- - debezium-iceberg-architecture.drawio.png
  - debezium-iceberg.drawio
  - debezium-iceberg.png
  - rdbms-debezium-iceberg.png
  - rdbms-debezium-iceberg_white.png
- contributing.md
- faq.md
- iceberg.md
- icebergevents.md
- index.md
- migration.md
- python-runner.md
- - docker-compose.yaml
  - produce_data.py
- - docker-compose.yaml
  - produce_data.py
- README.md
- - __init__.py
  - __main__.py
- pyproject.toml
.dockerignore
.editorconfig
.git-blame-ignore-revs
.gitignore
deploy.sh
Dockerfile
LICENSE
mkdocs.yml
pom.xml
README.md

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

[![License](http://img.shields.io/:license-apache%202.0-brightgreen.svg)](http://www.apache.org/licenses/LICENSE-2.0.html)
![contributions welcome](https://img.shields.io/badge/contributions-welcome-brightgreen.svg?style=flat)
![Create Release](https://github.com/memiiso/debezium-server-iceberg/actions/workflows/release.yml/badge.svg)

# Debezium Iceberg Consumer

This project implements Debezium Server Iceberg consumer
see [Debezium Server](https://debezium.io/documentation/reference/operations/debezium-server.html). It enables real-time
replication of Change Data Capture (CDC) events from any database to Iceberg tables. Without requiring Spark, Kafka or
Streaming platform in between.

See the [Documentation Page](https://memiiso.github.io/debezium-server-iceberg/) for more details.

![Debezium Iceberg](https://raw.githubusercontent.com/memiiso/debezium-server-iceberg/master/docs/images/debezium-iceberg-architecture.drawio.png)

## Installation
- Requirements:
  - JDK 21
  - Maven
### Building from source code

```bash
git clone https://github.com/memiiso/debezium-server-iceberg.git
cd debezium-server-iceberg
mvn -Passembly -Dmaven.test.skip package
# unzip and run the application
unzip debezium-server-iceberg-dist/target/debezium-server-iceberg-dist*.zip -d appdist
cd appdist/debezium-server-iceberg
mv config/application.properties.example config/application.properties
bash run.sh
```

## Contributing

The Memiiso community welcomes anyone that wants to help out in any way, whether that includes reporting problems,
helping with documentation, or contributing code changes to fix bugs, add tests, or implement new features.
See [contributing document](docs/contributing.md) for details.

### Contributors

debezium-server-iceberg

File Explorer

Today's picks

Was this content helpful?

Recent Feedback

debezium-server-iceberg

File Explorer

Today's picks

Was this content helpful?

Recent Feedback

Download README