go-pq-cdc
go-pq-cdc is lightweight and efficient Change Data Capture (CDC) system designed for PostgreSQL
File Explorer
Download Latest Version (.zip)- bug_report.md
- feature_request.md
- build.yml
- integration_test.yml
- release.yml
- scorecard.yml
- dependabot.yml
- Dockerfile
- go.mod
- go.sum
- main.go
- benchmark.json
- dashboard.json
- pg_monitoring.json
- dashboard.yml
- datasource.yml
- grafana.ini
- init.sql
- 10m_test.png
- dashboard.png
- docker-compose.yml
- prometheus.yml
- README.md
- Dockerfile
- go.mod
- go.sum
- main.go
- benchmark.json
- container-resources.json
- dashboard.json
- pg_monitoring.json
- dashboard.yml
- datasource.yml
- grafana.ini
- init.sql
- 10m_1x.png
- 10m_3x.png
- docker-compose.yml
- prometheus.yml
- README.md
- SCALING_GUIDE.md
- config.go
- config_test.go
- read.go
- PROTO_VERSION_SUPPORT.md
- SNAPSHOT_FEATURE.md
- docker-compose.yml
- init.sql
- main.go
- docker-compose.yml
- go.mod
- go.sum
- main.go
- docker-compose.yml
- init.sql
- main.go
- docker-compose.yml
- init.sql
- main.go
- docker-compose.yml
- init.sql
- main.go
- docker-compose.yml
- init.sql
- main.go
- config.yml
- docker-compose.yml
- go.mod
- go.sum
- main.go
- docker-compose.yml
- high_init.sql
- init.sql
- main.go
- docker-compose.yml
- init.sql
- main.go
- docker-compose.yml
- init.sql
- main.go
- docker-compose.yml
- init.sql
- main.go
- docker-compose.yml
- init.sql
- main.go
- docker-compose.yml
- Dockerfile
- go.mod
- go.sum
- init.sql
- main.go
- docker-compose.yml
- go.mod
- go.sum
- init.sql
- main.go
- README.md
- .DS_Store
- dashboard.json
- dashboard.png
- basic_functionality_test.go
- books.go
- concurrent_tx_ordering_test.go
- copy_protocol_test.go
- go.mod
- go.sum
- heartbeat_test.go
- main_test.go
- publication_column_list_test.go
- publication_for_all_tables_test.go
- publication_partitioned_test.go
- sigterm_lsn_flush_test.go
- snapshot_advanced_test.go
- snapshot_basic_test.go
- snapshot_chunks_test.go
- snapshot_consistency_test.go
- snapshot_ctid_partitioning_test.go
- snapshot_force_resnapshot_test.go
- snapshot_helpers_test.go
- snapshot_migration_test.go
- snapshot_no_walsender_test.go
- snapshot_only_test.go
- snapshot_publication_columns_test.go
- snapshot_query_condition_test.go
- snapshot_sparse_integer_pk_test.go
- streaming_rollback_test.go
- streaming_transaction_test.go
- system_identity_full_test.go
- test_connector.yaml
- transactional_large_commit_test.go
- transactional_large_rollback_test.go
- transactional_process_test.go
- server.go
- metric.go
- registry.go
- retry.go
- logger.go
- heartbeat.go
- begin.go
- begin_test.go
- commit.go
- commit_test.go
- delete.go
- delete_test.go
- insert.go
- insert_test.go
- keepalive.go
- keepalive_test.go
- relation.go
- relation_test.go
- snapshot.go
- stream.go
- stream_test.go
- time.go
- time_test.go
- truncate.go
- truncate_test.go
- update.go
- update_test.go
- data.go
- data_test.go
- message.go
- message_test.go
- config.go
- operation.go
- publication.go
- query_condition.go
- query_condition_test.go
- replica_identity.go
- replica_identity_test.go
- table.go
- table_test.go
- replication.go
- shutdown_audit_test.go
- stream.go
- stream_ack_test.go
- stream_connmu_test.go
- stream_test.go
- wal.go
- wal_test.go
- config.go
- info.go
- slot.go
- slot_test.go
- connection_pool.go
- coordinator.go
- coordinator_test.go
- decoder_cache.go
- helpers.go
- job.go
- range_chunks_sparse_test.go
- snapshot.go
- transaction_snapshot.go
- worker.go
- hypertable.go
- connection.go
- lsn.go
- query.go
- system.go
- .gitignore
- .golangci.yml
- .goreleaser.yml
- connector.go
- CONTRIBUTING.md
- go.mod
- go.sum
- LICENSE
- Makefile
- README.md
# Installation Guide
1. Get the code
git clone https://github.com/Trendyol/go-pq-cdc
Downloads the entire project code from GitHub to your computer.
cd go-pq-cdc
Moves into the project folder you just downloaded.
2. Docker
Easy RecommendedPrerequisites
- Git Needed to download the project code from GitHub.
- Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
β οΈ This is a large repository, so this method may point to an internal sub-package rather than the actual core product. Check the full README as well.
docker compose -f benchmark/benchmark_cdc/docker-compose.yml up -d --build
Runs the command against the services defined in the compose file.
Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.
3. Go
MediumPrerequisites
cd benchmark/benchmark_cdc/go-pq-cdc-kafka
This project's files live in a subfolder, so move into it first.
go build ./...
Compiles the Go program into an executable.
go run .
Runs the Go program directly without a separate build step.
If the build finishes without errors, it worked. If you used go run ., check the terminal output.
4. Make
MediumPrerequisites
- Git Needed to download the project code from GitHub.
- Make Usually pre-installed on Linux/macOS. On Windows, install separately (e.g. via MSYS2 or WSL).
make
Compiles the code based on the generated build configuration to produce an executable.
If it finishes without errors, it worked. Try running the generated executable directly.
// repository documentation
Was this content helpful?
(0 ratings)