denormalized
Embeddable stream processing engine based on Apache DataFusion
File Explorer
Download Latest Version (.zip)- action.yaml
- python-docs.yml
- python-lint.yml
- python.yml
- rust.yml
- mod.rs
- py_err.rs
- lib.rs
- Cargo.toml
- LICENSE
- README.md
- mod.rs
- serializable_accumulator.rs
- serialize.rs
- denormalized_config.rs
- mod.rs
- kafka_config.rs
- kafka_stream_read.rs
- mod.rs
- topic_reader.rs
- topic_writer.rs
- mod.rs
- avro.rs
- json.rs
- mod.rs
- utils.rs
- mod.rs
- mod.rs
- streaming_window.rs
- coalesce_before_streaming_window_aggregate.rs
- mod.rs
- grouped_window_agg_stream.rs
- mod.rs
- streaming_window.rs
- accumulators.rs
- mod.rs
- time.rs
- mod.rs
- stream_table.rs
- mod.rs
- streaming_window.rs
- mod.rs
- rocksdb_backend.rs
- slatedb.rs
- arrow_helpers.rs
- default_optimizer_rules.rs
- mod.rs
- row_encoder.rs
- serialization.rs
- context.rs
- datastream.rs
- lib.rs
- query_planner.rs
- Cargo.toml
- LICENSE
- README.md
- mod.rs
- lib.rs
- orchestrator.rs
- Cargo.toml
- denormalized_dark.png
- denormalized_logo.png
- kafka_rideshare_example.md
- csv_streaming.rs
- emit_measurements.rs
- kafka_rideshare.rs
- simple_aggregation.rs
- stream_join.rs
- udf_example.rs
- lib.rs
- Cargo.toml
- module.html.jinja2
- __init__.py
- base.py
- location.py
- __init__.py
- catalog.py
- common.py
- context.py
- dataframe.py
- expr.py
- functions.py
- object_store.py
- py.typed
- record_batch.py
- udf.py
- __init__.py
- context.py
- data_stream.py
- feast_data_stream.py
- feast_data_stream.pyi
- utils.py
- stream_aggregate.py
- stream_join.py
- udaf_example.py
- udf_example.py
- context.rs
- datastream.rs
- errors.rs
- lib.rs
- utils.rs
- .gitignore
- build_wheels.sh
- Cargo.lock
- Cargo.toml
- pyproject.toml
- README.md
- uv.lock
- .clabot
- .dockerignore
- .gitignore
- Cargo.lock
- Cargo.toml
- clippy.toml
- CODE_OF_CONDUCT.md
- CONTRIBUTING.md
- Dockerfile
- LICENSE
- README.md
π Installation Guide
1. Get the code
git clone https://github.com/probably-nothing-labs/denormalized
Downloads the entire project code from GitHub to your computer.
cd denormalized
Moves into the project folder you just downloaded.
2. Docker
Easy RecommendedPrerequisites
- Git Needed to download the project code from GitHub.
- Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker build -t denormalized .
Builds a runnable image based on the Dockerfile.
docker run -p 8080:80 denormalized
Runs the built image as an actual container.
Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.
3. Python
EasyPrerequisites
pip install .
Installs the package published on PyPI directly β no need to clone the source.
python <μ€νν νμΌλͺ
>.py # READMEμμ μ νν μ€ν νμΌλͺ
μ νμΈνμΈμ
Runs the Python script (or module).
If it runs without errors and prints output in the terminal, it worked.
4. Rust
MediumPrerequisites
- Git Needed to download the project code from GitHub.
- Rust (rustup) Installing via rustup also installs cargo.
cargo build --release
Compiles the Rust project.
cargo run
Builds and then immediately runs the program.
If cargo build finishes without errors, it worked. The executable is created under target/.
// repository documentation
Was this content helpful?
(0 ratings)