koheesio
Python framework for building efficient data pipelines. It promotes modularity and collaboration, enabling the creation of complex pipelines from simple, reusable components.
File Explorer
Download Latest Version (.zip)- bug_report.md
- feature_request.md
- auto-merge-dependabot.yml
- codeql.yml
- release.yml
- test.yml
- CODE_OF_CONDUCT.md
- CODEOWNERS
- dependabot.yml
- PULL_REQUEST_TEMPLATE.md
- intro_api.md
- documentation-system-overview.png
- k_blue.svg
- k_in_logo.svg
- k_in_logo_white.svg
- k_white.svg
- logo_koheesio.svg
- logo_total_white.svg
- maintainance.png
- approach-documentation.md
- contribute.md
- custom.css
- local-github-actions.md
- glossary.md
- info.md
- tags.md
- concepts.md
- context.md
- logger.md
- step.md
- readers.md
- transformations.md
- writers.md
- 0.10.md
- 0.11.md
- 0.9.md
- advanced-data-processing.md
- getting-started.md
- hello-world.md
- learn-koheesio.md
- onboarding.md
- testing-koheesio-steps.md
- gen_ref_nav.py
- index.md
- __init__.py
- http.py
- __init__.py
- test_utils.py
- __init__.py
- secrets.py
- utils.py
- __init__.py
- spark_expectations.py
- __init__.py
- hyper.py
- server.py
- __init__.py
- sftp.py
- snowflake.py
- __init__.py
- box.py
- __init__.py
- nested_enum.py
- reader.py
- sql.py
- __init__.py
- slack.py
- __init__.py
- excel.py
- __init__.py
- __init__.py
- __init__.py
- __init__.py
- autoloader.py
- __init__.py
- delta.py
- dummy.py
- excel.py
- file_loader.py
- hana.py
- jdbc.py
- kafka.py
- memory.py
- metastore.py
- rest_api.py
- snowflake.py
- spark_sql_reader.py
- teradata.py
- cast_to_target.py
- schema.py
- __init__.py
- interval.py
- __init__.py
- camel_to_snake.py
- rename_columns.py
- rename_columns_and_map_keys.py
- rename_map_keys.py
- __init__.py
- change_case.py
- concat.py
- pad.py
- regexp.py
- replace.py
- split.py
- substring.py
- trim.py
- __init__.py
- arrays.py
- cast_to_datatype.py
- debug.py
- download_files.py
- drop_column.py
- dummy.py
- get_item.py
- hash.py
- lookup.py
- repartition.py
- replace.py
- row_number_dedup.py
- sql_transform.py
- transform.py
- uuid5.py
- __init__.py
- common.py
- connect.py
- dataframe.py
- string.py
- __init__.py
- batch.py
- scd.py
- stream.py
- utils.py
- __init__.py
- buffer.py
- dummy.py
- file_writer.py
- kafka.py
- snowflake.py
- stream.py
- __init__.py
- delta.py
- etl_task.py
- snowflake.py
- __init__.py
- okta.py
- __init__.py
- download_file.py
- dummy.py
- http.py
- __init__.py
- date_time.py
- testing.py
- __about__.py
- __init__.py
- context.py
- logger.py
- common.yml
- dev.yml
- sample.json
- sample.toml
- sample.yaml
- .part-00000-c95e3fda-3943-4701-b0ae-cb6bc7e015e4-c000.avro.crc
- part-00000-c95e3fda-3943-4701-b0ae-cb6bc7e015e4-c000.avro
- dummy.csv
- dummy_semicolon.csv
- .00000000000000000000.json.crc
- 00000000000000000000.json
- .part-00000-0f8b246f-e779-4d48-896a-6a12362bf370-c000.snappy.parquet.crc
- part-00000-0f8b246f-e779-4d48-896a-6a12362bf370-c000.snappy.parquet
- dummy.xlsx
- dummy.hyper
- dummy.json
- dummy_simple.json
- .part-00000-ddcce057-2ef4-44b1-baf4-d263f748b060-c000.snappy.orc.crc
- part-00000-ddcce057-2ef4-44b1-baf4-d263f748b060-c000.snappy.orc
- .part-00000-c7808dd3-0ba3-4ded-95f7-5c8b70b35e09-c000.snappy.parquet.crc
- .part-00001-c7808dd3-0ba3-4ded-95f7-5c8b70b35e09-c000.snappy.parquet.crc
- part-00000-c7808dd3-0ba3-4ded-95f7-5c8b70b35e09-c000.snappy.parquet
- part-00001-c7808dd3-0ba3-4ded-95f7-5c8b70b35e09-c000.snappy.parquet
- spark_sql_reader.sql
- expected_step_output.yaml
- expected_step_output_simple.yaml
- test_product_dq_stats.ddl
- test_product_rules.ddl
- test_product_rules.sql
- 100000_rows_with_strings.json
- dummy.sql
- test_asyncio_http.py
- test_context.py
- test_init.py
- test_logger.py
- __init__.py
- test_models.py
- test_nested_enum.py
- test_slack.py
- test_pandas_excel.py
- test_snowflake.py
- test_box.py
- test_secrets.py
- test_spark_expectations.py
- test_spark_snowflake.py
- test_sync_task.py
- test_hyper.py
- test_server.py
- test_auto_loader.py
- test_delta_reader.py
- test_file_loader.py
- test_hana.py
- test_jdbc.py
- test_memory.py
- test_metastore_reader.py
- test_reader.py
- test_rest_api.py
- test_spark_excel.py
- test_spark_sql_reader.py
- test_teradata.py
- test_etl_task.py
- test_cast_to_target.py
- test_date_time.py
- test_interval.py
- test_rename_columns.py
- test_rename_columns_map_keys.py
- test_rename_map_keys.py
- test_change_case.py
- test_concat.py
- test_pad.py
- test_regexp.py
- test_split.py
- test_string_replace.py
- test_substring.py
- test_trim.py
- test_arrays.py
- test_camel_to_snake_transform.py
- test_cast_to_datatype.py
- test_debug.py
- test_download_files.py
- test_drop_column.py
- test_get_item.py
- test_hash.py
- test_lookup.py
- test_repartition.py
- test_replace.py
- test_row_number_dedup.py
- test_sql_transform.py
- test_transform.py
- test_transformation.py
- test_uuid5.py
- test_dataframe_utils.py
- test_string_utils.py
- test_delta_writer.py
- test_scd.py
- test_buffer.py
- test_dummy.py
- test_file_writer.py
- test_sftp.py
- test_stream.py
- __init__.py
- _testing.py
- conftest.py
- test_delta.py
- test_spark.py
- test_spark_utils.py
- test_warnings.py
- test_okta.py
- test_download_file.py
- test_http.py
- test_steps.py
- test_common_utils.py
- test_date_time_utils.py
- conftest.py
- .actrc
- .gitignore
- CONTRIBUTING.md
- LICENSE.txt
- makefile
- mkdocs.yml
- pyproject.toml
- README.md
# Installation Guide
1. Get the code
git clone https://github.com/Nike-Inc/koheesio
Downloads the entire project code from GitHub to your computer.
cd koheesio
Moves into the project folder you just downloaded.
2. Official Install Script
Easy RecommendedPrerequisites
- Python 3 Python is required to use pip.
pip install koheesio
Installs the package published on PyPI directly β no need to clone the source.
After installing, open a new terminal and run the program's version command (e.g. --version) to confirm it worked.
Pulled directly from this repo's README.
3. Python
EasyPrerequisites
pip install koheesio
Installs the package published on PyPI directly β no need to clone the source.
If you're using poetry for package management, you can add Koheesio to your project with the following command:
Type this command into your terminal and run it.
or add the following line to your `pyproject.toml` (under `[tool.poetry.dependencies]`), making sure to replace
Type this command into your terminal and run it.
If it runs without errors and prints output in the terminal, it worked.
Pulled directly from this repo's README.
4. Make
MediumPrerequisites
- Git Needed to download the project code from GitHub.
- Make Usually pre-installed on Linux/macOS. On Windows, install separately (e.g. via MSYS2 or WSL).
make
Compiles the code based on the generated build configuration to produce an executable.
If it finishes without errors, it worked. Try running the generated executable directly.
// repository documentation
Was this content helpful?
(0 ratings)