aws-data-lake-solution

(★ 398)

A deployable reference implementation intended to address pain points around conceptualizing data lake architectures that automatically configures the core AWS services necessary to easily tag, search, share, and govern specific subsets of data across a business or with other external businesses.

File Explorer

Download Latest Version (.zip)

- - app.js
  - package.json
- build-s3-dist.sh
- data-lake-api.template
- data-lake-deploy-federated.template
- data-lake-deploy.template
- data-lake-services.template
- data-lake-storage.template
- run-unit-tests.sh
- - datalake-add-cart-item.js
  - datalake-checkout-cart.js
  - datalake-create-group.js
  - datalake-create-package-metadata.js
  - datalake-create-package.js
  - datalake-delete-group.js
  - datalake-describe-cart-item.js
  - datalake-describe-cart.js
  - datalake-describe-package-dataset.js
  - datalake-describe-package-datasets.js
  - datalake-describe-package-metadata.js
  - datalake-describe-package.js
  - datalake-describe-required-metadata.js
  - datalake-execute-package-crawler.js
  - datalake-get-group.js
  - datalake-get-package-crawler.js
  - datalake-get-package-table-data.js
  - datalake-get-user-group-list.js
  - datalake-import-package-manifest.js
  - datalake-list-groups.js
  - datalake-list-package-tables.js
  - datalake-remove-cart-item.js
  - datalake-remove-package-dataset.js
  - datalake-remove-package.js
  - datalake-remove-user-from-group.js
  - datalake-search.js
  - datalake-update-group.js
  - datalake-update-package-crawler.js
  - datalake-update-package.js
  - datalake-update-user-group-list.js
  - datalake-upload-package-dataset.js
  - datalake.js
  - install.sh
  - package.json
- - .bowerrc
  - .jshintrc
  - .travis.yml
  - bower.json
  - karma.conf.js
  - package.json
.gitignore
.jscsrc
CHANGELOG.md
CODE_OF_CONDUCT.md
CONTRIBUTING.md
LICENSE.txt
NOTICE.txt
README.md

# Installation Guide

1. Get the code

git clone https://github.com/aws-solutions/aws-data-lake-solution

Downloads the entire project code from GitHub to your computer.

cd aws-data-lake-solution

Moves into the project folder you just downloaded.

2. Node.js

Easy Recommended

Prerequisites

Git Needed to download the project code from GitHub.
Node.js Node.js must be installed to use npm. The LTS version is recommended.

⚠️ This is a large repository, so this method may point to an internal sub-package rather than the actual core product. Check the full README as well.

cd deployment/manifest-generator

This project's files live in a subfolder, so move into it first.

npm install

Downloads and installs the libraries listed in package.json.

npm start

Starts the development/run server.

✅ After running the command, open the address shown in the terminal (usually something like http://localhost:3000) in your browser.