data-accelerator

(โ˜… 312)

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

File Explorer

Download Latest Version (.zip)
  • .gitignore
  • CODE_OF_CONDUCT.md
  • CONTRIBUTING.md
  • LICENSE
  • README.md
  • SECURITY.md
  • ThirdPartyNotices.txt

# Installation Guide

1. Get the code
git clone https://github.com/microsoft/data-accelerator

Downloads the entire project code from GitHub to your computer.

cd data-accelerator

Moves into the project folder you just downloaded.

2. Docker

Easy Recommended
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker build -f DeploymentCloud/Deployment.Kubernetes/Dockerfile -t data-accelerator .

Builds a runnable image based on the Dockerfile.

docker run -p 8080:80 data-accelerator

Runs the built image as an actual container.

โœ… Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.

3. .NET

Medium
Prerequisites
  • Git Needed to download the project code from GitHub.
  • .NET SDK The SDK required for the dotnet command.
โš ๏ธ This is a large repository, so this method may point to an internal sub-package rather than the actual core product. Check the full README as well.
cd DataProcessing/DataX.Utilities

This project's files live in a subfolder, so move into it first.

dotnet restore

Downloads the packages the project depends on.

dotnet run

Builds the project and runs it immediately.

โœ… After dotnet run, check the message or address shown in the terminal.

4. Maven (Java)

Medium
Prerequisites
  • Git Needed to download the project code from GitHub.
  • JDK (Java) Required to build and run Java projects.
  • Maven The build tool used for the mvn command.
โš ๏ธ This is a large repository, so this method may point to an internal sub-package rather than the actual core product. Check the full README as well.
cd DataProcessing/datax-core

This project's files live in a subfolder, so move into it first.

mvn clean install

Installs dependencies and builds the project using Maven.

โœ… A BUILD SUCCESS message means it worked. The output is created under target/.

Today's picks

ghidra โ˜… 72,620

Ghidra is a software reverse engineering (SRE) framework

Java
PaddleOCR โ˜… 88,058

Turn any PDF or image document into structured data for your AI. A powerful, lightweight O

Python
llm-course โ˜… 81,890

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
awesome-mac โ˜… 111,530

๏ฃฟ This project is dedicated to collecting high-quality macOS software and organizing them

Swift
MoneyPrinterTurbo โ˜… 104,509

ๅˆฉ็”จ AI ๅคงๆจกๅž‹ๅ’Œ่‡ชๅŠจๅŒ–ๅทฅไฝœๆต๏ผŒๆ นๆฎไธป้ข˜ๆˆ–ๅ…ณ้”ฎ่ฏไธ€้”ฎ็”Ÿๆˆ้ซ˜ๆธ…็Ÿญ่ง†้ข‘ใ€‚Generate HD short videos from a topic or keyword with a

Python
HelloGitHub โ˜… 171,210

:octocat: ๅˆ†ไบซ GitHub ไธŠๆœ‰่ถฃใ€ๅ…ฅ้—จ็บง็š„ๅผ€ๆบ้กน็›ฎใ€‚Share interesting, entry-level open source projects on Gi

Python
// repository documentation