hadoopfromscratch

KO | EN

gitlite — search

#react #typescript #llm #go #golang #android #machine-learning #linux #docker #windows #awesome #cli #openai #open-source

hadoopfromscratch

(★ 15)

A set of tools to roll out your own hadoop distro.

hadoopfromscratch 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# HadoopFromScratch

A set of tools to compile and roll out your own Hadoop distro for educational or testing purposes.

## Requirements

- CentOS 7 is required.
- SElinux and firewalld should be disabled.
- The install.sh script should be run as root.
- It is also recommended to configure a resolvable FQDN for the host, even thought the default "localhost" should be enough for testing purposes.

## Installation

Download install.sh and run it as root:

```curl -s https://raw.githubusercontent.com/hadoopfromscratch/hadoopfromscratch/master/install.sh | bash```

If everything goes well, the software listed below should be up and running. You can test if everything works properly by executing the test.sh script:

```curl -s https://raw.githubusercontent.com/hadoopfromscratch/hadoopfromscratch/master/test.sh | bash```

## Software and versions

The script will download, compile, configure and run the following pieces of software:

- Java 8u171
- Ant 1.10.3
- Maven 3.5.3
- Zookeeper 3.4.11
- Hadoop 2.9.0
- Spark 2.3.0
- Hive 2.3.3
- Pig 0.17
- HBase 1.4.3
- Flume 1.8.0
- Sqoop 1.4.7
- Hue 4.1.0

## Layout

- /opt will contain installed software (each project goes into its own directory)
- /data will contain Hadoop's data
- User's home dir will contain ant and maven directories and all downloaded sources. All its contents can be safely removed after the installation is finished.

hadoopfromscratch

hadoopfromscratch 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

hadoopfromscratch

hadoopfromscratch 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README