How to install hadoop cluster/multi node on ubuntu server 18.04

Channel:
Ambar Hasbiyatmoko
Subscribers:
4,970
Published on ● Video Link: https://www.youtube.com/watch?v=zGP0Uqm0SAo


Category:
Tutorial
Duration: 38:29
14,459 views
106

how to install hadoop cluster/multi node on ubuntu server 18.04

requirements:
- hadoop 3.2.1
- java 8 (MUST java 8 for hadoop 3.x.x)
- 3 server
- master server (192.168.56.101/ubuntu18_svr_01, hostname:moko)
- slave server (192.168.56.102/ubuntu18_svr_02, hostname:moko2)
- slave server (192.168.56.103/ubuntu18_svr_03, hostname: moko-3)

steps:
- install java 8 on each server
- download hadoop 3.2.1 https://www-eu.apache.org/dist/hadoop/common/hadoop-3.2.1/hadoop-3.2.1.tar.gz and extract
- copy hadoop-3.2.1.tar.gz folder to each slave server with scp and extract
- add hostname in /etc/hosts/
- move folder: hadoop-3.2.1 to /usr/local/hadoop/
- add PATH /etc/environment
JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
- create user: hadoop
- create ssh keygen from master server and copy to slave server
- Configuring the Hadoop Master
- Copy the configuration files to each of your Hadoop Nodes from your Hadoop Master.
- Format the HDFS file system on master server
- Now you can start HDFS
- open master server : http://192.168.56.101:9870
- .......

see this video for details

https://dzone.com/articles/install-a-hadoop-cluster-on-ubuntu-18041



Other Videos By Ambar Hasbiyatmoko


2020-05-26How to install postman in Ubuntu 18.04
2020-05-26Wine error - wine is not owned by you, refusing to create a configuration directory there
2020-05-24Error Codeigniter 4 when access public folder - We seem to have hit a snag. Please try again later
2020-04-16How to fix Postman Canary - The SUID sandbox helper binary was found but is not configured correctly
2020-04-10Codeigniter Tutorial - How to Connect to SFTP with public-private key
2020-04-10Codeigniter error (Ubuntu) - You don't have permission to access this resource.Server unable to read
2020-04-05Digitalocean - How to create vps or droplet and add public ssh key
2020-03-14Arduino Error - avrdude, can't open device ttyACM0, permission denied
2020-01-27PHP - How to convert pdf to base64 or base64 to pdf using PHP
2019-10-13[Linux] How to solving PHP Curl: Call to undefined function curl_init()
2019-10-07How to install hadoop cluster/multi node on ubuntu server 18.04
2019-09-29Virtualbox problem - NAT adapter doesn't work after host-only adapter configured on ubuntu server 18
2019-09-15How to solving Phpmyadmin [Ubuntu] - the local server's socket is not correctly configured
2019-09-10PHP Tutorial - How to connect to server using ssh2_connect
2019-08-26Tutorial - Remote access to mysql on google compute engine
2019-08-25Akses ke vps google cloud menggunakan sftp atau ssh
2019-08-25Tutorial membuat VPS di Google Cloud Platform (Google Compute Engine)
2019-07-20install Webmin in Ubuntu 18.04
2019-07-14How to install laravel 5.8 in Ubuntu 18.04
2019-07-14How to solve grub rescue - after deleted my ubuntu partition
2019-07-07How to solve Virtualbox - Failed install extension pack (Failed to load the main module)


Tags:
hadoop
cluster
install
node
ubuntu
server
tutorial
yarn
java
virtualbox