Hadoop Single node Cluster Installation with Ambari

Pre-requisites:

we need to have 1 VM with Linux OS ,4 vCPUs, 4 GB RAM and 20 GB System Disk.

On a Server host that has Internet access, use a command line editor to perform the following steps:

Step 1) Log in to your host as root

Step 2) Download the Ambari repository file to a directory on your installation host.
wget -nv http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.4.2.0/ambari.repo -O /etc/yum.repos.d/ambari.repo

Important: Do not modify the ambari.repo file name. This file is expected to be available on the Ambari server host during Agent registration

Step 4) Confirm that the repository is configured to showing correct version of Ambari

Step 5) Install the Ambari server

Step 6) Install Ambari-server with postgresql DB

Follow the below instructions and install Ambari-server

Step 7) Ambari Server Setup

 Continue and follow the instructions until complete the Ambari server set up.

Step 8) Stop iptables service using below command on Cert OS 7x

Step 9) Ambari Server Start and checking status

Step 10) Check Ambari Server status using process command

Step 11) Install Ambari Agent

Step 12) Ambari Agent Start

Step 13) Type ifconfig to know the IP address of Ambari server

Step 14) Type IP address and Ambari port 8080 in Google Crome browser like

Step 15) Ambari Home Screen and Type user and password as admin/admin, later you can change the ambari credentials when you want.

Step 16) Ambari Dashboard

Password Less SSH OR SSH login without Password in Hadoop Cluster

Secure SHELL (SSH) is an open source network protocol that is used to login into remote servers for execution of commands and programs.It is also used to transfer files from one computer to another computer over the network using secure copy (SCP) Protocol.

Here is the process to setup password-less login on any linux RHEL/CentOS using ssh keys to connect to remote Linux servers without entering password. Using Password-less login with SSH keys will increase the trust between two Linux servers for easy file synchronization or transfer.

In this example I will setup SSH password-less automatic login from server1 cloudglee.com (192.237.172.243) to cloudglee.com_2 (104.237.172.243).

Step 1) Go to ~/.ssh directory, please create ~/.ssh directory if already doesn't exist

Step 2) Login into server cloudglee.com (1st server) with root user and generate a pair of public keys using following command.

Step 3) Verify the public Key(id_rsa.pub) and Private Key (id_rsa) got created, authorized_keys file is also default exists in same directory.If doesn't present we need to create manually using touch command.

Step 4) Copy public key id_rsa.pub to authorized_keys as shown in above screen
Step 5) Copy public key to authorizied_keys file in server 2 (cloudglee.com_2)using scp

Step 6) Copy Publickey and Private key to Server 2 (CloudGlee.com_2).

Step 7) Verify Piblic key, Private Key and authorized keys in server 2 (cloudglee.com_2)

Step 8) Change the permission as per below on both the servers

Step 9) Validate SSH from server 1 to Server 2 and Server2 to Server 1.