Overview

Apache Hadoop is a collection of open-source software utilities that facilitates using a network of many computers to solve problems involving massive amounts of data and computation. It provides a software framework for distributed storage and processing of big data using the MapReduce programming model.

As such, hadoop stores the data into instances called Data Nodes, managed by a Name node as you can see below:

In that example the replication factor is set to 3, so we have 3 copy of a block in the whole cluster. These datablocks (pieces of the file sent by the client) and stored on Hadoop File system or HDFS

Management

Start Hadoop

Start DFS

Start Yarn

Start HBase

Check Processes

Manage HDFS

Create / List / Delete HDFS Directories