Integration of LVM with Hadoop-Cluster on RHEL8 🔥

LVM → Logical Volume Management (LVM) creates a layer of abstraction over physical storage, allowing you to create logical storage volumes. With LVM in place, you are not bothered with physical disk sizes because the hardware storage is hidden from the software so it can be resized and moved without stopping applications or unmounting file systems. You can think of LVM as dynamic partitions.

What is Hadoop?

Firstly have hadoop setup on both Namenode and Datanode

Now start Namenode

Successfully done NAMENODE setup

Now setup in Datanode

Finally done setup on both master and slave node

Now create Logical volume i,e extendable volume

Create pv

Create Vg

providing size in GB

Formatting

Mounting

Now Extending Volume

Now it has increased also check in hadoop cluster

Before Mounting the logical volume

After Mounting Logical volume to /dn3

It has increased the volume on the fly.

Task description → Integrating LVM with Hadoop and providing Elasticity to DataNode Storage

Hope it helped you 😎

Passionate learner || Data Science Enthusiast || Django || Competitive Programmer