How Big is Big Data Problem……!

What is Big Data ?

It is even impossible to imagine that the amount of data we are uploading in the Social medias like Facebook, Instagram, twitter, Netflix…and so on.

Do we really know where our data is exactly been stored and is easily accessible for us and from where is we getting information when we google things..

🔹Lets take the example of Facebook

On per day basis Facebook has been receiving 500 + Terabyte Data. So that means in just two days 1000 TB that is equal to 1 Petabyte Data has been received by Facebook and in one month around 15 Petabyte.

Data is power..❗

As in the 21st century data is the most powerful fuel . The company which stores more data is the most powerful company.Facebook is one of it.

But the challenge is where to store so much data ❔

PROBLEMS ARE THE SOURCE TO CREATE TECHNOLOGY..

what are the challenges faced by facebook to store the data and we know its huge.

  1. Volume: The volume of data refers to the size of the data sets that need to be analyzed and processed, which are now frequently larger than terabytes and petabytes.
  2. Velocity: Velocity refers to the speed with which data is generated. High velocity data is generated with such a pace that it requires distributed processing techniques.

To solve these problems here comes the “HADOOP CLUSTER”

Hadoop is an open-source software framework for storing data and running applications on clusters of commodity hardware.It provides massive storage for any kind of data, enormous processing power and the ability to handle virtually limitless concurrent tasks or jobs.

This is also called as MULTI CLUSTER NODE

Firstly when we upload our data in social media it will be converted into chunk of data and will be sent to the MASTER NODE which has control on the slaves (it may be 100 or 1000’s of slave) but master is the who has control on all the slaves.

The data can be interchanged between the slave node and master node only if they are connected with HDFS protocol.

By this “Master and slave” Cluster it has been possible to Solve the big data problem in this world.

I think by reading this u guys have a idea about Big data, hope u guys like it...

signing of …..✌

linkidin :https://www.linkedin.com/in/dileep-kumar-a16b691a9/

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Dileepkumar

Dileepkumar

Passionate learner || Data Science Enthusiast || Django || Competitive Programmer