Big Data : The Untold Story

What is Big Data? Why it is in so demand?

  1. Volume: Organizations collect data from a variety of sources, including business transactions, smart (IoT) devices, industrial equipment, videos, social media and more. In the past, storing it would have been a problem — but cheaper storage on platforms like data lakes and Hadoop have eased the burden. Size of data plays very crucial role in determining value out of data.
  2. Velocity: With the growth in the Internet of Things, data streams in to businesses at an unprecedented speed and must be handled in a timely manner. RFID tags, sensors and smart meters are driving the need to deal with these torrents of data in near-real time. Velocity refers to the speed of generation of data.
  3. Variety: Data comes in all types of formats — from structured, numeric data in traditional databases to unstructured text documents, emails, videos, audios, stock ticker data and financial transactions.

List of some Big Data Tools Used by Industry:

  1. Apache Hadoop
  2. Apache Spark
  3. Flink
  4. Apache Storm
  5. Apache Cassandra
  6. MongoDB
  7. Kafka
  8. Tableau

Who are facing this problem?

1. Netflix

Source : Netflix

2. Facebook

Source : DIGITAL 2019: GLOBAL DIGITAL OVERVIEW

3. Google

4. Instagram

5. Amazon

6. Some More General Statistics

  1. Twitter community generates more than 12 terabytes of data per day that equals 84 terabytes per week and 4368 terabytes or 4.3 petabytes per year.· Since 2013, the number of Tweets each minute has increased 58% to more than 474,000 Tweets PER MINUTE in 2019!
  2. According to computer giant IBM, 2.5 exabytes — that’s 2.5 billion gigabytes (GB) — of data was generated every day in 2012.
  3. Worldwide over 100 million messages are sent every minute via SMS and in-app messages!
  4. More than 4 million hours of content uploaded to Youtube every day, 300 hours of video are uploaded to YouTube every minute! with users watching 5.97 billion hours of Youtube videos each day. Youtube usage more than tripled from 2014–2016 with users uploading 400 hours of new video each minute of every day! Now, in 2019, users are watching 4,333,560 videos every minute.
  5. Walmart is the largest retailer in the world and the world’s largest company by revenue, with more than 2 million employees and 20000 stores in 28 countries.Hadoop and NoSQL technologies are used to provide internal customers with access to real-time data collected from different sources and centralized for effective use.
Source : DOMO Data Never Sleeps 7.0

--

--

--

Be Somebody Nobody Thought You Could Be

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Kenshins give back to the community during Impactathon 2021 — Part 2

Searchlight — IMINT

Covid-19: A surprisingly effective data driven model

Training neural networks to generate piano music

Analyzing NYPD Motor Vehicle Collisions with Python (Part 2)

Data, Data, Data! 11(+2) Great Financial Data Vendors

Default Credit Card Client Classification

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Anirudhi Thanvi

Anirudhi Thanvi

Be Somebody Nobody Thought You Could Be

More from Medium

DATA WAREHOUSE?

You are being lied to. Stop scanning your data

Big Data Management

How Decision Automation Solves for Big Data Bias