Big Data & Hadoop

Big Data & Hadoop

Q:- What is Big Data?
A:- Massive Volume , Structured,Semi-Structured,Unstructured data which is so large and difficult to       process using traditional approach under databases and software techniques.
      In this individual transactions are not critical only aggregates or you can say derived analysis
      matters.
      Examples :- Credit Card transactions – 10,000/second. Walmart – 1 Million Customer                         transactions/second. RFID Systems .

Internal vs. External Sources
3 V of Big Data

  1. Volume
  2. Velocity
  3. Variety



  
Now Come to HADOOP


Comments

Post a Comment

Popular posts from this blog

Root User Access Solution on putty

Root User Access Permission denied :( Solution is here Don't worry :)  As I have also faced the same issue while I was also trying to install on my VM, could not able to access my Root user access. So I have decided that the proper solution must be share to all of you. You are facing like this:-  login as: root root@192.168.30.131's password: Access denied root@192.168.30.131's password: login as: user user@192.168.30.131's password: Welcome to Ubuntu 14.04 LTS (GNU/Linux 3.13.0-24-generic i686)  * Documentation:  https://help.ubuntu.com/ Last login: Mon May  2 14:03:30 2016 from 192.168.30.1 user@ubuntuvm:~$ /etc/ssh/sshd_config -bash: /etc/ssh/sshd_config: Permission denied Solution 1 :- type on VM terminal vim /etc/ssh/sshd_config Using Sudo for Super User Access to Root Privileges in Linux The Linux super user, or root user, is a special user that has tremendous power, with the ability to access an...
Read more

RDBMS vs MAPREDUCE

Image
REF :- HADOOP : THE DEFINITIVE GUIDE :- BY TOM WHITE ( THE BIBLE OF HADOOP ) [ Relational Database Management Systems Why can’t we use databases with lots of disks to do large-scale analysis? Why is Hadoop needed? The answer to these questions comes from another trend in disk drives: seek time is improving more slowly than transfer rate. Seeking is the process of moving the disk’s head to a particular place on the disk to read or write data. It characterizes the latency of a disk operation, whereas the transfer rate corresponds to a disk’s bandwidth. If the data access pattern is dominated by seeks, it will take longer to read or write large portions of the dataset than streaming through it, which operates at the transfer rate. On the other hand, for updating a small proportion of records in a database, a traditional B-Tree (the data structure used in relational databases, which is limited by the rate at which it can perform seeks) works well. For updating the majority of a datab...
Read more