Analysis of Big Data Using Two Mapper Files in Hadoop

Overview Of Big Data

Big Data is found in number of fields like Astrophysics, Mathematics, Energy, Fundamental Science, Medicine, Engineering, and Remote Sensing and Statistical data. In all these fields the majority of challenges are the development of algorithms, visualization techniques, and analytics. To resolve these challenges there are many Big Data analysis tools available like Hadoop that is an open source platform used for parallel execution of Big Data. It processes large datasets across multiple nodes. According to the definition given by McKinsey Global Institute (MGI, 2012):

“Big Data” refers to datasets whose size is beyond the ability of typical database software tools to capture, store, manage and analyze (Bhatia et al, 2017).

Big Data is capable of changing the financial value across the following major sectors:

• •

  Public sector department

• •

  Due to widespread use of mobile phones, personal position data of various customers is maintained

• •

  Due to the presence of large Web e-commerce and retail shops such as eBay and Amazon, retail has become the important sector

• •

  Since patient history and information related to health is very important, Health care is a critical area

• •

  Manufacturing (Zicari, 2014)