A Review Paper on Hadoop Architecture

Pankaj Saraswat; Swapnil Raj

doi:10.55524/

Authors

Pankaj Saraswat SOEIT, Sanskriti University, Mathura, Uttar Pradesh, India Author
Swapnil Raj SOEIT, Sanskriti University, Mathura, Uttar Pradesh, India Author

DOI:

https://doi.org/10.55524/

Keywords:

Architecture, Big Data, Framework, Hadoop, HDFS

Abstract

Hadoop is an open-source software programming platform for storing and processing huge amounts of data. Its framework is built on Java programming, with some native C code and shell scripts thrown in for good measure. HDFS (Hadoop Distributed File System) is a global; highly failure file system intended to operate on low-cost commodity hardware. Big Data is the term used to describe this massive amount of data. In a world where data is generated at such a rapid pace, it must be preserved, evaluated, and dealt with. It is a subproject of the Apache Hadoop project. HDFS is designed for operations with big data volumes and offers high accessibility to application data. The main features of HDFS are discussed in this article, as well as a high level overview of the HDFS structure. Hadoop is a technology that will be used in the future, particularly by big businesses. The quantity of data being generated is only going to grow, and the need for this software is only going to grow.

Downloads

Download data is not yet available.

References

Hanson JJ. An introduction to the Hadoop Distributed File System. Dev Work. 2011;

Taylor RC. An overview of the Hadoop/MapReduce/HBase framework and its current applications in bioinformatics. BMC Bioinformatics. 2010;

Arslan M, Riaz Z, Munawar S. Building Information Modeling (BIM) Enabled Facilities management using hadoop architecture. PICMET 2017 - Portl Int Conf Manag Eng Technol Technol Manag Interconnected World, Proc. 2017;2017-January:1–6.

Diaconita V, Bologa AR, Bologa R. Hadoop oriented smart cities architecture. Sensors (Switzerland). 2018;18(4).

Kumar DGVRRCHVVNS. Hadoop Distributed File System and Map Reduce Processing on Multi-Node Cluster. Int J Sci Res. 2015;

Afrati FN, Ullman JD. Optimizing multiway joins in a map-reduce environment. IEEE Trans Knowl Data Eng. 2011;

Shahabinejad M, Khabbazian M, Ardakani M. An efficient binary locally repairable code for hadoop distributed file system. IEEE Commun Lett. 2014;

Mavani M. Comparative Analysis of Andrew Files System and Hadoop Distributed File System. Lect Notes Softw Eng. 2013;

Borthakur D. The hadoop distributed file system: Architecture and design. Hadoop Proj Website. 2007; [10]Shvachko K, Kuang H, Radia S, Chansler R. The Hadoop distributed file system. In: 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies, MSST2010. 2010.