Contributions to Hadoop File System Architecture by revising the file system Usage Along with Automatic Service

Main Article Content

Article Sidebar

Published Sep 14, 2021
Praveen Kumar Mannepalli

Abstract

The usage of unstructured data is becoming obvious by companies and social media is raised heavily from past decade. The sharing of images, audio, video content by the individual user and corporate can be observed everywhere. The current work focused on the Hadoop framework revision contributions so as to improve the performance of the eco system in the context of space and time parameters. The architecture basically provides the usage of Hadoop Distributed File System (HDFS) and MapReduce (MR) we are proposing certain revision contributions so that the process of importing and processing of the tasks can get the benefit of time and space usage in the effective and efficient manner [12]. The work provides the service running in two different ways which reduces the time requirements of the cluster management, in the distributed environment this revision helps in the reduction of waiting time for the start of the service. The other context we have focused on the local file system handler in the data storage and processing of the data, the provision of using the file system according to the proposed architecture will handles the CPU context switch while performing the import and export process in the running of the jobs [13-14]. The outcome of the work is revision architecture to reflect the service initiation by all the machines in the cluster and file system revision approach to minimize the CPU context switch while performing the storage and processing relevant aspects of the Hadoop cluster [15].

How to Cite

Mannepalli, P. K. (2021). Contributions to Hadoop File System Architecture by revising the file system Usage Along with Automatic Service. SPAST Abstracts, 1(01). Retrieved from https://spast.org/techrep/article/view/391
Abstract 137 |

Article Details

Keywords

Hadoop, cluster, Hadoop Distributed File System, HDFS, MapReduce

References
J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters", Proceedings c. of the 6th Conferece on OS Design and Implementation San Francisco CA, Dec. 2004.
A. Gates, O. Natkovich, S. Chopra, P. Kamath, S. Narayanam, C. Olston, et al., "Building a High-Level Dataflow System on top of MapReduce: The Pig Experience", data bases proceedings, vol. 2, no. 2, pp. 1414-1425, 2009.
M. K. McKusick and S. Quinlan, "GFS: Evolution on Fast-forward" in ACM Queue, New York, NY, vol. 7, no. 7, August 2009.
O. O'Malley and A. C. Murthy, "Hadoop Sorts a Petabyte in 16.25 Hours and a Terabyte in 62 Seconds", May 2009.
K.UmaPavan, , various issues in Hadoop file systems,IJPAM, Volume 120 No. 6 2018, 4441-4451.
Uma Pavan Kumar Kethavarapu, “Various Computing models in Hadoop eco system along with the perspective of analytics using R and Machine learning”, Vol. 14 CIC 2016 Special Issue IJCSAI, PP-1723.
Konstantin, The Hadoop Distributed File System,”Symantic Scholar.org,October 2013.
D.Borthakur ,”The Hadoop Distributed File System Architecture and Design”, 2017,Apache.org.
.H.Liao, ”Multi-Dimensional index on Hadoop Distributed File System” 2010, IEEE explore ieee.org.
J.Zhang “A Distributed Cache for Hadoop Distributed File system in real- cloud services,ACM 2012.
S.Jin,”Design of trusted file System based on Hadoop,2012, Springer.
UmaPavan Kumar,”Integration of Hadoop and IOT for better analytics” TESTEngineering and Management,February 2020.
UmaPavan Kumar,” Various Issues in Hadoop Distributed File System, Map Reduce and Future Research Directions, International Journal of Pure and Applied Mathematics.
Rama Naga Kiran Kumar,”Hadoop Based File System Revision with Derby and Virtual Local File System Models., International Journal of Advanced Science and Technology, Vol.29, June 2020.
Ivanliton Polato, “ A Comprehensive view of Hadoop Research- A Systematic Literature Review, Volume 46,November 2019,PP:1-25.
Konstantin Shvachko,” The Hadoop Distributed File System” IEEE 2010.
Mohd Rehan Ghazi, “Hadoop , MapReduce and HDFS: A Developers Perspective” Procedia Computer Science ,2015.
Wu Jun ,” Study of New Materials Design based on Hadoop”, MATEC Web of Conference 61,07016(2016).
Section
GE3- Computers & Information Technology