An Approach in Big Data Analytics to Improve the Velocity of Unstructured Data Using MapReduce

Sundarakumar M. R., Mahadevan G., Ramasubbareddy Somula, Sankar Sennan, Bharat Rawal

OAI: oai:igi-global.com:273889 • DOI: 10.4018/IJSDA.20211001.oa6

Big Data Analytics is an innovative approach for extracting the data from a huge volume of data warehouse systems. It reveals the method to compress the high volume of data into clusters by MapReduce and HDFS. However, the data processing has taken more time for extract and store in Hadoop clusters. The proposed system deals with the challenges of time delay in shuffle phase of map-reduce due to scheduling and sequencing. For improving the speed of big data, this proposed work using the Compressed Elastic Search Index (CESI) and MapReduce-Based Next Generation Sequencing Approach (MRBNGSA). This approach helps to increase the speed of data retrieval from HDFS clusters because of the way it is stored in that. this method is stored only the metadata in HDFS which takes less memory during runtime compare to big data due to the volume of data stored in HDFS. This approach is reduces the CPU utilization and memory allocation of the resource manager in Hadoop Framework and imroves data processing speed, such a way that time delay has to be reduced with minimum latency.

Adaptive & Complex Systems Computer Science and Information Technology Computer Engineering