Search
5 articles for “Hadoop”
-
Decoding Big Data: A Practical Comparison Between Hadoop and Spark
Abstract: This paper conducts a comprehensive comparison of Apache Hadoop and Apache Spark, two essential frameworks in the big data era. The rapid expansion of data possesses challenges in terms of volume, variety, and velocity, which necessitate advanced processing solutions. Hadoop, utilizing its MapReduce paradigm, provides scalable and fault-tolerant storage, whereas Spark, built upon Hadoop, introduces in-memory processing to increase speed and flexibility. This study includes a detailed examination of their …
Published in Recent Trends in Parallel Computing · Vol. 11, Issue 3, 2024 · pp. 15–23 Read article
-
Unravelling the Power of Avro and Hadoop: Revolutionising Big Data Processing and Serialization
Abstract: As the technology is in progress, the accumulation of data is also increasing. As a result of which a lot of organisations are constantly seeking new yet innovative solutions to process and analyse this huge accumulation of data. Well Hadoop proved a gamе-changеr in thе rеalm of big data procеssing whereas Avro proved a solution provider to data Serialization. In this review work, wе will dеlvе into thе world of …
Published in International Journal of Data Structure Studies · Vol. 2, Issue 1, 2024 · pp. 8–13 Read article
-
A Dynamic Text Compression Model for Big Data Applications Using Hadoop
Abstract: In today’s data-driven era, efficiently handling vast amounts of information has become increasingly important. Data compression plays a vital role in this regard — it is essentially a method of encoding information in such a way that significantly reduces the number of bits required to store or transmit a file. By shrinking data to its most compact form, compression techniques help save storage space, reduce bandwidth consumption, and improve the …
Published in International Journal of Algorithms Design and Analysis Review · Vol. 4, Issue 2, 2026 Read article
-
Effects of Cluster Computing on Big Data Analysis and Network Topology
Abstract: The rapid expansion of big data has posed substantial difficulties for conventional computing systems. As a result, cluster computing has grown to be a potent method for effective large data processing. Cluster computing involves multiple interconnected nodes functioning as a unified system, pooling together their processing, storage, and memory resources. These nodes are typically connected through high-speed networks such as ethernet or InfiniBand, facilitating efficient data sharing and communication among …
Published in International Journal of Algorithms Design and Analysis Review · Vol. 1, Issue 1, 2023 · pp. 31–39 Read article
-
Challenges in Parallel Computing for Big Data Analytics
Abstract: The integration of parallel computing into the realm of big data analytics promises accelerated processing speeds and enhanced scalability, but it is not without its formidable challenges. This study explores the multifaceted hurdles faced in the pursuit of efficient parallel processing for large-scale data analytics. The intricate task of distributing and partitioning massive datasets across multiple processing units demands adept strategies to ensure equitable workloads. Load balancing emerges as a …
Published in Recent Trends in Parallel Computing · Vol. 11, Issue 1, 2024 · pp. 1–6 Read article