Spark

1 article · search the full text for this term

• Published Subscription Review Article 16 Sep 2024

  Decoding Big Data: A Practical Comparison Between Hadoop and Spark

  By Saunved Palve, Ammar Abdulhussain, Om Sawant, Ayush Yadav, Aditya Kasar

  Abstract: This paper conducts a comprehensive comparison of Apache Hadoop and Apache Spark, two essential frameworks in the big data era. The rapid expansion of data possesses challenges in terms of volume, variety, and velocity, which necessitate advanced processing solutions. Hadoop, utilizing its MapReduce paradigm, provides scalable and fault-tolerant storage, whereas Spark, built upon Hadoop, introduces in-memory processing to increase speed and flexibility. This study includes a detailed examination of their …

  Published in Recent Trends in Parallel Computing · Vol. 11, Issue 3, 2024 · pp. 15–23 Read article →