Search
8 articles for “Apache Spark”
-
Intelligent Big Data Processing: Optimizing Analytics Pipelines Through Ensemble Machine Learning, Distributed Computing, and Adaptive AI Architectures
Abstract: Traditional data analytics methods are facing significant challenges due to the explosive rise of digital data. Global data generation is expected to reach nearly 175 zettabytes by 2025. This puts significant pressure on existing computing infrastructure. Conventional analytics methods often struggle with scalability, processing speed, and smart decision-making. Rule-based systems and standalone machine learning models frequently cannot handle the complexity and scale of modern big data environments effectively. To tackle …
Published in Journal of Multimedia Technology & Recent Advancements · Vol. 13, Issue 2, 2026 · pp. 1–11 Read article
-
Decoding Big Data: A Practical Comparison Between Hadoop and Spark
Abstract: This paper conducts a comprehensive comparison of Apache Hadoop and Apache Spark, two essential frameworks in the big data era. The rapid expansion of data possesses challenges in terms of volume, variety, and velocity, which necessitate advanced processing solutions. Hadoop, utilizing its MapReduce paradigm, provides scalable and fault-tolerant storage, whereas Spark, built upon Hadoop, introduces in-memory processing to increase speed and flexibility. This study includes a detailed examination of their …
Published in Recent Trends in Parallel Computing · Vol. 11, Issue 3, 2024 · pp. 15–23 Read article
-
Big Data Tools: A Survey
Abstract: AbstractNowadays, a large volume of data is generated in the form of text, voice, video, images, and sound. It is a very challenging job to handle and to get processed these different types of data. It is a very laborious process to analyze big data by using traditional data processing applications. Due to huge scattered file systems, a big data analysis is a difficult task. So, to analyze big data, …
Published in E-Commerce for Future & Trends · Vol. 7, Issue 3, 2020 · pp. 23–34 Read article
-
Effects of Cluster Computing on Big Data Analysis and Network Topology
Abstract: The rapid expansion of big data has posed substantial difficulties for conventional computing systems. As a result, cluster computing has grown to be a potent method for effective large data processing. Cluster computing involves multiple interconnected nodes functioning as a unified system, pooling together their processing, storage, and memory resources. These nodes are typically connected through high-speed networks such as ethernet or InfiniBand, facilitating efficient data sharing and communication among …
Published in International Journal of Algorithms Design and Analysis Review · Vol. 1, Issue 1, 2023 · pp. 31–39 Read article
-
Python's Applications in the Profession of Data Science
Abstract: Because of its ease of use, adaptability, and huge ecosystem of libraries, Python has become one of the most influential programming languages in the field of data science. Python is highly valued for its straightforward and versatile nature. This study delves into its various uses in data science, including tasks like data preprocessing, exploratory data analysis (EDA), statistical modeling, machine learning, and creating visualizations. Libraries like Pandas and NumPy make …
Published in International Journal of Data Structure Studies · Vol. 3, Issue 1, 2025 · pp. 23–30 Read article
-
Challenges in Parallel Computing for Big Data Analytics
Abstract: The integration of parallel computing into the realm of big data analytics promises accelerated processing speeds and enhanced scalability, but it is not without its formidable challenges. This study explores the multifaceted hurdles faced in the pursuit of efficient parallel processing for large-scale data analytics. The intricate task of distributing and partitioning massive datasets across multiple processing units demands adept strategies to ensure equitable workloads. Load balancing emerges as a …
Published in Recent Trends in Parallel Computing · Vol. 11, Issue 1, 2024 · pp. 1–6 Read article
-
Review Paper on Platform for Big Data Analytics as a Service with Stock Market Prediction and Analysis
Abstract: Petabyte-scale data is referred to as big data. The sum of the data in this quantity, which includes audio files, image files, and many more. Due to the unstructured nature of the data, it is challenging to evaluate the information that is gathered from it. As a result of social networking and cloud computing, data has significantly increased. It is therefore difficult to assess, process, and store. Big data processing …
Published in Journal of Advanced Database Management & Systems · Vol. 10, Issue 1, 2023 · pp. 1–5 Read article
-
Developing Intelligent Business Solutions Using Big Data
Abstract: Different types of industries and organizations are generating a large volume of data (known as big data). Analysis of such data has the potential to provide meaningful business insights and can be used to make various business decisions. However, the extraction of meaningful information from big data is not an easy task as it comes with different types of challenges. Production of actionable information and profitable decisions from big data …
Published in Journal of Software Engineering Tools & Technology Trends · Vol. 7, Issue 1, 2020 · pp. 12–17 Read article