Search

1 article for “parallel ETL”

• Published Subscription Review Article 5 Aug 2026

  A Hierarchical Orchestration Framework for Parallelized Multi-Entity Web Ingestion and NoSQL Synchronization

  By Taufique Khan Asadulla Khan, Ankush D. Bambal, Kartik S. Kharabe, Sonali Nimbhorkar

  Abstract: In the current EdTech sector, gathering structured data from various fragmented web portals is a major challenge for building reliable, real-time data systems. Standard sequential ETL (Extract, Transform, Load) pipelines often encounter significant bottlenecks, as a single failure in one module can halt the entire ingestion process. Furthermore, linear execution is often too slow to meet the demands for large, multi-category datasets. This paper presents a Modular Hierarchical Orchestration framework …

  Published in Recent Trends in Parallel Computing · Vol. 13, Issue 2, 2026 · pp. 1–6 Read article →