1 publication
-
Published Subscription Review Article
A Hierarchical Orchestration Framework for Parallelized Multi-Entity Web Ingestion and NoSQL SynchronizationBy Taufique Khan Asadulla Khan, Ankush D. Bambal, Kartik S. Kharabe, Sonali Nimbhorkar
Abstract: In the current EdTech sector, gathering structured data from various fragmented web portals is a major challenge for building reliable, real-time data systems. Standard sequential ETL (Extract, Transform, Load) pipelines often encounter significant bottlenecks, as a single failure in one module can halt the entire ingestion process. Furthermore, linear execution is often too slow to meet the demands for large, multi-category datasets. This paper presents a Modular Hierarchical Orchestration framework …
Published in Recent Trends in Parallel Computing · Vol. 13, Issue 2, 2026 · pp. 1–6 Read article →