Recent Trends in Parallel Computing
Volume 13, Issue 1 (2026)
Table of contents
-
Application of Proportional-Share with Punishment Principle for Resource Sharing in Parallel Computing Applications
Abstract: Efficient resource sharing is a cornerstone of high-performance parallel computing. While proportional-share scheduling has long been a foundational approach for distributing resources according to predefined weights, its effectiveness can be compromised by tasks that over-consume their allocated share, leading to system-wide performance degradation and unfairness. This review article investigates the application of the “Proportional-Share with Punishment” (PSWP) principle, a hybrid scheduling paradigm designed to address this challenge. PSWP integrates the …
Published in Recent Trends in Parallel Computing · Vol. 13, Issue 1, 2026 Read article
-
Design and Optimization of Domain-Specific Languages for High-Performance Computing Applications
Abstract: The accelerating demand for computational power in scientific, engineering, and data-intensive domains has driven High-Performance Computing (HPC) systems toward unprecedented levels of parallelism and architectural complexity. Contemporary HPC platforms integrate multicore CPUs, many-core GPUs, accelerators, and deep memory hierarchies, creating significant challenges for software development and performance optimization. Traditional general-purpose programming languages and parallel programming frameworks provide low-level control over hardware resources but require extensive manual tuning, resulting in poor …
Published in Recent Trends in Parallel Computing · Vol. 13, Issue 1, 2026 Read article
-
Parallel Privacy-Preserving Adaptive Federated Learning on GPU-Enabled Multi-Core Architectures
Abstract: The increasing deployment of parallel and distributed intelligent systems has intensified the need for privacy-preserving learning frameworks that can exploit multi-core and GPU-based architectures without centralizing sensitive data. This work proposes a parallel Adaptive Federated Learning (AFL) framework that integrates Differential Privacy and Secure Aggregation over heterogeneous multi-core and GPU platforms to enhance both data confidentiality and convergence efficiency. The framework dynamically adjusts client participation, learning rates, and aggregation weights …
Published in Recent Trends in Parallel Computing · Vol. 13, Issue 1, 2026 Read article
-
Adaptive Task Scheduling And Resource Optimization Using Ai Middleware
Abstract: Modern distributed and heterogeneous computing systems face significant challenges in dealing with dynamically changing workloads, resource fragmentation, and changing latencies; existing traditional, or rule-based, schedulers are no longer useful in achieving the best system performance. Such limitations highlight the importance of the adaptive scheduling paradigms that are able to learn, to forecast and reaction to the real red conditions in the system. The middleware of artificial-intelligence is also an attractive …
Published in Recent Trends in Parallel Computing · Vol. 13, Issue 1, 2026 Read article
-
A Reviewed Study On Cpu-Optimized Parameter-Efficient Fine- Tuning For Large Language Models To Increase Accuracy Using Lora
Abstract: The fast proliferation of Large Language Models (LLMs) has increased the need to optimize the process of fine-tuning but the existing workflows that require a GPU are still expensive, intensive, and unavailable to most researchers. This paper is driven by the desire to have a more cost-efficient and democratized version by examining a CPU-efficient implementation of Parameter-Efficient Fine-Tuning (PEFT) based on Low-Rank Adaptation (LoRA). The major purpose of the study …
Published in Recent Trends in Parallel Computing · Vol. 13, Issue 1, 2026 Read article