Recent Trends in Parallel Computing
Volume 13, Issue 1 (2026)
Table of contents
-
Application of Proportional-Share with Punishment Principle for Resource Sharing in Parallel Computing Applications
Abstract: Efficient resource-sharing is a cornerstone of high-performance parallel computing. While proportional-share scheduling has long been a foundational approach for distributing resources according to predefined weights, its effectiveness can be compromised by tasks that over-consume their allocated share, leading to system-wide performance degradation and unfairness. This review article investigates the application of the “proportional-share with punishment” (PSWP) principle, a hybrid scheduling paradigm designed to address this challenge. PSWP integrates the flexibility …
Published in Recent Trends in Parallel Computing · Vol. 13, Issue 1, 2026 · pp. 01–08 Read article
-
Parallel Privacy-Preserving Adaptive Federated Learning on GPU-Enabled Multi-Core Architectures
Abstract: The increasing deployment of parallel and distributed intelligent systems has intensified the need for privacy-preserving learning frameworks that can exploit multi-core and graphics processing unit (GPU)-based architectures without centralizing sensitive data. This work proposes a parallel adaptive federated learning (AFL) framework that integrates differential privacy and secure aggregation over heterogeneous multi-core and GPU platforms to enhance both data confidentiality and convergence efficiency. The framework dynamically adjusts client participation, learning rates, …
Published in Recent Trends in Parallel Computing · Vol. 13, Issue 1, 2026 · pp. 09–16 Read article
-
Design and Optimization of Domain-Specific Languages for High-Performance Computing Applications
Abstract: The accelerating demand for computational power in scientific, engineering, and data-intensive domains has driven high-performance computing (HPC) systems toward unprecedented levels of parallelism and architectural complexity. Contemporary HPC platforms integrate multicore CPUs, many-core GPUs, accelerators, and deep memory hierarchies, creating significant challenges for software development and performance optimization. Traditional general-purpose programming languages and parallel programming frameworks provide low-level control over hardware resources but require extensive manual tuning, resulting in poor …
Published in Recent Trends in Parallel Computing · Vol. 13, Issue 1, 2026 · pp. 17–22 Read article
-
Adaptive Task Scheduling and Resource Optimization Using AI Middleware
Abstract: Modern distributed and heterogeneous computing systems face significant challenges in dealing with dynamically changing workloads, resource fragmentation, and changing latencies; existing traditional, or rule-based, specialized schedulers are no longer useful in achieving the best system performance. Such limitations highlight the importance of the adaptive scheduling paradigms that can learn, forecast, and react to the actual real-world conditions in the system. Artificial intelligence middleware is also an attractive solution to this …
Published in Recent Trends in Parallel Computing · Vol. 13, Issue 1, 2026 · pp. 23–31 Read article
-
A Review Study on CPU-Optimized Parameter-Efficient Fine-Tuning for Large Language Models to Increase Accuracy Using LoRA
Abstract: The fast proliferation of large language models (LLMs) has increased the need to optimize the process of fine-tuning, but the existing workflows that require a graphics processing unit (GPU) are still expensive, intensive, and unavailable to most researchers. This paper is driven by the desire to have a more cost-efficient and democratized version by examining a CPU-efficient implementation of parameter-efficient fine-tuning (PEFT) based on low-rank adaptation (LoRA). The major purpose …
Published in Recent Trends in Parallel Computing · Vol. 13, Issue 1, 2026 · pp. 32–38 Read article