Search
88 articles for “Deep Q-Network”
-
Deep Reinforcement Learning-Based Intelligent Energy Management Strategy for Battery–Supercapacitor Hybrid Energy Storage Systems in Electric Vehicles
Abstract: As the number of EVs increases, smart solutions for energy management are needed that will optimize energy use, prolong battery life and boost vehicle performance. The application of conventional rule based and optimization-based Energy Management Strategies (EMS) for Battery–Supercapacitor Hybrid Energy Storage Systems (HESS) often leads to sub-optimal power management, supercapacitor mismatch and battery degradation when subjected to varying driving conditions. This study aims to design an intelligent energy management …
Published in International Journal of Advanced Control and System Engineering · Vol. 4, Issue 2, 2026 Read article
-
Advancements in Reinforcement Learning: A Comprehensive Analysis of Algorithms, Applications, and Future Directions in Artificial Intelligence
Abstract: This work provides an overview of Reinforcement Learning (RL), an important field of artificial intelligence (AI) aims to provide the long-term benefits by learning a relating with a given environment. It spells out everything, what agents and environments do, to how rewards, states, and behaviours. It spent lot of time on looking the most usable RL algorithms, like DQN, SARSA, and Q-Learning. These studies provide a clear view of RL. …
Published in E-Commerce for Future & Trends · Vol. 11, Issue 1, 2024 · pp. 17–22 Read article
-
Path Planning using DDPG Algorithm and Univector Field Method for Intelligent Mobile Robot
Abstract: Path planning is one of the most fundamental challenging tasks in robotics and its purpose is to lead the robot from the initial position to the goal without any collision through the optimal route. With the rapid development of artificial intelligence technology, AI has been widely studied for robot path planning and a method by deep reinforcement learning (DRL) was proposed. In general, path planning methods with DRL need discrete …
Published in International Journal of Advanced Robotics and Automation Technology · Vol. 2, Issue 2, 2024 · pp. 1–9 Read article
-
Machine Learning Based Optimization of Polymer Structure Property Relationships in Composite Material Systems
Abstract: In modern engineering applications, polymer-based composite materials have garnered a lot of attention because of their lightweight nature, high strength-to-weight ratio, and changing physical features. In order to maximize the relationships between polymer structure and properties in composite materials, this study suggests a strategy based on reinforcement learning (RL). The research utilized the Polymer Composite Properties Dataset, which contains 12,700 records associated with polymer matrices, reinforcement fillers, interfacial bonding characteristics, …
Published in Journal of Polymer & Composites · Vol. 14, Issue 3, 2026 · pp. 242–255 Read article
-
State of the Art: A Pandemic Big HealthCare Analytics Solution: Image Data Classification Using Quantum MAML
Abstract: The modern age is facing many pandemic healthcare problems, e.g., covid 19, infections, inflammations, and many more, leading to critical, deadly situations. Survival rate can be increased with proper diagnosis of such data. We have proposed one of the implementations based on a medical image dataset for classification using deep reinforcement learning (RL) with quantum computing. Deep RL is the combination of DL (deep learning), generative adversarial network (GAN), and …
Published in Research and Reviews : A Journal of Medical Science and Technology · Vol. 14, Issue 2, 2024 · pp. 1–9 Read article
-
A Study of DCGAN-Based Generative Models for Anime Character Face Generation
Abstract: Artificial intelligence, or AI, has in recent years moved from simple rule-based systems to models that are now fully capable of creative content generation and are referred to as generative AI. One such approach for content generation, introduced in the year 2014, is called generative adversarial networks (GANs), which consists of training a generator to create fake content that tries to mimic real content as closely as possible and a …
Published in Journal of Multimedia Technology & Recent Advancements · Vol. 13, Issue 1, 2026 · pp. 31–41 Read article
-
Design and Development of Agrobot Using Feed Forward Network for Smart Farming Agriculture
Abstract: The Agrobot framework is a form of natural language processing that requires training to understand human language and meet user needs accordingly. The development of a chatbot tailored for the agricultural industry represents a significant advancement in agricultural technology. This chatbot serves as an interactive tool to assist farmers in various aspects of agricultural practices, including crop management, pest control, weather forecasting, and market information. The main objective of this …
Published in Journal of Advancements in Robotics · Vol. 11, Issue 1, 2024 · pp. 6–14 Read article
-
Quasar: Quantum-Accelerated Sustainable Anomaly Recognition in Climate Systems
Abstract: Accurate detection of climate anomalies is vital for disaster alleviation and policy making in a sustainable manner, but customary detection methods face the challenges of computational inefficiency and physical inconsistency. In this study, we propose a novel approach called Quantum-Optimized Fuzzy Physics-Informed Neural Networks (QFuzzy-PINNs), which integrates quantum computing, fuzzy logic, and physics-informed deep learning. As a first step, we employ quantum annealing for conventional optimization to adjust multiple Gaussian …
Published in International Journal of Climate Conditions · Vol. 2, Issue 2, 2025 · pp. 18–27 Read article
-
Statistical Modeling for Weld Quality Assessment using AI SAW Welding of Mild Steel
Abstract: The main issue to the industries that apply Submerged Arc Welding (SAW) is quality assurance since the structural integrity dictates safety and the performance of the industry. The existing system of checking manuals is not only time consuming but also has human errors that make it mandatory to deploy automated intelligent systems. This study carries out an extensive comparison of the leading approaches based on the use of Artificial Intelligence …
Published in Journal of Polymer & Composites · Vol. 14, Issue 2, 2026 · pp. 892–907 Read article
-
Classification and Detection of Brain Tumor using Convolutional Neural Network
Abstract: Tumors are masses created when brain cells multiply uncontrollably. A brain tumor is the medical term for this condition. Brain tumors are a serious and aggressive disease that can lead to a reduced life expectancy. Developing a treatment plan is essential to raising a patient's standard of living. Tumors in different regions of the body are evaluated using a variety of imaging techniques, with MRI pictures being utilized mostly for …
Published in International Journal of Cheminformatics · Vol. 1, Issue 1, 2023 · pp. 8–13 Read article
-
AI for Cybersecurity: Deploying Machine Learning for Network Traffic Anomaly Detection
Abstract: The growing sophistication of cyberattacks and the growth of network traffic necessitate sophisticated anomaly detection methods. This study overviews the use of artificial intelligence (AI) and machine learning (ML) to counter these challenges, as noted in current studies. It analyses supervised learning (SVM, Decision Trees), unsupervised learning (K-means, DBSCAN), and deep learning (CNNs, RNNs, Auto-encoders) approaches, considering their strengths and weaknesses. The research integrates current developments in AI/ML-based network anomaly …
Published in International Journal of Computer Science Languages · Vol. 3, Issue 2, 2025 · pp. 1–10 Read article
-
Hybrid Approach for Community Detection Using Deep Learning Techniques
Abstract: Community detection in complex networks is a fundamental problem with applications across diverse domains, ranging from social networks to biological systems and beyond. Traditional methods based on graph theory have been widely used for identifying communities within networks. However, the intricate and evolving nature of modern networks demands more sophisticated approaches. This research work proposes a hybrid approach that combines the strengths of deep learning techniques with traditional community detection …
Published in Recent Trends in Electronics Communication Systems · Vol. 11, Issue 3, 2024 · pp. 18–26 Read article
-
AI-Driven Prediction of Square-Hole Laser Trepanning Performance in AA7075/15%SiC/15% Glass Fiber Hybrid Composites Using Taguchi–ANOVA and Deep Neural Networks
Abstract: Hybrid AA7075 composites reinforced with 15% silicon carbide (SiC) and 15% glass fiber were fabricated via the stir casting technique to improve machining and structural performance. The addition of dual reinforcements into the aluminum matrix was aimed at enhancing hardness, thermal stability, and surface quality during non-traditional drilling operations. Square-hole drilling was performed using a laser trepanning process, and the key responses—hole size accuracy, surface roughness, and taper angle—were systematically …
Published in Journal of Polymer & Composites · Vol. 14, Issue 1, 2026 · pp. 1932–1943 Read article
-
Pneumonia Detection and Classification Using Deep Learning
Abstract: Pneumonia, an infectious lung disease primarily caused by bacteria, often exacerbated by environmental factors, leads to the accumulation of pus in the lung’s alveoli. Accurate diagnosis through chest X-rays, ultrasounds, or lung biopsies is crucial to avoid misdiagnosis and ensure proper treatment, crucial for patients’ quality of life. Diagnostic capacities have been greatly improved by deep learning advances, especially with convolutional neural networks (CNNs). This research presents a robust CNN-based …
Published in Journal of Microwave Engineering and Technologies · Vol. 11, Issue 3, 2024 · pp. 9–19 Read article
-
Accelerating Unsupervised Feature Learning: Parallelized Training of Denoising Autoencoders
Abstract: Unsupervised representation learning has become a cornerstone of contemporary machine learning, enabling algorithms to extract informative features from un-labelled, high-dimensional data. This work investigates the efficacy of stacked denoising autoencoders (SDAEs) trained via parallelized stochastic gradient descent (SGD) as a scalable approach to feature extraction. By strategically leveraging multi-threaded computation, our study systematically examines the trade-offs between increased parallelism, training efficiency, and the preservation of model accuracy. Experiments on the …
Published in Journal of Image Processing & Pattern Recognition Progress · Vol. 12, Issue 3, 2025 · pp. 56–64 Read article
-
ML Model Comparison for Sentiment Analysis Across Diverse Datasets
Abstract: Analyzing sentiment is crucial for understanding public opinion on various issues in marketing, politics, and social sciences. This study compares the performance of seven different machine learning algorithms for sentiment classification, focusing on their effectiveness, accuracy, and complexity. The research is conducted on a pre-processed dataset with balanced text samples, utilizing feature extraction methods such as Term Frequency-Inverse Document Frequency (TF-IDF). The performance assessment criteria consist of accuracy, precision, recall, …
Published in Journal of Operating Systems Development & Trends · Vol. 12, Issue 2, 2025 · pp. 26–33 Read article
-
Digital Transformation of Urban Infrastructure with the Help of AI Guardians
Abstract: The construction industry continues to face challenges related to quality control, safety protocols, and meeting project deadlines. These issues often result in significant cost overruns and project delays. Traditional inspection and site management approaches rely heavily on manual work and individual judgment. As a result, human errors can easily occur, and these methods provide only limited snapshots of site conditions over time. This paper presents a comprehensive framework that uses …
Published in Recent Trends in Civil Engineering & Technology · Vol. 16, Issue 1, 2026 · pp. 16–25 Read article
-
The Evolution and Impact of Numbers: From Ancient Tallies to Quantum Computing: Review Article on Numbers
Abstract: Numbers are among the most fundamental constructs in human civilization, serving as the backbone of mathematics, science, technology, and virtually every aspect of daily life. They represent not only quantities and measures but also relationships, structures, and patterns that underpin the fabric of human understanding. From the earliest tallies etched on bones by prehistoric humans to the sophisticated numerical systems embedded in today’s artificial intelligence and quantum computing, the evolution …
Published in Research & Reviews: Discrete Mathematical Structures · Vol. 12, Issue 3, 2025 · pp. 15–19 Read article
-
Matching Minutiae Fingerprint Q-Learning Approach for Detail Coordination: Identifiable Mark Point
Abstract: The use of fingerprints for high-precision recognition and identification of people is one of the most reliable biometric symbols because it is non-invasive. In this paper, we propose an innovative approach to detect details on low contrast resolution image quality of fingerprint images. Existing algorithms are not very susceptible to sound and image excellence due to the lack of level of intensity. We recommend a reliable route to find fingerprints …
Published in International Journal of Information Security Engineering · Vol. 1, Issue 1, 2023 · pp. 1–15 Read article
-
Routing Protocols in FANETs with Future Enhancements
Abstract: Flying Ad Hoc Networks (FANETs), which are swarms of Unmanned Aerial Vehicles (UAVs), are an emerging solution which revolutionized the area of mission-critical and infrastructure-less communication systems. These networks provide real-time data transfer for use cases such as disaster relief, battlefield observation, environmental monitoring, and 6G-based smart cities. However, the dynamic profile of FANETs, which is defined by high 3D mobility, limited energy resources, unstable wireless links, and constant topology …
Published in Journal of Aerospace Engineering & Technology · Vol. 15, Issue 3, 2025 · pp. 8–13 Read article