Search
2 articles for “web scraping”
-
Webpage Extraction and Retrieval Chatbot
Abstract: Web scraping is a fundamental technique for automating data extraction in big data applications. While multiple implementations exist, few leverage Python’s Beautiful Soup library for efficient and structured data retrieval. This project aims to develop a web scraper and retrieval system that extracts relevant information from web pages, stores it in a vector database (Milvus), and enables intelligent querying using semantic search and generative AI. The system is designed to …
Published in International Journal of Satellite Remote Sensing · Vol. 3, Issue 2, 2025 · pp. 1–7 Read article
-
LLM-based Chatbot for Course-based Question Answering
Abstract: The “LLM-based Chatbot for Course-Based Question Answering” project addresses the pressing need for tailored and efficient learning tools in education. By using a state-of-the-art Large Language Model (LLM) with a diverse dataset, including textbooks, professor slides, and web scraping data, the chatbot offers accurate and contextually enriched responses to students' course-related queries. Using recent advances in language modeling, this work presents a Longformer-based Language Model (LLM) for constructing a smart …
Published in International Journal of Electronics Automation · Vol. 1, Issue 2, 2023 · pp. 30–41 Read article