International Journal on Science and Technology

E-ISSN: 2229-7677     Impact Factor: 9.88

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Call for Paper Volume 16 Issue 2 April-June 2025 Submit your research before last 3 days of June to publish your research paper in the issue of April-June.

Locally Deployed NLP System for Secure Document Summarization and Context-Aware Question Answering Using LLMs and Vector Embeddings.

Author(s) Rama Krishna Pradhana, Durga Pavan Seerapu, Gayatri Routhu, Sarath Kumar Manda, Giri Rajasekhar Jami
Country India
Abstract This paper presents a locally deployed Natural Language Processing (NLP) system designed to perform secure document summarization and context-aware question answering. The proposed framework addresses critical concerns related to data privacy by eliminating dependence on external APIs or cloud-based services. By leveraging advanced Large Language Models (LLMs), vector databases, and modern NLP tools such as LangChain, Hugging Face, Qdrant, and Streamlit, the system enables users to interact intelligently with unstructured documents in a fully offline environment. The architecture facilitates efficient document parsing, semantic embedding, and retrieval-augmented generation (RAG), empowering users to generate concise summaries and retrieve precise information through natural language queries. This solution is particularly well-suited for privacy-sensitive domains such as healthcare, law, finance, and research, where local data control and confidentiality are essential. The framework not only enhances document comprehension but also promotes efficient information retrieval and workflow automation
Keywords Natural Language Processing, Text Summarization, Local Deployment, Semantic Search, Retrieval-Augmented Generation (RAG), Large Language Models, Qdrant, LangChain, HuggingFace, Streamlit
Field Engineering
Published In Volume 16, Issue 2, April-June 2025
Published On 2025-05-01
Cite This Locally Deployed NLP System for Secure Document Summarization and Context-Aware Question Answering Using LLMs and Vector Embeddings. - Rama Krishna Pradhana, Durga Pavan Seerapu, Gayatri Routhu, Sarath Kumar Manda, Giri Rajasekhar Jami - IJSAT Volume 16, Issue 2, April-June 2025. DOI 10.71097/IJSAT.v16.i2.4275
DOI https://doi.org/10.71097/IJSAT.v16.i2.4275
Short DOI https://doi.org/g9g7zv

Share this