Voice-based AI Healthcare Assistant: Automating Forms, Inquiries, and Initial Diagnosis

The Voice-based AI Healthcare Assistant is an intelligent mobile application designed to simplify the initial stages of healthcare services by automating patient registration, answering medical queries, and providing preliminary diagnosis. The system allows patients to interact using their voice in Hindi or other regional languages, making healthcare more accessible for people with limited literacy or medical knowledge.

The project leverages Artificial Intelligence, Natural Language Processing (NLP), Machine Learning, and Large Language Models (LLMs) to understand patient information, automatically fill medical forms, analyze symptoms, and suggest an initial diagnosis. It also acts as a voice-based healthcare assistant that answers questions about medical tests, diseases, and the appropriate specialists to consult.

This solution aims to reduce the workload of healthcare professionals, improve patient experience, and enhance the efficiency of hospitals and clinics, especially in rural and underserved areas. By providing healthcare support in local languages, the project promotes faster, more accurate, and accessible medical services while contributing to better healthcare management and data-driven decision-making.

Scope: Healthcare, Natural Language Processing, Automatic Speech Recognition

Funding Agency: Council of Science & Technology, Uttar Pradesh, 2025

Amount: INR 7,72,000

Duration: 2 Years

Principal investigator: Dr. Sonia Khetarpaul

Co-principal investigator:  Dr. Suchi Kumari, Prof. Rajib Mall