The global COVID-19 pandemic has introduced massive changes in both need and availability of telemedicine and telehealth services. Physicians have increased their use of telemedicine to care for individuals and populations who have difficulty accessing care because of geography, lack of available trained practitioners, or health limitations. If we can provide an application which would help in handling mental fitness, heart-rate monitoring and also a smart chatbot to be aware of symptoms and diseases and doctors needed to consult, then it would be highly beneficiary to the generation especially in this pandemic world. The motivation behind this idea was driven by wellness for the entire society in these times. People fret about their pulse or heartrate considering as a symptom for COVID, they suffer from anxiety or depression. They are unaware or worried about what symptoms would prompt what disease and which doctor to consult. Also a medical platform to order medicines online through a voice based chatbot would benefit the older generation as well. Hence, our application MEDBAY comes to the rescue providing a one stop for all.
MAJOR TOOLS USED
Weavy Django RASA NLU HTML, CSS, JavaScript Machine Learning Algorithms Random Forest, Naïve Bayes Classifier Deep Learning Posture Detection Algorithms FFT and Band filtering techniques NLP Sentiment Analysis Model GTTS module, STRIPE, celery, Google Geolocation Python ML,DL libraries Bootstrap, Ajax, jQuery etc.
Major Features
Dashboard for Patient and Doctor with Weavy Tasks, Files, Recent Activities and Chat
Patient Dashboard containing analytics of total test prices, patient visits, visit reviews, recovery rates and graphical analytics based on medical test expenses, visits and recovery ratio.
Doctor Dashboard containing counts and percentages for total income, total patients, reviews, growth and graphical analytics of income, patients and satisfaction ratio.
Both dashboard contains Weavy based Task Manager where tasks can be added, updated, starred or deleted.
Dashboards containing recent activity sections linked across all users!
File Section integrated for both patient and doctor dashboard using Weavy file service - enabling to create or attach files essential to upcoming visits or treatments.
Real time chat section integrated for user-friendly and easy doctor patient communication.
Microsoft teams in-app video conferencing section integrated into the chat portal to enable setup virtual visits or checkups from within the app itself.
Functions
WORKOUT PLANNER AND MONITOR
In our application we have a workout planner that gives you a set of exercises, shows you how to do them and then checks if you are doing them correctly. Our posture detection system will check if you are doing correctly and when the set count gets over, it moves on to the next exercise.
HEART RATE MONITORING SYSTEM
Our application has an unique heart rate monitoring system, which is a non-contact based system to measure Heart Rate using real-time application using camera. Heart Rate (HR) is one of the most important Physiological parameter and a vital indicator of people‘s physiological state. The main principle is to extract heart rate information from facial skin color variation caused by blood circulation to monitor the user’s‘ physiological state Detect face, align and get ROI using facial landmarks Apply band pass filter with fl = 0.8 Hz and fh = 3 Hz, which are 48 and 180 bpm respectively Average color value of ROI in each frame is calculate pushed to a data buffer which is 150 in length FFT the data buffer. The highest peak is Heart rate Amplify color to make the color variation visible
AI DIET PLANNER
There is a diet planner in our application, which helps our end-users get a customized diet plan for them. There are two part, one which takes in basic user details for profile building, which later will be utilized to connect other users with the similar likes and disliked and they can share their weekly diet plans and commencements. The second part takes in all important metrics like the person’s favorite food, diet, cuisines, nutrients he/she wants their diet to be comprised of, and also about any past medical history or diseases they suffer from. All these inputs are fed into our ML model which accurately forms a diet planner for the user, listing out all the meals with their nutrient value and ratings to the user. Using celery running in the background, the diet planner refreshed weekly giving a diversified option to the users.
REALTIME GROUP YOGA POSTURE MONITORING SYSTEM
In these difficult times, mental as well as physical health need to be looked into. Hence, our application is at the service with a yoga monitoring system, where multiplayers can join and share their video and audio. A particular yoga posture would be displayed to the users at a time, and the users have to do yoga as displayed in the posture. Our posture detection system would run in the background for each user and score them real-time based on their accurate performance, and finally declare a winner in the end. Thus physical health is monitored as well mental health is maintained by social connection in this unique effort.
DEPRESSION CHATBOT
In today’s pandemic situation, when everyone is at home, mental health has become an even more important thing to focus on. That is why our application comes with a depression chatbot which serves as the patient’s listener in these time of crisis. And using our NLP Sentiment analysis models trained in the backend on TensorFlow, it supports and cheers the person up person based on all the conditions they have mentioned. It suggests some appropriate quotes about life, love and family. It also suggests some songs that can uplift user moods and help get over the hard times. Hence, it reduces the mental stress or worry a person goes through especially on low days.
WORKOUT PLANNER AND POSTURE DETECTOR
In today’s pandemic situation, when everyone is at home, physical health has also become an important aspect to focus on. Thus our workout planner comes with a posture detector where certain exercise poses are taught to the user, and they have to try their best to attain that pose. There is a unique timer attached with each pose maintaining the exercise duration which has to be completed before going to the next exercise. There is also a scoring system based on the posture detection system running in real-time in the background.
MEDICAL CHATBOT
The application comes with a chatbot MEDBOT, which serves as the patient’s listener in these time of crisis. Any person can chat with our chatbot describing about their current state of body and what they are suffering from, mental or physical. Our chatbot comes to their assist, asks them counter questions about their exact symptoms or feelings they are undergoing. And using ML and NLP models trained in the backend, it predicts the disease for the person based on all the symptoms they have mentioned. Our chatbot also predicts type of doctor to consult for the disease. Hence, it reduces the hassle or worry a person goes through while thinking about which hospital or which doctor to consult for his symptoms.
MEDICAL TEST COMPARISON
There is often a variety of prices for medical tests offered by different hospitals. People are confused and do not get a clear comparison statistic of the medical tests. Hence, MEDBAY has a unique section in the patient portal where users can search for their desired medical test. It would enlist all the hospitals where the tests are available and lists them in increasing order of price. Thus, users can get a clearer insight.
PHARMACEUTICAL STORE MEDBAY
has a linked up pharmacy store where, allopathy, homeopathy as well as ayurvedic medicines are available and any user can buy from. It has integrated STRIPE payment gateway for smooth checkout. It has home delivery system which would really help the older generation. It connects medicine from local pharmacy stores based on geolocation, hence reducing the delivery price to minimum.
