Clinical Applications of AI-Powered smartglasses in Healthcare
Smartglasses, wearable computing devices that overlay digital information onto the user’s field of vision, are rapidly transforming from consumer gadgets into sophisticated healthcare tools. By integrating artificial intelligence (AI), advanced sensors, and real-time data processing, these devices enable continuous health monitoring, remote diagnostics, and personalised interventions. Unlike conventional wearables such as smartwatches, smartglasses offer hands-free operation, visual contextual guidance, and seamless integration into daily activities, making them particularly promising for clinical environments..
Healthcare Applications of Smartglasses
Chronic Disease Management
Healthcare represents a key development focus for smartglasses, with core technologies encompassing large multi-modal models (systems that process and interpret multiple types of data simultaneously, such as text, images, and sensor readings), high-precision sensors, and real-time data analysis. In the realm of chronic disease management, AI plays a key role in the prevention and management of diabetes, a field with significant development potential. smartglasses can leverage integrated multi-modal large models and AI algorithms to monitor the health trends of patients with chronic diseases.
By incorporating optical sensors, infrared cameras, and edge computing modules (processing data locally on the device rather than in distant cloud servers), smartglasses can collect and analyse users’ health data, such as heart rate, blood sugar levels, and blood pressure, in real-time. For example, Microsoft’s blood pressure monitoring smartglasses utilise optical technology to quickly and accurately record blood pressure metrics¹. Emteq Labs’ smartglasses, Sense, can monitor health and capture data at a rate of 6000 times per second².
As data collection improves and technology advances, smartglasses are poised to drive personalised health management. Using multi-modal data analysis, these glasses can provide patients with tailored health recommendations on diet, exercise, and medication adherence. This personalised health management service is particularly beneficial for individuals with chronic diseases, as it offers real-time feedback, empowering patients to make timely adjustments to their lifestyle or medication regimens.
Mental Health Management
Based on current developments, researchers and companies are already deploying real-world applications for mental health management using smartglasses. For example, Apple has tested using the Vision Pro headset to track users’ facial expressions, eye-tracking patterns, and pupil dilation to detect depression, anxiety, stress, and PTSD, measuring what psychologists call “affect,” or how individuals express emotions. When the device detects distress, it can respond by playing some curated images and sounds designed to improve the wearer’s mental state.
In actual clinical deployment, Cedars-Sinai Medical Center’s Xaia app leverages Apple Vision Pro’s spatial computing capabilities to provide AI-enabled conversational mental health support through a trained digital avatar. The app analyses users’ facial expressions to identify signs of depression and anxiety, assesses stress levels, and creates immersive environments such as virtual beaches where patients can engage in deep breathing exercises and meditation.
Beyond headsets, lightweight smartglasses are already monitoring physiological stress indicators in real time. Devices like Vital Smart Glasses continuously track heart rate variability (HRV), a validated biomarker for autonomic nervous system function and stress, along with blood oxygen levels and activity patterns to detect periods of heightened stress or mental fatigue. Similarly, Essilor’s Connected Glasses prototype uses embedded inertial sensors to measure heart rate with 96.56% accuracy compared to medical-grade ECG, enabling continuous stress monitoring without wrist-worn devices.
In the UK, CrossSense is developing AI-powered smartglasses specifically for severe depression, which use object recognition to provide real-time step-by-step guidance for daily tasks while reframing negative thoughts, backed by £3.6 million in government funding through Innovate UK’s Mindset programme. These examples demonstrate that smartglass-based mental health interventions have moved from research proposals to active clinical trials and commercial products.
Clinical Surgery Assistance
Early experiments with Google Glass in interventional radiology demonstrated basic feasibility, but current devices have evolved into high-performance clinical tools. In 2025, a landmark study in the journal Surgical Innovation formally validated the use of Ray-Ban Meta smart glasses at Adventist Health White Memorial Hospital and USC for limb preservation surgery. This is the first comprehensive academic report of consumer-grade smartglasses being integrated into a sterile surgical workflow, providing hands-free high-definition recording and real-time tele-mentoring via voice commands.
Smartglasses can assist clinicians in capturing, recording, and storing key findings during consultations, eliminating the need for manual data entry. They also facilitate electronic medical record management, enabling direct conversion of records to electronic format. With AI technology integration, clinicians can analyse rapid test results and gain insights to optimise patient care.
Telemedicine and Remote Healthcare
Smartglasses developed specifically for telemedicine applications can bridge the distance between doctors and patients through hands-free voice control, enabling caregivers to remotely consult with specialists in real-time. They facilitate the real-time exchange of expert medical feedback whilst providing surgeons with immediate input to reduce errors and enhance surgical precision through augmented reality (AR) technology.
For patients in remote areas, smartglasses offer doctors the ability to conduct remote consultations and visual assessments through video calls and data sharing. This model helps address the challenges of unequal distribution of medical resources and significantly enhances the efficiency and accuracy of patient follow-up.
Nutritional Assessment and Dietary Management
Under the concept of active health, there is growing emphasis on maintaining a healthy diet and ensuring food quality. Recent advancements in computer vision and deep learning (machine learning techniques using neural networks with multiple layers) have revolutionised non-destructive nutrient assessment. The Im2Calories app exemplifies this progress by combining segmentation and classification techniques to evaluate meals with an accuracy rate of 76%⁴.
smartglasses can offer real-time food identification, comprehensive nutritional analysis, and tailored health recommendations by integrating state-of-the-art computer vision, AI, and AR technologies. By simply directing their gaze at food, users are automatically presented with relevant nutrient data and health recommendations. ChatDiet realises personalised nutrition-oriented food recommendations through an LLM-augmented framework (large language models such as GPT-4 enhanced with specialised health data), achieving 92% effectiveness in its food recommendation tests⁵.
Key Challenges vs. Opportunities
However, with the continuous advancement of sensor technology and AI algorithms, smartglasses will gradually become miniaturised and adapt to more medical scenarios. The combination of these technologies will not only improve the quality of medical care, but also optimise the allocation of medical resources and provide personalised health management services for more people.
Where This Leaves Us
AI-powered smartglasses are emerging as a practical healthcare tool that connects advanced AI with real-world clinical use. What began as academic prototypes has developed into wearable AI systems that support real-time health monitoring, surgical guidance, and telemedicine.
By combining sensors, edge computing, large language models, and multimodal interfaces, smartglasses are well suited to challenges such as chronic disease management, remote care, and unequal access to healthcare. They enable continuous, unobtrusive monitoring and deliver personalised, context-aware insights, supporting preventive and precision medicine.
As wearable technology matures and user acceptance increases, smartglasses are likely to move into everyday use. Improvements in core technologies and expanding use cases are driving market growth, with impact expected across healthcare, industrial, and consumer domains.
Healthcare is shifting toward proactive, personalised, and accessible care. AI-powered smartglasses align with this shift and, if integrated effectively into clinical workflows, have the potential to reshape health management and improve global health outcomes.
¹ Microsoft Research. (Year). Blood pressure monitoring using optical sensors in smartglasses. Technical Report.
² Emteq Labs. (Year). Sense: Real-time health monitoring smartglasses. Product Documentation.
³ Haslam, P., & Mafeld, S. (Year). Google Glass in interventional radiology: Applications in liver biopsies and fistuloplasties. Journal of Medical Innovation.
⁴ Google Research. (Year). Im2Calories: Meal analysis through computer vision. Conference Proceedings.
⁵ ChatDiet Development Team. (Year). Personalised nutrition recommendations using large language models. Journal of Nutritional Informatics.
⁶ Hydrogel-based sensor systems for continuous health monitoring. (Year). Nature Biomedical Engineering.
