Varun Ranganathan, MCOptom

Clinical Optometrist

An OCULAR Interface Exclusive

Synopsis:

Smart glasses and augmented reality (AR) powered by Artificial Intelligence (AI) are offering innovative solutions for both patients and professionals. From assisting visually impaired individuals with object recognition and voice-guided navigation to enhancing eye surgeries with real-time data overlays, these technologies are reshaping eye care. This blog explores how AI-driven smart glasses are improving vision, reducing eye strain, and paving the way for a more accessible future in eye care.

Introduction

Over the last decade, there has been significant improvement in using Augmented Reality (AR) in several mainstream fields like automotive industries, healthcare, gaming, production, and tourism. In the recent past AR technology has been paired with headsets which offer immersive experience of the surrounding environment. These headsets are now being replaced by smart glasses making them less cumbersome and more discreet.

How it works

The main sub-field of AI used in smart glasses is Computer Vision (CV). It allows smart glasses to capture and interpret objects gestures and surroundings. ¹ This is achieved by using cameras, sensors, and AI algorithms. The algorithms are trained on vast amounts of data to recognise specific objects and even categorise them.

In addition to CV, these smart glasses also use Natural Language Processing (NLP) which can interpret and respond to natural language commands and improves user’s experience.

AR technology can vastly change the way we view and perceive the world. It can modify the user’s environment by superimposing it with virtual elements such as images, video, and text. In eye care, smart glasses will be extremely helpful for people who are blind or visually impaired. Real-time object recognition allows users to amplify the visual captured by the camera and they can also translate the visual world into auditory descriptions. ² Object recognition can go a step further by recognising people’s faces ³ but the faces will have to be in the algorithm’s database. Though this feature will be helpful in assisting the blind, it can pose significant security and privacy challenges and these need to be addressed before it can be implemented.

Navigation assistance uses Global Positioning System (GPS) and obstacle detection with CV and helps users to safely navigate both indoor and outdoor environments even in unfamiliar places. ⁴

Optical Character Recognition (OCR) is a technology by which the glasses can convert text into a machine-readable format. If the text is too small for the visually impaired to see, the glasses can display in an AR format which can be magnified. Text To Speech (TTS) can convert written text to auditory descriptions. ⁵

In addition to AR technology, smart glasses can also adjust contrast and colour settings to further help the visually impaired. Children with dyslexia and Attention-Deficit Hyperactive Disorder (ADHD) can also make use of coloured overlays which can help them with schoolwork. ⁶ Integrating smart glasses with mobile phones can enhance its capabilities. Accessing popular applications and social media can be performed seamlessly by connecting to mobile phones through Bluetooth. Through AR technology, digital overlays can help visually impaired lead normal lives.

Future of smart glasses

Ocular biosensors are gradually but surely turning heads in non-invasive detection of systemic and ocular conditions. When integrated with smart glasses, these biosensors can constantly collect data from the eyes and provide regular health monitoring and diagnosis and provide more possibilities for the innovative development of wearable devices in medical and health management. ⁷

References:

1. Spandonidis, C. C., Spyropoulos, D., Galiatsatos, N., Giannopoulos, F., & Karageorgiou, D. (2021). Design of smart glasses that enable computer vision for the improvement of autonomy of the visually impaired. Prisma Electronics S.A.
2. Ali Abdolrahmani, Maya Howes Gupta, Mei-Lian Vader, Ravi Kuber, and Stacy Branham. 2021. Towards More Transactional Voice Assistants: Investigating the Potential for a Multimodal Voice-Activated Indoor Navigation Assistant for Blind and Sighted Travelers. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1-16.
3. Ali Abdolrahmani, Kevin M Storer, Antony Rishin Mukkath Roy, Ravi Kuber, and Stacy M Branham. 2020. Blind leading the sighted: drawing design insights from blind users towards more productivity-oriented voice interfaces. ACM Transactions on Accessible Computing (TACCESS) 12, 4 (2020), 1-35.
4. Ravi Gorapudi, Puvvula Priya Darsini, Uddanti Naga Kavya, and Oggu Jaswanthi. 2020. Product label, obstacle, and sign boards detection for visually impaired people. In International Conference of Advance Research & Innovation (ICARI).
5. Jaejoon Kim. 2020. Application on character recognition system on road sign for visually impaired: Case study approach and future. International Journal of Electrical and Computer Engineering (IJECE) 10, 1 (2020), 778—785.
6. Gao L, Wang C, Wu G. Wearable Biosensor Smart Glasses Based on Augmented Reality and Eye Tracking. Sensors (Basel). 2024 Oct 20;24(20):6740. doi: 10.3390/s24206740. PMID: 39460220; PMCID: PMC11511461.
7. Maresca G, Leonardi S, De Cola MC, Giliberto S, Di Cara M, Corallo F, Quartarone A, Pidalà A. Use of Virtual Reality in Children with Dyslexia. Children (Basel). 2022 Oct 25;9(11):1621. doi: 10.3390/children9111621. PMID: 36360349; PMCID: PMC9688381.