Virtual reality cataract surgery simulation

Is Your Eye Surgery Skill Up to Par? How Virtual Reality Scoring Can Help

"Discover how human-based video scoring enhances virtual reality cataract surgery assessments, ensuring top-notch surgical skills."


Cataract surgery training is rapidly evolving, with virtual reality (VR) simulators becoming a crucial part of the learning process. These simulators offer a safe and standardized environment for surgeons to hone their skills before operating on real patients. But how do we accurately measure a surgeon's proficiency in a virtual setting?

A recent study from Lund University, Sweden, delves into this very question by comparing the internal computer-based scoring of the Eyesi surgical simulator with human-based video scoring. The goal was to determine which method better distinguishes between experienced cataract surgeons and those still in training.

The study highlights the importance of accurate assessment in surgical training and demonstrates how combining technology with expert human insight can lead to more effective evaluation methods.

AI Search Multiple angles on this topic

Why Skill Measurement Matters

Cataract surgery requires precise, repeatable technical performance, making objective assessment an important part of training. Virtual reality scoring may offer a structured way to track skills before trainees operate on real patients. However, the practical impact of such scoring depends on how accurately simulator performance reflects operating-room ability.

Simulation and Supervised Training

Cataract training commonly combines supervised surgery on actual patients with virtual reality simulation. The EyeSi and HelpMeSee (HMS) simulators were specifically designed for cataract surgery, but their training designs, purposes, and accessibility differ. A 2024 scoping review reported that virtual reality simulation appeared to support safer outcomes than supervised training on actual patients alone, while a systematic review found that 37 studies used an iteration of the EyeSi simulator and that methodologies varied widely, with few randomized trials.

From Operating Rooms to Simulators

Cataract surgery has long been a central focus of ophthalmic training; one review notes that more than 9.5 million cataract operations were performed worldwide each year. The evidence base has gradually expanded from supervised patient surgery to dedicated systems such as HelpMeSee, while training programs have differed substantially and only four studies in one review were randomized clinical trials. Practitioners also describe simulation workshops, courses, and independent practice as reshaping their surgical skills and understanding over the last decade.

Eyesi vs. the Human Eye: Unveiling the Best Scoring Method

Virtual reality cataract surgery simulation

The study involved 7 experienced cataract surgeons and 17 medical students, all of whom performed cataract surgery modules on the Eyesi simulator. These modules included key steps such as capsulorhexis, hydromaneuvers, and phacoemulsification.

The Eyesi simulator automatically calculated a score for each performance, but the researchers also had two experienced cataract surgeons analyze video recordings of the simulations. These experts used the Objective Structured Assessment of Cataract Surgical Skill (OSACSS) and modified Objective Structured Assessment of Surgical Skills (OSATS) tools to evaluate the participants' techniques.

  • Capsulorhexis: Creating a circular opening in the lens capsule.
  • Hydromaneuvers: Separating the lens nucleus from the cortex using fluid.
  • Phacoemulsification: Breaking up and removing the cataract using ultrasound energy.
AI Search Multiple angles on this topic

New Evidence for Cataract Simulators

Recent research continues to examine virtual reality systems designed specifically for cataract surgery, including EyeSi and HelpMeSee. A 2024 study evaluated validity evidence for the HMS phacoemulsification modules for the first time and highlighted their potential to broaden simulation-based training through more diverse targets. The available research therefore addresses both differences between simulator platforms and whether their performance measures provide meaningful evidence of surgical skill.

Limits of Virtual Scoring

Virtual reality scoring should not be treated as a complete substitute for supervised clinical training. Simulator results may not capture every aspect of patient care, surgical judgment, or the variable conditions encountered during real operations. Evidence remains uneven, so claims that scoring alone guarantees better surgical outcomes should be interpreted cautiously.

Building a Proficiency-Based Curriculum

Virtual reality simulation can help address the steep learning curve associated with cataract surgery by allowing structured practice before or alongside patient-based training. A systematic review argues that combining virtual reality with wet-laboratory simulation in a structured, proficiency-based curriculum could improve outcomes and strengthen future surgical education. This comparison favors an integrated training model rather than positioning simulation and supervised surgery as mutually exclusive approaches.

By comparing the simulator's scores with the expert video evaluations, the researchers could determine which method was more effective at differentiating skill levels.

The Verdict: Human Insight Elevates Surgical Assessment

The study revealed a significant finding: video-based scoring by experts was superior to the Eyesi simulator's internal scoring system, particularly for the phacoemulsification procedure. The simulator's scoring for hydromaneuvers and phacoemulsification was deemed unacceptably poor in its ability to discriminate skill levels.

AI Search Multiple angles on this topic

A Useful but Developing Tool

Current commentary presents extended reality as a promising component of cataract-surgery education while recognizing important limitations. A 2026 Frontiers commentary described Jiang and colleagues' systematic review of cataract-surgery simulator training and surgical outcomes as valuable despite those limitations. The overall evidence supports continued evaluation of simulator scoring rather than assuming that virtual performance measures are already definitive.

Choosing the Right Simulation Model

A 2025 global survey examined patterns of virtual reality simulation use in ophthalmological surgery education, indicating continued international interest in the field. Future programs will still need to decide which simulation models best fit their educational goals and resources. The European Society of Cataract and Refractive Surgeons has emphasized that the most expensive equipment is not always the most efficient or appropriate choice.

Access and Implementation

Virtual reality training may be valuable, but implementation is likely to vary across institutions and health systems. Cost, equipment availability, faculty support, and opportunities for supervised practice can influence who benefits from simulator-based education. These practical differences mean that a scoring system should be evaluated not only for technical validity but also for accessibility and fit within local training programs.

Beyond the Score

A virtual reality score can provide structured feedback, but it represents only one part of a surgeon's development. Real-world performance also depends on judgment, adaptation, communication, and the ability to manage patients in changing clinical circumstances. Used alongside mentorship and supervised experience, simulation may support confidence and preparedness without replacing the human responsibilities of surgical care.

This suggests that while VR simulators offer valuable training opportunities, their scoring systems may need refinement. Incorporating human-based video analysis can provide a more nuanced and accurate assessment of surgical competence.

As surgical training continues to evolve, combining the benefits of VR simulation with the expertise of experienced surgeons will likely play a key role in producing highly skilled and confident ophthalmologists.

What the scoring comparison shows

The strongest evidence favoring human video assessment came from phacoemulsification: its expert rating separated the experience groups better than the simulator score, and the reported difference was significant.[1]

Where this Eyesi assessment is weakest

  • Participants had no previous experience with the Eyesi simulator, which may limit how well these results represent performance after simulator familiarization.[1]

What Lund researchers tested in Eyesi cataract modules

PopulationMedical students and cataract surgeons performing Eyesi cataract modules[1]
SettingDepartment of Clinical Sciences - Ophthalmology, Lund University, Skåne University Hospital, Malmö, Sweden[1]
ComparisonEyesi simulator scores compared with human video-based scores[1]
Effect sizeFor phacoemulsification, OSACSS video ROC area 0.945 vs simulator ROC area 0.664[1]
Times cited19[1]

How the study measured discrimination

The study’s combined-procedure comparison favored video scoring numerically, but its reported test did not establish a statistically significant difference, unlike the phaco-specific comparison.[1]

Questions left by the scoring results

  • Would revised Eyesi scoring improve discrimination on the hydromaneuvers and phaco modules that performed poorly here?[1] [2]

Assessment terms in the paper

OSACSS
Objective Structured Assessment of Cataract Surgical Skill[1]

About this Article -

Written with AI assistance from published research, and reviewed by the Mystum team. See our About page for more information.

This article is based on research published under:

DOI-LINK: 10.2147/opth.s48374, Alternate LINK

Title: Ready For Or Or Not? Human Reader Supplements Eyesi Scoring In Cataract Surgical Skills Assessment

Subject: Ophthalmology

Journal: Clinical Ophthalmology

Publisher: Informa UK Limited

Authors: Madeleine Selvander, Peter Asman

Published: 2013-10-01

Everything You Need To Know

1

What role do virtual reality simulators play in modern cataract surgery training?

Virtual reality simulators like Eyesi offer a standardized and safe environment for cataract surgery training, allowing surgeons to practice essential steps such as capsulorhexis, hydromaneuvers, and phacoemulsification before operating on real patients. This controlled setting is crucial for skill development and reducing risks associated with early surgical experience.

2

How did the Lund University study evaluate the effectiveness of virtual reality cataract surgery training?

A recent study compared the Eyesi simulator's internal scoring with expert video analysis using tools like OSACSS and modified OSATS. The study found that human-based video scoring by experienced cataract surgeons was more effective at differentiating skill levels, especially during the phacoemulsification procedure, highlighting the limitations of relying solely on automated simulator scoring.

3

What are OSACSS and modified OSATS, and how are they used in surgical training?

OSACSS (Objective Structured Assessment of Cataract Surgical Skill) and modified OSATS (Objective Structured Assessment of Surgical Skills) are evaluation tools used by experienced cataract surgeons to analyze video recordings of virtual reality cataract surgery simulations. These tools provide a structured way to assess surgical techniques, offering a more nuanced understanding of a surgeon's proficiency compared to automated scoring systems.

4

What were the key findings regarding the accuracy of virtual reality simulator scoring versus human expert evaluations?

The study revealed that while virtual reality simulators offer valuable training environments, their internal scoring systems, particularly for hydromaneuvers and phacoemulsification, may not accurately reflect a surgeon's skill level. Expert video analysis using OSACSS and modified OSATS proved superior, suggesting that integrating human insight with technology enhances surgical assessment and ensures comprehensive evaluation.

5

Beyond the specific procedures mentioned (capsulorhexis, hydromaneuvers, and phacoemulsification), what are the broader implications of the study's findings for surgical training and assessment?

Capsulorhexis involves creating a circular opening in the lens capsule, hydromaneuvers separate the lens nucleus from the cortex using fluid, and phacoemulsification breaks up and removes the cataract using ultrasound energy. While the study focused on these specific procedures within cataract surgery, further research is needed to determine if the superiority of human-based video scoring extends to other surgical procedures and specialties. The need for continuous assessment methods is paramount.

Newsletter Subscribe

Subscribe to get the latest articles and insights directly in your inbox.