Machine Vision Exercise Coaching App
A 3-lab collaboration between my HCI lab and 2 other labs / associate deans in kinesiology and health sciences
Technical and design lead on a cross-institutional research project spanning 3 labs at RIT and the University of South Carolina, building a native iOS app backed by custom ML training pipelines and large language models. This app affords independent learning opportunities for blind and low-vision children, with age and needs-adaptive coaching feedback to help them improve their exercise performance; while also providing valuable clinical insights. Field-tested with 15 BLV participants.
Multi-institution research project, between RIT, USC, and SUNY Brockport · Ongoing