Skip to content

Professor Qi Wang awarded National Science Foundation grant

October 28, 2021


Videos are a popular medium for online learning, and captions are essential for increasing the accessibility of videos to students for effective learning. Dr. Qi Wang, who teaches in the Department of Business, and professors from the University of Illinois at Urbana-Champaign and the University of Notre Dame, were recently awarded a $133,918 grant from the National Science Foundation (NSF). The work is entitled “Collaborative Research: Advancing STEM Online Learning by Augmenting Accessibility with Explanatory Captions and AI.” Dr. Wang is the first professor in the history of the Business department to secure a NSF grant.

In this project, research is being conducted on the success of explanatory captions as an educational tool for both deaf and hard of hearing learners as well as non-native English learners. There are two types of video captions: typical closed captions and explanatory captions. Closed captions are a text form of the spoken part of a video. Explanatory captions explain the visual, textual, and audio content of the video. Existing technologies have focused on automatically generating or improving the quality of closed captions, but this project’s focus is explanatory captions. 

For STEM learning, explanatory captions can play a new role in enhancing students’ comprehension. The project will work to devise effective question-and-answer mechanisms and effective interaction designs that allow students and instructors to generate explanatory captions for STEM videos in a collaborative manner. The proposed technologies will augment accessibility and learning experiences for underserved populations and the deaf and hard of hearing community, while also improving comprehension for non-native English speakers, deaf or hearing. Evaluation sites include both Gallaudet University and the University of Illinois at Urbana-Champaign, which has the largest international student population among U.S. public institutions and supports students with disabilities in inclusive learning environments. The University of Notre Dame supports this project through contributions in computer science and artificial intelligence.

This interdisciplinary research draws from the fields of computer science, learning science, and accessibility practices. The project aims to discover new knowledge and practical ways and means as to how accessibility-enabled videos (with explanatory and closed captions) can broaden the participation of under-served populations in STEM learning. The effort will also investigate effective mechanisms of human contribution and machine learning algorithms to create explanatory captions for STEM videos at different learning stages (e.g., preparing, tracking, troubleshooting, and reflecting), as well as how novel chatbots and AI agents impact student and instructor practices. Their work will be developed and analyzed through interactive, constructive, active, and passive (ICAP) theoretical frameworks.. 

Congratulations to Dr. Wang for this accomplishment. We look forward to the findings of this exciting research and applications!

This material is based upon work supported by the National Science Foundation under NSF Award No. 2118824. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

28 October 2021


Recent Posts

Roberto E. Wirth, E-’74 & H-’09, passed away on June 5 in Rome, Italy. Mr. Wirth was owner and managing director of the Hotel Hassler in Rome, one of the most prestigious family-owned hotels in the world, and owned several other hotels and resorts throughout Italy. He was a strong advocate for deaf people in...

Alumnus Timel Benton has signed a contract with the Bay Area Panthers of the Indoor Football League (IFL). Benton, who graduated last month, is the first Gallaudet Bison to sign a professional football contract since Tony Tatum signed on with the Utah Blaze in the now-disbanded Arena Football League (AFL) in May 2013. Benton was...

James Caverly, ’11, who plays Theo Dimas in Hulu’s Only Murders in the Building, will play Professor Harold Hill in the Olney Theatre Center’s summer production of Meredith Willson’s Tony-winning musical The Music Man, which opens tonight and runs through July 23. The show’s official opening is on Thursday, June 23. Sandra Mae Frank, ’13,...

About the Author

Nikolya Sereda

Published Articles: 23

Recent Posts
Deaf hotelier Roberto Wirth passes away
Alumnus Timel Benton to play professional football
Alumni, faculty featured in The Music Man at Olney Theatre Center
Related Categories
Media Inquiries

For any other media inquiry, please contact:

No media contact found!

Stay up to date on all the Gallaudet happenings, both stories and initiatives we are doing with our Signing community!​

Admissions Requirements

Hearing Undergraduate