![Illustration of a multi-story indoor house layout used in the CapNav benchmark. The diagram asks: “Can [AGENT] go from the basement foyer to the top floor rest area?” The basement foyer (START) is at the bottom left, and the top floor rest area (END) is at the top right. Colored paths show different possible routes through labeled areas including Garage, First Floor Hallway, and Elevator. Icons on the left represent four agent types: a wheelchair user (allowed, green check), a quadruped robot (allowed, green check), a human (allowed, green check), and a sweeping robot (not allowed, red X). Red X markers and warning labels indicate constraints such as “Cannot go up stairs” and “Cannot operate elevator,” showing how different mobility capabilities affect route feasibility.](https://calendarstemplates.com/media/projects/images/Screenshot_2026-02-23_at_11.51.22AM.png.500x300_q85_box-279%2C0%2C1094%2C489_crop_upscale.png)
Makeability Lab - Home
The Makeability Lab
We are an advanced research lab in Human-AI 🧠🤖 directed by Professor Jon E. Froehlich in the Allen School of Computer Science at the University of Washington.
We specialize in Human-Computer Interaction and applied machine learning for high-impact problems in:
- 🌆 Urban Computing / GeoAI: Building and studying accessible, intelligent cities
- 🥽 Augmented Reality: Enhancing human capabilities
- 🎨 Creativity Support Tools: Creating AI-powered imagination systems
- 🦽 Accessibility: Improving access via Human-AI techniques
To learn more, see our recent projects and our lab handbook.
Interested in working with us? If you are a current UW undergrad, UW MS student, or local Seattle high school student, please apply here. If you are a prospective PhD student, apply to the UW CSE PhD program and mention Professor Froehlich. Before applying, please read the "Prospective PhD Student" section of our lab handbook.
Recent Projects
Project Sidewalk
2012 – Present
StreetReaderAI
2024 – Present
AccessParkCV
2023 – Present
GeoQA^3
2024 – Present
RampNet
2025 – Present
SonoCraftAR
2025 – Present
Accessibility Scout
2024 – Present
Recent Papers
CapNav: Benchmarking Vision Language Models on Capability-conditioned Indoor Navigation
CVPR 2026
PDF arXiv Cite CapNav: Benchmarking Vision Language Models on Capability-conditioned Indoor Navigation
Towards Human-AI Accessibility Mapping in India: VLM-Guided Annotations and POI-Centric Analysis in Chandigarh
AI4UP 2026
Street View for Whom? An Initial Examination of Google Street View’s Urban Coverage and Socioeconomic Indicators in the US
GeoIndustry 2025
Making Street View Accessible Using Context-Aware Multimodal AI: A Demo of StreetReaderAI
ASSETS 2025
A Demo of GeoQA3 : Towards An Accessible AI-based Question-Answering System for Geoanalytics
ASSETS 2025
"Where Can I Park?" Understanding Human Perspectives and Scalably Detecting Disability Parking from Aerial Imagery
ASSETS 2025
Recent Videos
Recent Talks
"Where Can I Park?" Understanding Human Perspectives and Scalably Detecting Disability Parking from Aerial Imagery
Oct 26, 2025 | ASSETS
Denver, CO
RampNet: A Two-Stage Pipeline for Bootstrapping Curb Ramp Detection in Streetscape Images from Open Government Metadata
Oct 20, 2025 | ICCV CV4A11y Workshop
Honolulu, Hawaiʻi
John O'Meara, Jared Hwang, Zeyu Wang, Mikey Saugstad, Jon E. Froehlich
SonoCraftAR: Towards Supporting Personalized Authoring of Sound-Reactive AR Interfaces by Deaf and Hard of Hearing Users
Oct 08, 2025 | IDEATExR
Daejeon, South Korea
Jaewook Lee, Davin Win Kyi, Leejun Kim, Jenny Peng, Gagyeom Lim, Jeremy Zhengqi Huang, Dhruv Jain, Jon E. Froehlich
FlyMeThrough: Human-AI Collaborative 3D Indoor Mapping with Commodity Drones
Sep 30, 2025 | UIST 2025
Busan, South Korea
StreetReaderAI: Making Street View Accessible Using Context-Aware Multimodal AI
Sep 28, 2025 | UIST
Busan, Korea
Jon E. Froehlich, Alexander J. Fiannaca, Nimer Jaber, Victor Tsaran, Shaun K. Kane
Design and Fabrication for Tangible Interaction with Real-World Objects and Environments
May 09, 2025 | UMBC Seminar
Baltimore, MD
NightLight: Passively Mapping Nighttime Sidewalk Light Data for Improved Pedestrian Routing
Apr 29, 2025 | CHI 2025
Yokohama, Japan
Sponsors
Makeability Lab research is made possible by the generous support of our sponsors. Our research findings, opinions, and/or recommendations may not reflect their views.
