Have you ever wanted to hear a photograph or pie chart, and not just a description of what is in it? The IMAGE project (Internet Multimodal Access to Graphical Exploration) adds controls to graphics in your browser so you can activate it on photographs and some charts and maps, on any webpage you visit. You will then receive experiences that combine spoken words with other sounds you hear around your head, that tell you details such as where things are, how large they are, or other information depending on the graphic. We are also working on touch experiences using add-on hardware including the Haply 2diy force feedback device and the Humanware Monarch braille pin array tablet, but those IMAGE experiences are not yet released. The goal is to provide people who are blind or have low vision with a new and useful experience of internet graphics that goes beyond automatically generating alt tags. To learn how IMAGE can practically help you, and how to install the IMAGE browser extension so you can try it out, visit the Using IMAGE page. Much of the interpretation of graphics is done using artificial intelligence models, including some Built with Llama.
The IMAGE extension is fully supported on Chrome, but also works on Microsoft Edge, Brave, Safari, and Opera for Desktop or Laptop. To learn how IMAGE can practically help you, and how to install the IMAGE browser extension so you can try it out, visit the Using IMAGE page.
We use rich spatialized audio (sonification) together with the sense of touch (haptics) to provide a faster and more nuanced experience of graphics on the web.
Some audio examples can be found on our Interpretations section of the Using IMAGE page.
Collaborating with the community is key when creating accessible technology. Our team is partnering with Gateway Navigation CCC Ltd and the Canadian Council of the Blind (CCB), a consumer organization of Canadians who are blind, to ensure that our system is in line with the needs of the community. We are in regular contact with community members as part of our co-design approach, who are helping guide the development process but there is always room for more voices. If you experience vision loss and would like to participate in current and future studies, we invite you to fill out our community survey for Canadian residents only, in: English or en français.
This project is carried out by McGill University's Shared Reality Lab (SRL), in strategic partnership with Gateway Navigation CCC Ltd and the Canadian Council of the Blind (CCB). The project was funded by Innovation Science Economic Development Canada through the Assistive Technology Program, Healthy Brains, Healthy Lives through the Accelerate Neuro Commercialization Grant.
Currently, IMAGE is being funded by a Humanware/The American Printing House corporate grant2021-2022 Innovation Science Economic Development Canada, Assistive Technology Program
2022 Healthy Brains, Healthy Lives, Ignite Neuro Commercialization Grant
2022-2024 Healthy Brains, Healthy Lives, MEDTEQ Accelerate Neuro Commercialization Grant, in partnership with: Haply Robotics
2023Humanware/The American Printing House corporate grant
2024-2025 Humanware/The American Printing House corporate grant