OpenTag: Understanding Human Perceptions of Image Tagging Algorithms
Brief Description
An award-winning (HCOMP 2020 – Best Demo Award) platform that fuses the auditing process with a crowdsourcing approach. Users can upload an image, which is then analyzed by various Image Tagging Algorithms (ITAs), resulting in multiple sets of descriptive tags. With OpenTag, the user can observe and compare the output of multiple ITAs simultaneously, while researchers can study the manner in which users perceive this output. Finally, using the collected data, further audits can be performed on ITAs.
Purpose
- it serves as a research tool for understanding people’s perceptions of ITA outputs and
-
as an awareness tool to help the general public in understanding the risks when using applications that are based on ITAs, by considering the results they get in response to their own images.
The 8th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2020)
Watch OpenTag’s first presentation at the HCOMP 2020.
Abstract
Image Tagging Algorithms (ITAs) are extensively used in our information ecosystem, from facilitating the retrieval of images in social platforms to learning about users and their preferences. However, audits performed on ITAs have demonstrated that their behaviors often exhibit social biases, especially when analyzing images depicting people. We present OpenTag, a platform that fuses the auditing process with a crowdsourcing approach. Users can upload an image, which is then analyzed by various ITAs, resulting in multiple sets of descriptive tags. With OpenTag, the user can observe and compare the output of multiple ITAs simultaneously, while researchers can study the manner in which users perceive this output. Finally, using the collected data, further audits can be performed on ITAs.
Citation
Kyriakou, K., Barlas, P., Kleanthous, S., & Otterbacher, J. (2020). OpenTag: Understanding Human Perceptions of Image Tagging Algorithms. In Proceedings of the 8th AAAI Conference on Human Computation and Crowdsourcing. Hilversum, The Netherlands. URL www.aaai.org.
Related Publications
- Kyriakou, K., Barlas, P., Kleanthous, S., & Otterbacher, J. (2020). OpenTag: Understanding Human Perceptions of Image Tagging Algorithms. In Proceedings of the 8th AAAI Conference on Human Computation and Crowdsourcing. Hilversum, The Netherlands. URL www.aaai.org.
- Kyriakou, K., Barlas, P., Kleanthous, S., Christoforou, E., & Otterbacher, J. (2021). Crowdsourcing Human Oversight on Image Tagging Algorithms: An initial study of image diversity.
Interested to Get Access?
Contact us and we will get back as soon as possible to discuss the details. Don’t forget to state the purpose you want access to this demo.