Discovering and Validating AI Errors With Crowdsourced Failure Reports

teaser

AI systems can fail to learn important behaviors, leading to real-world issues like safety concerns and biases. Unfortunately, discovering these systematic failures often requires significant developer attention, from hypothesizing potential edge cases to collecting evidence and validating patterns. To scale and streamlinethis process, we introduce failure reports, end-user descriptions of how or why a model failed, and show how developers can use them to detect AI errors. We also design and implement Deblinder, a visual analytics system for synthesizing failure reports that developers can use to discover and validate systematic failures. In semi-structured interviews and think-aloud studies with 10 AI practitioners, we explore the affordances of the Deblinder system and the applicability of failure reports in real-world settings. Lastly, we show how collecting additional data from the groups identified by developers can improve model performance.

Citation

Discovering and Validating AI Errors With Crowdsourced Failure Reports

Ángel Alexander Cabrera, Abraham Druck, Jason Hong, Adam Perer
ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW). Virtual, 2021.

BibTex

@article{cabrera2021deblinder,author = {Cabrera, '{A}ngel Alexander and Druck, Abraham J. and Hong, Jason I. and Perer, Adam},title = {Discovering and Validating AI Errors With Crowdsourced Failure Reports},year = {2021},issue_date = {October 2021},publisher = {Association for Computing Machinery},address = {New York, NY, USA},volume = {5},number = {CSCW2},url = {https://doi.org/10.1145/3479569},doi = {10.1145/3479569},journal = {Proc. ACM Hum.-Comput. Interact.},month = oct,articleno = {425},numpages = {22}}