Cyber & IT Supervisory Forum - Additional Resources

Datasheets for Datasets. GAO-21-519SP: AI Accountability Framework for Federal Agencies & Other Entities. AI policies and initiatives, in Artificial Intelligence in Society, OECD, 2019. Stakeholders in Explainable AI, Sep. 2018. AI Transparency Resources ISO, “Ergonomics of human-system interaction — Part 210: Human-centered design for interactive systems,” ISO 9241-210:2019 (2nd ed.), July 2019. Rumman Chowdhury and Jutta Williams, "Introducing Twitter’s first algorithmic bias bounty challenge," Leonard Haas and Sebastian Gießler, “In the realm of paper tigers – exploring the failings of AI ethics guidelines,” AlgorithmWatch, 2020. Josh Kenway, Camille Francois, Dr. Sasha Costanza-Chock, Inioluwa Deborah Raji, & Dr. Joy Buolamwini. 2022. Bug Bounties for Algorithmic Harms? Algorithmic Justice League. Accessed July 14, 2022. Microsoft Community Jury , Azure Application Architecture Guide. “Definition of independent verification and validation (IV&V)”, in IEEE 1012, IEEE Standard for System, Software, and Hardware Verification and Validation. Annex C, References What was done to mitigate or reduce the potential for harm? Stakeholder involvement: Include diverse perspectives from a community of stakeholders throughout the AI life cycle to mitigate risks.

41