Cyber & IT Supervisory Forum - Additional Resources

Elicit and track feedback from AI actors in incident response and support roles about the adequacy of staffing and resources to perform their duties in an effective and timely manner.

Organizations can document the following: Transparency & Documentation

GAO-21-519SP - Artificial Intelligence: An Accountability Framework for Federal Agencies & Other Entities. Artificial Intelligence Ethics Framework for the Intelligence Community. WEF Companion to the Model AI Governance Framework – Implementation and Self-Assessment Guide for Organizations. Did your organization implement a risk management system to address risks involved in deploying the identified AI solution (e.g., personnel risk or changes to commercial objectives)? To what extent can users or parties affected by the outputs of the AI system test the AI system and provide feedback? What metrics has the entity developed to measure performance of the AI system, including error logging? To what extent do the metrics provide accurate and useful measure of performance? ISO. "ISO 9241-210:2019 Ergonomics of human-system interaction — Part 210: Human-centered design for interactive systems." 2nd ed. ISO Standards, July 2019. Larysa Visengeriyeva, et al. “Awesome MLOps.“ GitHub. References AI Transparency Resources

158