Cyber & IT Supervisory Forum - Additional Resources

Share information about errors, near-misses, and attack patterns with incident databases, other organizations with similar systems, and system users and stakeholders. Respond to and document detected or reported negative impacts or issues in AI system performance and trustworthiness. Decommission systems that exceed establish risk tolerances. Transparency & Documentation To what extent has the entity documented the post-deployment AI system’s testing methodology, metrics, and performance outcomes? How easily accessible and current is the information available to external stakeholders? Organizations can document the following: GAO-21-519SP - Artificial Intelligence: An Accountability Framework for Federal Agencies & Other Entities. Datasheets for Datasets. AI Transparency Resources Navdeep Gill, Patrick Hall, Kim Montgomery, and Nicholas Schmidt. "A Responsible Machine Learning Workflow with Focus on Interpretable Models, Post-hoc Explanation, and Discrimination Testing." Information 11, no. 3 (2020): 137. References

201