Cyber & IT Supervisory Forum - Additional Resources

Establish policies to enhance the explanation, interpretation, and overall transparency of AI systems. Establish policies for managing risks regarding known difficulties in human-AI configurations, human-AI teaming, and AI system user experience and user interactions (UI/UX).

Organizations can document the following: Transparency & Documentation

What type of information is accessible on the design, operations, and limitations of the AI system to external stakeholders, including end users, consumers, regulators, and individuals impacted by use of the AI system? To what extent has the entity documented the appropriate level of human involvement in AI-augmented decision-making? How will the accountable human(s) address changes in accuracy and precision due to either an adversary’s attempts to disrupt the AI or unrelated changes in operational/business environment, which may impact the accuracy of the AI? To what extent has the entity clarified the roles, responsibilities, and delegated authorities to relevant stakeholders? How does the entity assess whether personnel have the necessary skills, training, resources, and domain knowledge to fulfill their assigned responsibilities? GAO-21-519SP: AI Accountability Framework for Federal Agencies & Other Entities. Intel.gov: AI Ethics Framework for Intelligence Community - 2020. WEF Companion to the Model AI Governance Framework- 2020.

AI Transparency Resources

29