Cyber & IT Supervisory Forum - Additional Resources

Identify a team (internal or external) that is independent of AI design and development functions to assess AI system benefits, positive and negative impacts and their likelihood and magnitude. Evaluate and document stakeholder feedback to assess potential impacts for actionable insights regarding trustworthiness characteristics and changes in design approaches and principles. Develop TEVV procedures that incorporate socio-technical elements and methods and plan to normalize across organizational culture. Regularly review and refine TEVV processes. If the AI system relates to people, does it unfairly advantage or disadvantage a particular social group? In what ways? How was this managed? If the AI system relates to other ethically protected groups, have appropriate obligations been met? (e.g., medical data might include information collected from animals) If the AI system relates to people, could this dataset expose people to harm or legal action? (e.g., financial social or otherwise) What was done to mitigate or reduce the potential for harm? Datasheets for Datasets. GAO-21-519SP: AI Accountability Framework for Federal Agencies & Other Entities. AI policies and initiatives, in Artificial Intelligence in Society, OECD, 2019. Intel.gov: AI Ethics Framework for Intelligence Community - 2020. Assessment List for Trustworthy AI (ALTAI) - The High-Level Expert Group on AI - 2019. LINK Organizations can document the following: Transparency & Documentation AI Transparency Resources

102