Generative AI Risk Management
Meta’s Open Loop program is excited to have launched its first policy prototyping research program in the United States, which is focused on testing the National Institute of Standards and Technology (NIST) AI Risk Management Framework (RMF) 1.0 to ensure that it is clear, implementable and effective at helping companies to identify and manage risks arising from generative AI.
This program gives participating companies the opportunity to learn about NIST's AI RMF, and to understand how it can be applied to managing risks associated with developing and deploying generative AI systems. At the same time, the program will gather evidence on current practices and provide valuable insights and feedback to NIST, which can inform future iterations of the RMF.
Read the first phase report now!
This report presents the findings and recommendations of the first phase of the Open Loop US program on Generative AI Risk Management, launched in November of 2023 in partnership with Accenture. The first phase focused around two topics that are key to generative AI risk management and of particular interest for NIST, namely AI red-teaming and synthetic content risk mitigation. This report shares the results of the first phase of the program which took place from January to April 2024 and involved 40 companies.
Through desk research, interviews, surveys and workshops, we investigated:
Open Loop Program structure
Leveraging the policy prototyping methodology developed by Open Loop the program incorporates both qualitative and quantitative testing methodology in two phases:
PHASE 1
PHASE 2
Open Loop will produce two policy reports containing initial recommendations for product and policymakers aimed at supporting effective AI governance and risk management measures.
Leverage collaborative policy prototyping (testing proposed, hypothetical or real policy guidance within a structured program) methodologies to enable cohort members to apply and provide feedback on the NIST AI RMF in order to inform its future iterations as a practical tool for managing AI-related risks.
Inform the practical application of the NIST AI RMF among a diverse group of developers and users of Generative AI products and services, by unlocking insights, showcasing best practices and lessons learned, and by pinpointing gaps and opportunities.
Facilitate exchanges of ideas and solutions among AI companies, experts, and policymakers to drive the evolution of responsible and accountable AI practice.
The participating companies
AI companies across various sectors joined the program, including AI startups, AI risk and assurance companies, and established multinational enterprises across various industries. Individual participants represented a diverse range of expertise, with both senior-level decision-makers and individuals involved in operational aspects of safety, compliance, and technology development.
As a participant, you will:
Provide feedback on how the NIST AI RMF helps companies integrate trustworthiness considerations into the development, deployment, and assessment of AI products, services, and systems, to better manage risks to individuals, organizations, and society associated with artificial intelligence.
Gain insights from peers, industry leaders, and policy experts during a series of collaborative discussions and deep dive workshops on specific AI topics.
Inform potential future iterations of the NIST AI RMF to foster innovative policies and effective implementation, considering the evolving AI landscape.
Showcase your company’s approaches to AI governance and share experiences in developing and implementing the AI RMF and/or other risk management frameworks.
Network with a vibrant community of responsible AI practitioners, thought leaders and AI companies.
Influence future approaches to (international) AI policy beyond the United States.
Expression of interest
To express your interest and learn more about getting involved as a participating company or expert in future Open Loop programs, please fill out the short application form below.
Meta’s Open Loop is a global program that connects policymakers and technology companies to help develop effective and evidence-based policies around AI and other emerging technologies.
Through experimental governance methods, Meta’s Open Loop members co-create policy prototypes and test new or existing approaches to policy, guidance frameworks, regulations, and laws. These multi-stakeholder efforts improve the quality of rulemaking processes by ensuring that new guidance and regulation aimed at emerging technology are effective and implementable.
Open Loop has been running theme-specific programs to operationalize trustworthy AI across multiple verticals, such as Transparency and Explainability in Singapore and Mexico, and Human Centered-AI with an emphasis on stakeholder engagement in India. Beyond AI, we are also testing a playbook to promote the adoption of Privacy Enhancing Technologies in Brazil and Uruguay.
Meta’s Open Loop program has partnered with Accenture and will work closely with other prominent industry players and other organizations in the US. Our collaborative efforts extend to include experts from international organizations, NIST, civil society organizations, academia, and more. Each of these contribute to the program's comprehensive knowledge base and holistic approach. Through these strategic partnerships, we aim to collectively drive the advancement of AI risk management and foster a well-rounded understanding of responsible AI practices.
Should you have any questions, please feel free to get in touch
Be a part of Open Loop’s first US Program
