Extending ethical guidelines to private companies is essential for effective governance
Artificial Intelligence/Machine Learning Risk & Security Working Group, 2020 [Wharton, ‘Artificial Intelligence Risk & Governance’, https://ai.wharton.upenn.edu/artificial-intelligence-risk-governance/]
Most financial institutions follow a three-lines-of-defense model, which separates front line groups, which are generally accountable for business risks (the First Line), from other risk oversight and independent challenge groups (the Second Line) and assurance (the Third Line). AI governance frameworks should ensure that sufficient oversight, challenge, and assurance requirements are met in AI system development and utilization. Furthermore, as both the potential risks and regulations related to AI are evolving, the second and third lines of defense should, likewise, ensure they have adequate subject matter expertise to effectively challenge the first line in evaluating the proposed use and implementation of the AI systems, as outlined earlier in Section 2. Roles and Responsibilities Every organization is different with respect to their internal organizational structure and general roles and responsibilities. The roles/activities below provide some examples for organizations that are discussing roles and responsibilities with respect to AI implementations to consider. It is not intended to be an exhaustive or prescriptive list. Ethics Review Board An ethics review board may review AI projects in accordance with an organization’s ethical principles, e.g. AI deemed to be high risk. Center of Excellence A Center of Excellence (CoE) may provide a knowledge-sharing platform in an organization. Depending on the organization, a CoE could create a collective view and create and share best practices. Furthermore, the CoE could maintain engagement with the industry to share and learn best practices. Data Science Some organizations have mature Data Science practices. In addition to their assigned responsibilities, the Data Science team could manage AI system inventory and version control. ML Operations A ML operations team provisions data for analysis by the data science team. They may also create and maintain data sets for the purpose of training AI systems.