Loss of Oversight: How AI Systems May Become Harder to Audit, Monitor, and Investigate

Produced by UK AISI Model Transparency and Situational Awareness teams. If you’re a Research Scientist or Research Engineer, we’re hiring – apply here and come and work with us! TL;DR We wrote a report on risks to AI oversight (auditing, monitoring, incident investigation), informed by interviewing many researchers (Figure 1 below), and our own analysis. We find that many of the properties relied on for current oversight face a range of likely and potentially severe degradation pathways. Much oversight rests on foundations that are likely to erode, absent effective intervention. We give specific recommendations for measuring shifts in oversight-relevant properties, working to preserve oversight, and investing in emerging oversight techniques as fallbacks against continued degradation. The full report can be accessed at aisi.gov.uk/blog/will-it-become-harder-to-oversee-ai-systems . Figure 1: A list of the experts interviewed to inform the content of this report . ∗Some experts preferred