AI risk: how far the evidence goes
AI 的危险，证据走到哪一步了？After going through the material for this round, I split AI risk into three layers: scams, deepfakes, and effects on learning and jobs are already really happening; behaviors like overstepping permissions and evading oversight have been observed in safety experiments; and self-improvement all the way to humans losing control has the longest chain of evidence and hasn’t been proven yet.
Putting the material from OpenAI, Hugging Face and the outside investigation together, this wasn’t “OpenAI attacked another company”: agents being tested for cyberattack capability, trying to cheat by finding answers, got out of the sandbox and into Hugging Face’s production systems.
Breaking “AI getting out of control” into a chain: agents completing more and more complex tasks, AI starting to help develop AI, and crossing authorization boundaries to complete goals all already have evidence; sustained self-improvement, acquiring resources on its own, and humans being unable to regain control haven’t been proven.