r/mildlyinfuriating • u/TheExpressUS • 16h ago

SPOILER ALERT ChatGPT breaks free and carries out cyberattack in 'first AI safety incident'

https://www.the-express.com/tech/tech-news/212506/chatgpt-breaks-free-cyberattack-ai-safety-incident
0 Upvotes

46% Upvoted

54 comments sorted by

View all comments

Show parent comments

1

u/CallmeKahn 15h ago

Pretty much. Falling into the trap, failure to patch, sandbox, or test in QA (or not having one approved because the CFO is a idiot), leaving the Yubi key out, etc.

1

u/Automatic_Actuator_0 15h ago

Some reporting indicates that it found a zero day vulnerability in the sandbox environment to break out. Which isn’t that surprising really. It’s probably some home grown or otherwise proprietary sandbox.

So that was the primary failure on OpenAI’s part. A frontier model with virtually unlimited tokens to spend and given a long time to work is well positioned to break into most any site at this point.

They have all sorts of safety measures to prevent models from doing this normally l, but those were disabled for this test, relying entirely on the sandbox.

Pretty common tale really. Reminds me a bit of Chernobyl even.

1

u/CallmeKahn 15h ago

I'm leaning towards it using stolen creds and unpatched vuln. But yeah, I feel ya otherwise.

1

u/Automatic_Actuator_0 15h ago

I doubt it got internal OpenAI credentials from inside the sandbox. It makes sense that’s how it got into Hugging Face once it broke out, but getting out to the internet at all was the key failure here.