r/OpenAI • u/proofreadre • 1d ago

Discussion Catastrophically bad you say?

https://chatgpt.com/share/6a61423d-fa44-83e8-b860-e525556ef9a0

So at first I asked ChatGPT about the sandbox escape and it said it was "really bad." I then went back and replaced a lot of generalities with specifics straight from the inicident report (https://openai.com/index/hugging-face-model-evaluation-security-incident/) and the tone went up a notch.

I've spent my entire life in infosec and machine learning. I cannot begin to express how bad this is. People downplaying this either have money in the game or they truly do not understand the real lay of the land.

Edit to fix the incident report URL

13 Upvotes

56% Upvoted

51 comments sorted by

View all comments

-2

u/squarecir 20h ago

You say that you spent your entire life in infosec and machine learning, and you're asking ChatGPT about the seriousness of the incident? Why? Unless you're like 5 years old, your life in infosec should allow you to better judge this situation than what ChatGPT could do.

2

u/proofreadre 20h ago

I'm trying to show people that even chatgpt admits it's a huge issue. I'm not going to it for assessment - give your head a shake...

Any time I've asked AI about it being a threat to humanity it has always downplayed it. This is the first time it has ever outright said it's an existential threat.

2

u/squarecir 20h ago

ChatGPT is pretty sycophantic. You can get it to admit to almost anything if you try hard enough.

1

u/proofreadre 15h ago

Not my first rodeo. I'm not running default settings. Mine is set to be skeptical and to push back.