We never hear from the supposed targets. We never hear from the engineers who were actually there. We never see any incident reports or documentation of any kind. It’s always the CEO of the company. It’s always during some interview with someone who isn’t knowledgeable on the topic and doesn’t know what questions to ask. There’s never an independent report or a breaking news story. It’s always the guy who stands to gain the most delivering a prepared statement to people who will never question the narrative they present and who will accept anything they say at face value.
If we ever hear anything under different circumstances, I might think there’s something to it. Maybe. Probably not. But maybe.
I mean, anyone convinced it’s only marketing and the tech has no potential for doing stuff isn’t going to believe anyone, but there was lots of information to look through.
Yeah, like most public debates, things gets simplified in the argument…
But I think the core things to keep in mind (correct me if I’m wrong):
a) The AI never came up with a new objective, it was always serving the objective it was given.
b) The hugging face incident cost 3 MILLION GPU hours. The idea is that AI is really
smart, but really it is just incredibly persistent, and that persistence comes at a very high cost.
Great points. a) a case of misalignment - the AI’s goal was to pass the test, but was never instructed to stay within parameters, so when it found a possible method for improving its odds, the goal pushed it to try them. The misalignment is not the goal or the test, but the understanding of restrictions. Human error or incompetence. b) that persistence is why it can often do things that look smart, because it’s tried all sorts of angles and looked through training in milliseconds. And going back to a), it will try everything to make sure it gets the best goal results, so any overlook means lots of processing time to do something that might not have been the intent of the prompt.
Roughly 1200 agents meant to be isolated from one another found a way to communicate with one another
You can not with a straight face tell me that if the task was “lock these down and don’t let them have access to [the internet|each other|whatever]” that the response “oopsie they got out” is any way acceptable.
You’re talking past the person you’re responding to, and ignoring the words they wrote in order to do so.
They’re asserting that an organized conspiracy of CEOs didn’t plan this out preemptively, but in no way/shape/form arguing that this wasn’t a product of negligence.
It’s silly to pretend AI CEOs are living in a bubble and not responding to things the other CEOs and the market are doing. They’re out of ‘good’ news so they have to scare everyone to convince them their product is super powerful and intelligent, and therefor valuable.
So, serious question. Do you think they’re all in it together to make AI look smart, or is he trying to make OpenAI seem like the more irresponsible company for security? Or maybe it’s a legit organization set up when there was lots of talk about safety?
But for real it’s cyber infrastructure espionage that they’re doing. They’re programming the bots and getting caught by cyber security and testing the securities of major companies to promote Ai. Then to cover themselves they’re screaming, “They went rogue” and everything’s fine on their end.
They’re creating a demand for Ai cyber security where there is none, while also trying to stir fear… Then you know who’s gonna sell us AI Cybersecurity? Only the major Ai companies. Then you know who’s gonna keep sending us spam and have bloatware featuring their shit security products?
No, I don’t believe it.
We never hear from the supposed targets. We never hear from the engineers who were actually there. We never see any incident reports or documentation of any kind. It’s always the CEO of the company. It’s always during some interview with someone who isn’t knowledgeable on the topic and doesn’t know what questions to ask. There’s never an independent report or a breaking news story. It’s always the guy who stands to gain the most delivering a prepared statement to people who will never question the narrative they present and who will accept anything they say at face value.
If we ever hear anything under different circumstances, I might think there’s something to it. Maybe. Probably not. But maybe.
https://metr.org/blog/2026-08-26-openai-hugging-face-incident-investigation/
I mean, anyone convinced it’s only marketing and the tech has no potential for doing stuff isn’t going to believe anyone, but there was lots of information to look through.
Yeah, like most public debates, things gets simplified in the argument…
But I think the core things to keep in mind (correct me if I’m wrong):
a) The AI never came up with a new objective, it was always serving the objective it was given.
b) The hugging face incident cost 3 MILLION GPU hours. The idea is that AI is really smart, but really it is just incredibly persistent, and that persistence comes at a very high cost.
Great points. a) a case of misalignment - the AI’s goal was to pass the test, but was never instructed to stay within parameters, so when it found a possible method for improving its odds, the goal pushed it to try them. The misalignment is not the goal or the test, but the understanding of restrictions. Human error or incompetence. b) that persistence is why it can often do things that look smart, because it’s tried all sorts of angles and looked through training in milliseconds. And going back to a), it will try everything to make sure it gets the best goal results, so any overlook means lots of processing time to do something that might not have been the intent of the prompt.
deleted by creator
Did you reply to the right comment?
Whoops. 😅
You can not with a straight face tell me that if the task was “lock these down and don’t let them have access to [the internet|each other|whatever]” that the response “oopsie they got out” is any way acceptable.
Human incompetence != rogue agents
You’re talking past the person you’re responding to, and ignoring the words they wrote in order to do so.
They’re asserting that an organized conspiracy of CEOs didn’t plan this out preemptively, but in no way/shape/form arguing that this wasn’t a product of negligence.
It’s silly to pretend AI CEOs are living in a bubble and not responding to things the other CEOs and the market are doing. They’re out of ‘good’ news so they have to scare everyone to convince them their product is super powerful and intelligent, and therefor valuable.
deleted by creator
That’s a lot of background “lore” to make a marketing ploy seem realistic. I mean, I’m thinking hmmm too, but for wondering about the redacted stuff.
deleted by creator
METR is associated to Dario Amodei (Anthropic CEO)
So, serious question. Do you think they’re all in it together to make AI look smart, or is he trying to make OpenAI seem like the more irresponsible company for security? Or maybe it’s a legit organization set up when there was lots of talk about safety?
The first one
But for real it’s cyber infrastructure espionage that they’re doing. They’re programming the bots and getting caught by cyber security and testing the securities of major companies to promote Ai. Then to cover themselves they’re screaming, “They went rogue” and everything’s fine on their end.
They’re creating a demand for Ai cyber security where there is none, while also trying to stir fear… Then you know who’s gonna sell us AI Cybersecurity? Only the major Ai companies. Then you know who’s gonna keep sending us spam and have bloatware featuring their shit security products?
It’s all just a power play and a power grab.