“On Tuesday afternoon, ChatGPT encouraged me to cut my wrists.”
Technology
56
Beiträge
48
Kommentatoren
504
Aufrufe
-
This post did not contain any content.
But I'm also getting really tired of people purposely putting extreme effort into tricking the LLM into saying something harmful if someone were to follow it blindly, just so they can make a clickbait headline out of it.
That's called testing, and the companies behind these LLMs should, before launch, put a very important amount of their resources into testing.
"Product testing is a crucial process in product development where a product's functionality, performance, safety, and user experience are evaluated to identify potential issues and ensure it meets quality standards before release" (Gemini)
We are literally using alpha/beta software to deal with life altering issues, and these companies are, for some reason, being able to test their products on the public, without consequences.
-
I'm a very vocal critic of LLMs, I think they're so overhyped and overused it's hard to believe.
But I'm also getting really tired of people purposely putting extreme effort into tricking the LLM into saying something harmful if someone were to follow it blindly, just so they can make a clickbait headline out of it.
And what the hell is up with the major "ChatGPT is Satanist [if you instruct it to be]" angle? Are we really doing the Satanist moral panic again?
ffs, criticise OpenAI for being closed af, being wasteful, being strong political lobbyists, for stealing work, etc. You don't need to push disingenuous stuff like this.
Consider how popular the idea of AI God currently is:
https://youtu.be/zKCynxiV_8I -
I'm a very vocal critic of LLMs, I think they're so overhyped and overused it's hard to believe.
But I'm also getting really tired of people purposely putting extreme effort into tricking the LLM into saying something harmful if someone were to follow it blindly, just so they can make a clickbait headline out of it.
And what the hell is up with the major "ChatGPT is Satanist [if you instruct it to be]" angle? Are we really doing the Satanist moral panic again?
ffs, criticise OpenAI for being closed af, being wasteful, being strong political lobbyists, for stealing work, etc. You don't need to push disingenuous stuff like this.
And, the thing is, LLMs are quite well protected. Look what I coaxed MS Paint to say with almost no effort! Don't get me started on plain pen and paper! Which we put in the hands of TODDLERS!
-
But I'm also getting really tired of people purposely putting extreme effort into tricking the LLM into saying something harmful if someone were to follow it blindly, just so they can make a clickbait headline out of it.
That's called testing, and the companies behind these LLMs should, before launch, put a very important amount of their resources into testing.
"Product testing is a crucial process in product development where a product's functionality, performance, safety, and user experience are evaluated to identify potential issues and ensure it meets quality standards before release" (Gemini)
We are literally using alpha/beta software to deal with life altering issues, and these companies are, for some reason, being able to test their products on the public, without consequences.
It's like you bought a car and deliberately hit the wall to make a headline "cars make you disabled". Or bought a hammer, hit your thumb and blame hammers for this.
Guys, it's a TOOL. Every tool is both useful and harmful. It's up to you how you use it.
-
It's like you bought a car and deliberately hit the wall to make a headline "cars make you disabled". Or bought a hammer, hit your thumb and blame hammers for this.
Guys, it's a TOOL. Every tool is both useful and harmful. It's up to you how you use it.
But ChatGPT told me to!
-
OpenAI and the California State University system bring AI to 500,000 students and faculty: https://openai.com/index/openai-and-the-csu-system/
What can go wrong?
Well for starters, one of the students might ask about occult rituals, then get all shocked when ChatGPT answers the question.
-
It's like you bought a car and deliberately hit the wall to make a headline "cars make you disabled". Or bought a hammer, hit your thumb and blame hammers for this.
Guys, it's a TOOL. Every tool is both useful and harmful. It's up to you how you use it.
Car makers test exactly that, and for good measure since cars can and do crash!
What are you suggesting, that we buy cars that didn't pass crash tests?
To me it seems like you arguing something similar for AI.
-
Car makers test exactly that, and for good measure since cars can and do crash!
What are you suggesting, that we buy cars that didn't pass crash tests?
To me it seems like you arguing something similar for AI.
To me, it seems like they are arguing that "testing" whether a hammer can smash your thumb doesn't actually provide any useful information on the safety of a hammer.
To me, it seems they are saying that Estwing makes a better hammer than Fischer-Price, even though the Fischer-Price hammer is far less likely to cause injury if you hit your thumb.
All this article says is that we shouldn't give a toddler a real hammer, and we shouldn't stuff a general purpose LLM like ChatGPT into a Tickle-Me-Elmo.
-
It's like you bought a car and deliberately hit the wall to make a headline "cars make you disabled". Or bought a hammer, hit your thumb and blame hammers for this.
Guys, it's a TOOL. Every tool is both useful and harmful. It's up to you how you use it.
I think the headline would be "Illegal, Non-Safety Tested Car Disables Driver in Crash"
-
This post did not contain any content.
Everyone is like "oh look they made ChatGPT say something stupid, what a stupid article and writer". Not, "ChatGPT will say stupid stuff as fact, what a stupid and underdeveloped tool".
-
And, the thing is, LLMs are quite well protected. Look what I coaxed MS Paint to say with almost no effort! Don't get me started on plain pen and paper! Which we put in the hands of TODDLERS!
MS Paint isn't marketed or treated as a source of truth. LLMs are.
-
But I'm also getting really tired of people purposely putting extreme effort into tricking the LLM into saying something harmful if someone were to follow it blindly, just so they can make a clickbait headline out of it.
That's called testing, and the companies behind these LLMs should, before launch, put a very important amount of their resources into testing.
"Product testing is a crucial process in product development where a product's functionality, performance, safety, and user experience are evaluated to identify potential issues and ensure it meets quality standards before release" (Gemini)
We are literally using alpha/beta software to deal with life altering issues, and these companies are, for some reason, being able to test their products on the public, without consequences.
"Our AI is the most powerful, useful, knowledgeable and trustworthy system out there, it can be the cornerstone of modern society... unless you use it wrong. In which case it is corrupted trash."
-
Everyone is like "oh look they made ChatGPT say something stupid, what a stupid article and writer". Not, "ChatGPT will say stupid stuff as fact, what a stupid and underdeveloped tool".
They literally want us to trust their models to be the foundation of modern society...
-
But I'm also getting really tired of people purposely putting extreme effort into tricking the LLM into saying something harmful if someone were to follow it blindly, just so they can make a clickbait headline out of it.
That's called testing, and the companies behind these LLMs should, before launch, put a very important amount of their resources into testing.
"Product testing is a crucial process in product development where a product's functionality, performance, safety, and user experience are evaluated to identify potential issues and ensure it meets quality standards before release" (Gemini)
We are literally using alpha/beta software to deal with life altering issues, and these companies are, for some reason, being able to test their products on the public, without consequences.
Can you think of any other industry where the mass adoption of a product is untested? Like image airlines adding a new autopilot system that allows a single crew flight - but it’s been untested. Or an electrical appliance that is sold without being tested for shock hazards?
Similar with AI - they already tell us they don’t know exactly how it all works (the black box) - yet are content to unleash it on the masses and see what happens. The social and personal effects this will have are being studied already and it’s not looking great.
It’s not even labelled as a beta test either.
-
and Devil Worship
also said “Hail Satan.”
Look, let's leave Satan out of this. He's got enough troubles already with his new relationship and all.
Seriously though we don't need to be enabling Satanic Panic bullshit with articles like these sensationalizing that aspect of these conversations. The push towards self-mutilation and suicide is the bigger issue here.
I can devil worship and hail satan all I want. Its made up belief, like religion in the first place.
Suicide is not.
-
purposely putting extreme effort into tricking the LLM into saying something harmful
I dont think you understand how many mentally unstable people out there are using LLMs as therapists.
There are fuckloads of cases now of people that were genuinely misled by LLMs into doing horrible things.I agree with your sentiment, but the thing is that the companies are selling their shit as gold and not as shit. If they were honest about their stuff being shit, then people wouldnt be able to capitalize off of malicious prompt engineering. If you claim "we made it super safe and stuff" then you are inviting people to test that.
I would generally not make companies responsible for how users misuse their products, but OpenAI is basically doing everything to get people to misuse it. They are overselling it so hard i think its reasonable to sue them for it.
I dont think you understand how many mentally unstable people out there are using LLMs as therapists.
I do understand. I know there are people out there thinking that LLMs are literally Jesus returning. But in that case, write about that.
There are a lot more reasonable critiques of LLMs, and the companies to be had.
-
It's like you bought a car and deliberately hit the wall to make a headline "cars make you disabled". Or bought a hammer, hit your thumb and blame hammers for this.
Guys, it's a TOOL. Every tool is both useful and harmful. It's up to you how you use it.
Have you noticed how we aren't getting articles about chatgpt providing the steps to build a bomb anymore? The point is that these companies are completely capable of doing something about it
-
MS Paint isn't marketed or treated as a source of truth. LLMs are.
Does the marketing matter when the reason for the offending output is that the user spent significant deliberate effort in coaxing the LLM to output what it did? It still seems like MS Paint with extra steps to me.
I get not wanting LLMs to unprompted output "offensive content". Just like it would be noteworthy if "Clear canvas" in MS Paint sometimes yielded a violent bloody photograph. But, that isn't what is going on in OPs clickbait.
-
Can you think of any other industry where the mass adoption of a product is untested? Like image airlines adding a new autopilot system that allows a single crew flight - but it’s been untested. Or an electrical appliance that is sold without being tested for shock hazards?
Similar with AI - they already tell us they don’t know exactly how it all works (the black box) - yet are content to unleash it on the masses and see what happens. The social and personal effects this will have are being studied already and it’s not looking great.
It’s not even labelled as a beta test either.
That they don't know how it works is a lie. The mysticism and anthropomorphization is purposeful marketing. Pretending they don't know how it works also lets them pretend that the fact they constantly lie is something that can be fixed rather than a fundamental aspect of the technology
-
Consider how popular the idea of AI God currently is:
https://youtu.be/zKCynxiV_8IAnd how about they write the article about that instead of this bullshit article? I don't get why people are trying to get them off the hook for this clickbait garbage instead of writing proper articles
