I’ve talked with an AI about suicidal ideation. More than once. For me it was and is a way to help self-regulate. I’ve low-key wanted to kill myself since I was 8 years old. For me it’s just a part of life. For others it’s usually REALLY uncomfortable for them to talk about without wanting to tell me how wrong I am for thinking that way.
Yeah I don’t trust it, but at the same time, for me it’s better than sitting on those feelings between therapy sessions. To me, these comments read a lot like people who have never experienced ongoing clinical suicidal ideation.
They didn’t release their methods, so I can’t be sure that most of those aren’t just frustrated users telling the LLM to go kill itself.
In other news, a million people use openai???
I wonder what it means. If you search for music by Suicidal Tendencies then YouTube shows you a suicide hotline. What does it mean for OpenAI to say people are talking about suicide? They didn’t open up and read a million chats… they have automated detection and that is being triggered, which is not necessarily the same as people meaningfully discussing suicide.
Every third chat now gets triggered, the ChatGPT is pretty broken lately. Just check out ChatGPT subreddit, its pretty much in chaos with moderators going for censorship of complaints. So many users are mad they made a megathread for it. I cancelled my subscription yesterday, it just turned into a cyberkaren
Claude got hints that I might be suicidal just from normal chat. I straight up admitted I think of suicide daily.
Just normal life now I guess.
Stay strong friend! I know I’m just a stranger but I’m here if you need someone to talk to.
Okay, hear me out: How much of that is a function of ChatGPT and how much of that is a function of… gestures at everything else
MOSTLY joking. But had a good talk with my primary care doctor at the bar the other week (only kinda awkward) about how she and her team have had to restructure the questions they use to check for depression and the like because… fucking EVERYONE is depressed and stressed out but for reasons that we “understand”.
Not very informative. I want to know what percentage is the us and if it increased in the last year.
The headline has two interpretations and I don’t like it.
- Every week, there is 1M+ users that bring up suicide
- likely correct
- There is 1M+ long-term users that bring up suicide at least once every week
- my first thought
My first thought was “Open AI is collecting and storing the metrics for how often users bring up suicide to ChatGPT”.
Forgot to add ‘And trying to figure out how best to sell it to advertisers’ to the end.
Futurama suicide booths say what?
Mine too. I meant to write “my first interpretation” but wanted to use shorter and more varied vocabulary.
- Every week, there is 1M+ users that bring up suicide
Apparently, “suicide” is also a disproportionally common search term on Bing as opposed to other search engines. What does that say about Microsoft?
That they have a short term user base?
More trustworthy than Google?
nothing like getting a google ad sense ad burrying the support links to page two.
probly a survivorship bias thing going on.
I am more surprised it’s just 0.15% of ChatGPT’s active users. Mental healthcare in the US is broken and taboo.
in the US
It’s not just the US, it’s like that in most of the world.
At least in the rest of the world you don’t end up with crippling debt when you try to get mental healthcare that stresses you out to the point of committing suicide.
And then should you have a failed attempt, you go exponentially deeper into debt due to those new medical bills and inpatient mental healthcare.
Fuck the United States
None of this is funny. Please stop anyone you know or your business from using/ adopting this and other related tech. Use shame or prodding or intelligent debate, whatever works. This shit is already culture ending and redefining, job destroying and increasing economic disparity. Boycott Open AI, Meta, Stability, etc. etc. Make it dirty, embarrassing, disgusting to use or its infiltration will complete and “the haves” will have much much more than ever, and the have nots will be able to complain at their personal surveillance pocket kiosk.
i am sure shaming people who feel the need to open up about their feelings of suicide to an unjudging machine is a great idea. Totaly not a bad idea.
“Unjudging?” Oh no, its definitely compiling your dossier. And users are making it oh so easy.
the machine does not judge, the operator may, but that is not really a factor to many but is an abstract invasion. you can’t whisper your problems to the person sitting next to you without multiple companies trying to sell you a solution.
to someone in need an ai is an attractive option, this has no bearing on if that machine is qualified to do so. and while i get the urgency to move people over to any better option, shame is the quickest way to push someone to the end of the rope.
do not blame those who struggle. any port in a storm
They don’t care if it’s judging just that it agrees with them. Makes you wonder what people actually want when they fall in love with a yes person.
wow, can already tell you know nothing about this and were probably better off not having said anything at all
That’s crazy
A reminder that these chats are being monitored
But imagine the chances for your own business! Absolutely no one will steal your ideas before you can monetize them.
Absolutely blows my mind that people attach their real life identity to these things.
But they tell you that idea you had is great and worth pursuing!
deleted by creator
Still, what are they gonna do to a million suicidal people besides ignore them entirely
Well, AI therapy is more likely to harm their mental health, up to encouraging suicide (as certain cases have already shown).
There’s evidence that a lot of suicide hotlines can be just as bad. You hear awful stories all the time of overwhelmed or fed up operators taking it out on the caller. There’s some real evil people out there. And not everyone has access to a dedicated therapist who wants to help.
Suicide is big business. There’s infrastructure readily available to reap financial rewards from the activity, atleast in the US.
More so from corporate proprietary ones no? At least I hope that’s the only cases. The open source ones suggest really useful ways proprietary do not. Now I dont rely on open source AI but they are definitely better
The corporate models are actually much better at it due to having heavy filtering built in. The fact that a model generally encourages self arm is just a lie that you can prove right now by pretending to be suicidal on ChatGPT. You will see it will adamantly push you to seek help.
The filters and safety nets can be bypassed no matter how hard you make them, and it is the reason why we got some unfortunate news.
Real therapy isn’t always better. At least there you can get drugs. But neither are a guarantee to make life better—and for a lot of them, life isn’t going to get better anyway.
Are you comparing a professional to a text generator?
Have you ever had ineffective professional therapy?
Are you still trying to compare medical treatment with generating text?
Compare, as in equal? No. You can’t “game” a person (usually) like you can game an AI.
Now, answer my question
Real therapy is definitely better than an AI. That said, AIs will never encourage self harm without significant gaming.
AI “therapy” can be very effective without the gaming, but the problem is most people want it to tell them what they want to hear. Real therapy is not “fun” because a therapist will challenge you on your bullshit and not let you shape the conversation.
I find it does a pretty good job with pro and con lists, listing out several options, and taking situations and reframing them. I have found it very useful, but I have learned not to manipulate it or its advice just becomes me convincing myself of a thing.
I agree, and to the comment above you, it’s not because it’s guaranteed to reduce symptoms. There are many ways that talking with another person is good for us.
The keyword here is “person”.
My pet theory: Radicalize the disenfranchised to incite domestic terrorism and further OpenAI’s political goals.
What are their political goals?
Tax breaks for tech bros
I think total control over the country might be the goal, and it’s a bit more than a tax break.
Advertise drugs to them perhaps, or somd sort of taking advantage. If this sort of data is the hands of an ad network that is
No, no. They want repeat customers!
It’s never the drugs I want though :(
You have to decide, a few months ago everyone was blaming OpenAI for not doing anything
Definitely a case where you can’t resolve conflicting interests to everyone’s satisfaction.
Sounds like we should shut them down then to prevent a health crisis then.
why just chill and game.
Why play games if you’re not interested in them? Or don’t have the energy to play. Not so easy to “chill” if you’ll be kicked out your house next week. Lost your job? Bah, just chill and game.
What an absolutely brain dead thing to say.
Maybe they unintentionally forgot to put the word “not” before the word “just”.
im on the verge of getting kicked out. got my laptop and my switch 2. im good homie. been homeless before.
Y’all complain when they do nothing. Y’all complain when they try to be proactive. You neo-luddites need a new hobby.
deleted by creator
