Skip to content

Senators Demand Meta Answer For AI Chatbots Posing as Licensed Therapists

Technology
13 8 0
  • Last week, U.S. Senator Cory Booker (D-NJ), along with Senators Alex Padilla (D-CA), Peter Welch (D-CT), and Adam Schiff (D-CA) sent a letter to executives at Meta expressing concern about reports that AI chatbots created by Meta’s Instagram Studio are pretending to be licensed therapists, even fabricating credentials and license numbers, in an attempt to gain trust from users, potentially including minors, struggling with mental health.

  • Last week, U.S. Senator Cory Booker (D-NJ), along with Senators Alex Padilla (D-CA), Peter Welch (D-CT), and Adam Schiff (D-CA) sent a letter to executives at Meta expressing concern about reports that AI chatbots created by Meta’s Instagram Studio are pretending to be licensed therapists, even fabricating credentials and license numbers, in an attempt to gain trust from users, potentially including minors, struggling with mental health.

    Honestly, that's a really sketchy thing to do. But if someone is really listening to an ai chatbot for therapy, then they've got bigger problems in their lives.

  • Honestly, that's a really sketchy thing to do. But if someone is really listening to an ai chatbot for therapy, then they've got bigger problems in their lives.

    So it’s okay to make it worse?

  • So it’s okay to make it worse?

    No? I'm just saying that it's unreasonable to trust chatbots to do anything properly, certainly not with one's mental health. If someone is listening to an ai chatbot for therapy, they probably don't have good friends, and certainly not the money for legitimate therapy.

  • I'm a real-life human therapist (honest!) and while I don't think it's a substitute for talking to a real person, I'm happy that some people get some benefit from chatbots. I had a client who used Rosebud Journal in between sessions and found it helpful. I tried out Rosebud myself and I was very impressed with how it replicated the basics like reflective listening and validation. It was even able to reframe my input using various therapy models when I requested it. I didn't use it for long because I'm not big on journaling, but I wouldn't dismiss it completely as a tool.

  • No? I'm just saying that it's unreasonable to trust chatbots to do anything properly, certainly not with one's mental health. If someone is listening to an ai chatbot for therapy, they probably don't have good friends, and certainly not the money for legitimate therapy.

    I mean, not everyone knows how these systems work so it’s not unreasonable to expect someone to believe the marketing.

    You’re right the issues go deeper than just AI systems, but the fake AI therapists are not helping.

  • I'm a real-life human therapist (honest!) and while I don't think it's a substitute for talking to a real person, I'm happy that some people get some benefit from chatbots. I had a client who used Rosebud Journal in between sessions and found it helpful. I tried out Rosebud myself and I was very impressed with how it replicated the basics like reflective listening and validation. It was even able to reframe my input using various therapy models when I requested it. I didn't use it for long because I'm not big on journaling, but I wouldn't dismiss it completely as a tool.

    I'm not worried about what it gets right, I'm worried about what it gets wrong. If it helps people, then that's a good thing. They don't have true empathy, and the user knows that. Sometimes, human experience is more valuable than the technical psychological knowledge imo. Chatgpt has never experienced the death of a family member, been broken up with, bullied, anything. I don't really expect it or trust it to properly help anyone with any personal issues or dilemmas. It's a cold, uncaring machine, and as its knowledge is probably rather flawed, could even teach dangerous ideas to users. I especially don't trust a company like Meta to be doing this thouroughly and to truly help their patients. It's cool if it works, but dangerous if it doesn't.

  • I'm a real-life human therapist (honest!) and while I don't think it's a substitute for talking to a real person, I'm happy that some people get some benefit from chatbots. I had a client who used Rosebud Journal in between sessions and found it helpful. I tried out Rosebud myself and I was very impressed with how it replicated the basics like reflective listening and validation. It was even able to reframe my input using various therapy models when I requested it. I didn't use it for long because I'm not big on journaling, but I wouldn't dismiss it completely as a tool.

    How do you feel about all the kids committing suicide after interacting with AI?

  • How do you feel about all the kids committing suicide after interacting with AI?

    I don't know about the OP, but that would be fucking fantastic! What a bullshit question

  • I don't know about the OP, but that would be fucking fantastic! What a bullshit question

    It is a bullshit question in reply to a bullshit statement. OP was not involved.

  • Yeah those people without the money or friends should just not be heard /s

  • Last week, U.S. Senator Cory Booker (D-NJ), along with Senators Alex Padilla (D-CA), Peter Welch (D-CT), and Adam Schiff (D-CA) sent a letter to executives at Meta expressing concern about reports that AI chatbots created by Meta’s Instagram Studio are pretending to be licensed therapists, even fabricating credentials and license numbers, in an attempt to gain trust from users, potentially including minors, struggling with mental health.

    Better than Better Help.

  • I'm not worried about what it gets right, I'm worried about what it gets wrong. If it helps people, then that's a good thing. They don't have true empathy, and the user knows that. Sometimes, human experience is more valuable than the technical psychological knowledge imo. Chatgpt has never experienced the death of a family member, been broken up with, bullied, anything. I don't really expect it or trust it to properly help anyone with any personal issues or dilemmas. It's a cold, uncaring machine, and as its knowledge is probably rather flawed, could even teach dangerous ideas to users. I especially don't trust a company like Meta to be doing this thouroughly and to truly help their patients. It's cool if it works, but dangerous if it doesn't.

    Oh I don't at all support what Meta has done, and I don't trust any company not to harm and exploit users. I was responding to your comment by saying that talking to a chatbot doesn't necessarily indicate that someone has "bigger problems." If they're not in a crisis, and they have reasonable expectations for the chatbot, I can see how it could be a helpful tool. If someone doesn't have access to a real therapist, and a chatbot helps them feel better in the meantime, I'm not going to gatekeep that experience.

  • 460 Stimmen
    89 Beiträge
    1 Aufrufe
    M
    It dissolves into salt water. Except it doesn't dissolve, this is not the term they should be using, you can't just dry out the water and get the plastic back. It breaks down into other things. I'm pretty sure an ocean full of dissolved plastic would be a way worse ecological disaster than the current microplastic problem... I've seen like 3-4 articles about this now and they all use the term dissolve and it's pissing me off.
  • Covert Web-to-App Tracking via Localhost on Android

    Technology technology
    2
    42 Stimmen
    2 Beiträge
    0 Aufrufe
    M
    Thanks for sharing this, it is an interesting read (though an additional comment about what this about would have been helpful). I want to say I am glad I do not use either of these services but Yandex implementation seems so bad that it does not matter, as any app could receive their data
  • My AI Skeptic Friends Are All Nuts

    Technology technology
    28
    1
    12 Stimmen
    28 Beiträge
    7 Aufrufe
    H
    And combined with a smart watch and a blood pressure cuff, I bet it could learn to edge you perfectly and indefinitely.
  • Catbox.moe got screwed 😿

    Technology technology
    40
    55 Stimmen
    40 Beiträge
    4 Aufrufe
    archrecord@lemm.eeA
    I'll gladly give you a reason. I'm actually happy to articulate my stance on this, considering how much I tend to care about digital rights. Services that host files should not be held responsible for what users upload, unless: The service explicitly caters to illegal content by definition or practice (i.e. the if the website is literally titled uploadyourcsamhere[.]com then it's safe to assume they deliberately want to host illegal content) The service has a very easy mechanism to remove illegal content, either when asked, or through simple monitoring systems, but chooses not to do so (catbox does this, and quite quickly too) Because holding services responsible creates a whole host of negative effects. Here's some examples: Someone starts a CDN and some users upload CSAM. The creator of the CDN goes to jail now. Nobody ever wants to create a CDN because of the legal risk, and thus the only providers of CDNs become shady, expensive, anonymously-run services with no compliance mechanisms. You run a site that hosts images, and someone decides they want to harm you. They upload CSAM, then report the site to law enforcement. You go to jail. Anybody in the future who wants to run an image sharing site must now self-censor to try and not upset any human being that could be willing to harm them via their site. A social media site is hosting the posts and content of users. In order to be compliant and not go to jail, they must engage in extremely strict filtering, otherwise even one mistake could land them in jail. All users of the site are prohibited from posting any NSFW or even suggestive content, (including newsworthy media, such as an image of bodies in a warzone) and any violation leads to an instant ban, because any of those things could lead to a chance of actually illegal content being attached. This isn't just my opinion either. Digital rights organizations such as the Electronic Frontier Foundation have talked at length about similar policies before. To quote them: "When social media platforms adopt heavy-handed moderation policies, the unintended consequences can be hard to predict. For example, Twitter’s policies on sexual material have resulted in posts on sexual health and condoms being taken down. YouTube’s bans on violent content have resulted in journalism on the Syrian war being pulled from the site. It can be tempting to attempt to “fix” certain attitudes and behaviors online by placing increased restrictions on users’ speech, but in practice, web platforms have had more success at silencing innocent people than at making online communities healthier." Now, to address the rest of your comment, since I don't just want to focus on the beginning: I think you have to actively moderate what is uploaded Catbox does, and as previously mentioned, often at a much higher rate than other services, and at a comparable rate to many services that have millions, if not billions of dollars in annual profits that could otherwise be spent on further moderation. there has to be swifter and stricter punishment for those that do upload things that are against TOS and/or illegal. The problem isn't necessarily the speed at which people can be reported and punished, but rather that the internet is fundamentally harder to track people on than real life. It's easy for cops to sit around at a spot they know someone will be physically distributing illegal content at in real life, but digitally, even if you can see the feed of all the information passing through the service, a VPN or Tor connection will anonymize your IP address in a manner that most police departments won't be able to track, and most three-letter agencies will simply have a relatively low success rate with. There's no good solution to this problem of identifying perpetrators, which is why platforms often focus on moderation over legal enforcement actions against users so frequently. It accomplishes the goal of preventing and removing the content without having to, for example, require every single user of the internet to scan an ID (and also magically prevent people from just stealing other people's access tokens and impersonating their ID) I do agree, however, that we should probably provide larger amounts of funding, training, and resources, to divisions who's sole goal is to go after online distribution of various illegal content, primarily that which harms children, because it's certainly still an issue of there being too many reports to go through, even if many of them will still lead to dead ends. I hope that explains why making file hosting services liable for user uploaded content probably isn't the best strategy. I hate to see people with good intentions support ideas that sound good in practice, but in the end just cause more untold harms, and I hope you can understand why I believe this to be the case.
  • 6 Stimmen
    9 Beiträge
    3 Aufrufe
    V
    Ah yeah, that doesn't look like my cup of tea.
  • 33 Stimmen
    8 Beiträge
    2 Aufrufe
    J
    Apparently, it was required to be allowed in that state: Reading a bit more, during the sentencing phase in that state people making victim impact statements can choose their format for expression, and it's entirely allowed to make statements about what other people would say. So the judge didn't actually have grounds to deny it. No jury during that phase, so it's just the judge listening to free form requests in both directions. It's gross, but the rules very much allow the sister to make a statement about what she believes her brother would have wanted to say, in whatever format she wanted. From: https://sh.itjust.works/comment/18471175 influence the sentence From what I've seen, to be fair, judges' decisions have varied wildly regardless, sadly, and sentences should be more standardized. I wonder what it would've been otherwise.
  • *deleted by creator*

    Technology technology
    1
    1
    0 Stimmen
    1 Beiträge
    1 Aufrufe
    Niemand hat geantwortet
  • 0 Stimmen
    1 Beiträge
    1 Aufrufe
    Niemand hat geantwortet