Technology

genAI chatbots are so predatory

So somewhere they feel safe to do so. Says something pretty fucked up about our culture that men don't feel safe to open up anywhere. And no, it's not their own fault.

This thing has been trained on social media. Is that really wise?

Funny, I was just reading comments in another thread about people with mental health problems proclaiming how terrific it is. Especially concerning is how they had found value in the recommendations LLMs make and "trying those out." One of the commenters described themselves as "neuro diverse" and was acting upon "advice" from generated LLM responses.

And for something like depression, this is deeply bad advice. I feel somewhat qualified to weigh in on it as somebody who has struggled severely with depression and managed to get through it with the support of a very capable therapist. There's a tremendous amount of depth and context to somebody's mental condition that involves more deliberate probing to understand than stringing together words until it forms sentences that mimic human interactions.

Let's not forget that an LLM will not be able to raise alarm bells, read medical records, write prescriptions or work with other medical professionals. Another thing people often forget is that LLMs have maximum token lengths and cannot, by definition, keep a detailed "memory" of everything that's been discussed.

It's is effectively self-treatment with more steps.

I think we may be (re)-discovering the appeal of monotheistic religions, and why they hew patriarchal.

On average, men desperately need more mental health resources. But, on average, they are not comfortable building that with other men, and it often isn't appropriate or effective to lean on their female significant other (if a straight man).

So - enter the primary description of 'God'. Can listen any time but will always forgive, is super masculine but won't emasculate you, and has never told another soul what you are thinking.

AI is always available and is unlikely to emasculate anyone, but that third item... Well, we'll see where this goes.

Even in Canada, where mental health is still a value-add for most of us and not a right even under our current system, we are offered a fund with some jobs to use for either physiotherapy or mental health, and it's a limited fund.

Give us a choice, and 10/10 times we will prioritize being able to walk and move and sleep effectively over feeling good about it.

for me, beer with friends solves it