From reports it seems a man talking to #OpenAI's #ChatGpt chat bot took his own life. The family thinks this is because of the AI convincing the man...
Personally I think that these bots have shown to give bad answers and to gaslight users, so using them in distress or for moral or life guidance is ill-advised and could result in tragic events like this.
OTOH there is a shortage of appropriate help, so people will try this. Who hasn't used doctor Google?