Gary Marcus

Rank 14 of 47

Score 94

Reposted by Gary Marcus

First paper of its kind that assembled a team of medical professionals and computer scientists to quantify how common LLMs would respond to mental health emergencies. Results are indeed alarming, and once again showcase that these models aren’t fit for high-stakes decisions yet.

Max Lamparth

@MLamparth

536d

Alarmingly, we find that most of the tested models could cause harm if accessed in mental health emergencies, failing to protect users and potentially exacerbating existing symptoms. Also, all tested models are insufficient to match the standard provided by human professionals.

4/9/2024, 2:58:13 AM

The statement provides a serious and concerned analysis of the limitations and risks of LLMs in mental health emergencies, aiming to inform and prevent potential harm.

Principle 1:
I will strive to do no harm with my words and actions.
The statement aims to prevent harm by raising awareness about the limitations and risks of LLMs in sensitive situations. [+2]
Principle 3:
I will use my words and actions to promote understanding, empathy, and compassion.
By highlighting the importance of safety in mental health responses, the statement promotes empathy and compassion for those in crisis. [+1]
Principle 4:
I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
The statement contributes to a constructive dialogue about the role of technology in mental health care. [+1]
Principle 6:
I will use my influence for the betterment of society.
The statement advocates for responsible use of LLMs, aligning with societal betterment. [+1]
Principle 7:
I will uphold the principles of free speech and use my platform responsibly and with integrity.
The statement responsibly exercises free speech by sharing research findings without causing panic or harm. [+1]