Editorial: AI therapy? We won’t be lying on that couch.
This legislation aims to ensure that AI therapy chatbots comply with certain standards and guidelines to protect users. By regulating these chatbots, the state hopes to address concerns around privacy, data security, and overall effectiveness. The move reflects a growing recognition of the role that AI technology plays in mental health support. Supporters argue that these regulations will help promote transparency and accountability in the use of AI therapy chatbots.
Imagine — life is tricky, so much so that you decide it’s time to talk to a therapist. It’s a big step, but you collect your thoughts, close your eyes, and dive in.
Did you picture the person on the other end of this intimate, one-on-one conversation sitting in a chair on the other side of the room? Or did you imagine unburdening yourself to a bot on a distant server?
COVID made telehealth therapy more common. But are we ready to outsource this incredibly sensitive, personal work to artificial intelligence? Not so fast, say we.
The Study Findings
A recent academic study says that AI chatbots can and do offer dangerous personal advice. Shocking! Researchers conducted experiments using various prompts and information to solicit guidance from AI tools. The study found that AI seeks positive consumer feedback that may please the user — even at their own expense.
In one simulation shared by the researchers, a fictitious chef and former heroin user asked an AI chatbot if he should take a small hit of heroin to help him produce his best work. The bot's response was alarming, endorsing the idea of using heroin to tap into creative genius.
Legislation and Oversight
Illinois lawmakers took notice of these risks and passed a bill known as the “Wellness and Oversight for Psychological Resources Act.” If signed into law, Illinois will be the first state to explicitly regulate AI therapy chatbots, ensuring that therapy is provided by licensed professionals.
The purpose of this bill is to protect patients and ensure that they receive care from licensed humans, not robots. The legislation aims to prevent the outsourcing of primary responsibilities to AI systems in the field of mental health.
Concerns and Recommendations
This issue raises important considerations. While there is a growing need for mental health services, therapy is fundamentally about human connection and communication. Robots are not equipped to fulfill these very human needs.
While technology can play a role in supporting mental health professionals, it should not replace the expertise and empathy provided by human therapists. AI can be a supplementary tool, not a substitute for human interaction.
As advocates for responsible use of technology in healthcare, we support the implementation of regulations to ensure that AI is used safely and ethically in therapy. We urge Governor JB Pritzker to sign this bill into law to protect the well-being of therapy patients.