Mind to tackle AI mental health concerns with new commission

Mental health charity Mind is launching a commission to address concerns about inappropriate and dangerous mental health guidance from AI tools.

The year-long AI and Mental Health Commission will explore how to manage the risks and prevent harms where AI is being used as a substitute for therapy, crisis support, or clinical guidance.

It follows the launch of ChatGPT Health in the US, which allows people to upload their medical records for health advice.

Although, the AI tool is not yet available in the UK, Mind says that it is seeing a growing number of people seeking help after receiving inappropriate, misleading or dangerous advice from AI.

The charity has found that some people are forming emotionally dependent or quasi-therapeutic relationships with AI tools that are not designed, regulated or clinically aligned to provide mental health support.

Dr Sarah Hughes, chief executive at Mind, said: “We believe AI has enormous potential to improve the lives of people with mental health problems, widen access to support, and strengthen public services.

“But that potential will only be realised if it is developed and deployed responsibly, with safeguards proportionate to the risks.

“We are already seeing examples of AI tools offering dangerously incorrect guidance on mental health, including advice that could prevent people from seeking treatment, reinforce stigma or, discrimination and in the worst cases, put lives at risk.

“People deserve information that is safe, accurate and grounded in evidence, not untested technology presented with a veneer of confidence.”

The AI and Mental Health Commission will bring together people with lived experience of mental health problems, clinicians, technologists, ethicists and policymakers to develop practical recommendations.

It is intended to be a long-term platform outside of regulatory machinery and commercial interests, and will release regular reports sharing findings, insights and recommendations for further work.

Dr Hughes added: “Mind is a trusted source of information for those with mental illness, at this moment that landscape is shifting radically and it’s vital we use our insight and platform to shape how AI impacts on mental health provision.

“Our commission will examine the risks, opportunities and safeguards needed as AI becomes more deeply embedded in everyday life.

“We want to ensure that innovation does not come at the expense of people’s wellbeing, and that those of us with lived experience of mental health problems are at the heart of shaping the future of digital support.”

Meanwhile in January, the Medicines and Healthcare products Regulatory Agency published guidance on how to use AI tools safely to help tackle the increasing number of people turning to mental health apps and technologies for support.

Learn more about the importance of lived experience in developing digital mental health technologies in this episode of Digital Health Unplugged.