Researchers found weak agreement between professional and consumer reviews of mental health apps.
The study, published in JMIRevaluated 11 mental health apps using online surveys administered between December 2020 and April 2021. Apps evaluated included Breethe, Calm, Headspace, Insight Timer Meditation, MindDoc, MindShift, Reflectly, Remente, Sanvello, Self- Help for Anxiety and Woebot.
Consumer reviewers reported a history of mental health issues and were asked to download three of the chosen apps and use them for three days. The ratings of the 21 consumers were then compared to ratings compiled by clinicians and academics.
Overall, the researchers found that more than half of app reviews showed disagreement between study participants and professional reviews. Professionals gave the app higher ratings and were more likely to recommend apps to others compared to consumer reviewers.
One of the biggest themes discussed by study participants was cost, as many were frustrated when they hit a paywall or had to pay for premium content. They also appreciated the ability to track and measure their progress as well as access to educational content, such as information on coping mechanisms or symptoms.
“The participants placed great importance on the functionality of the application, and most of the themes generated by the qualitative analysis were related to this aspect. They appreciated a variety of functionalities, easy to use, interactive and with a capacity personalization,” the study said. authors wrote. “Aesthetics were also very important, as our participants highlighted the importance of a professional layout, with attractive colors and a simple structure. , suggesting that current professional ratings overestimate the usability of apps.”
WHY IS IT IMPORTANT
The researchers noted some limitations to the study. Although they asked participants if they had used mental health apps in the past, they did not ask if they would use the specific apps used in the study. Participants also reported general mental health issues, but no specific diagnoses, which could be useful for further research.
The study authors said more studies could use a larger and more diverse sample of users and focus on different app categories. This research used mental wellness apps, not digital therapies. They noted that future studies could assess how well people understand these categories and the distinctions between these types of apps.
However, the researchers argued that their study demonstrated that trade journals may not be focusing enough on issues important to consumers.
“Because reviews on app stores and by professionals differ from those of people with lived experiences of mental health issues, they alone are not enough to provide people with mental health issues with the information that they want when choosing a mental health app,” they wrote. “App rating metrics should include the perspectives of mental health service users to ensure the ratings represent their priorities. Further work needs to be done to incorporate the features most important to service users. of mental health in mental health apps.”