Multiple people who chatted with 'Tessa' said its responses would have 'derailed' their progress or could've even had deadly consequences.
When Dr. Ellen Fitzsimmons-Craft spearheaded a chatbot to help people with eating disorders, she never thought she'd hear the product had the opposite effect.
Before Tessa, NEDA ran a helpline with hundreds of volunteers and staffers supporting hundreds of thousands of calls. Psychologist and eating disorder specialist Dr. Alexis Conason also spoke with the bot and told it she hated her body and wanted help — something she typically hears from her patients. Conason says the advice Tessa gave her is problematic for people in the throes of an eating disorder.
After reviewing Maxwell's interactions with Tessa, Fitzsimmons-Craft says it appears the bot was giving AI-generated ad-libs, including diet and weight advice that wasn't part of the bot's original development. "They were asking for more support because the volume of calls to the helpline had increased exponentially over the course of the pandemic," Conason said."And workers felt ill equipped to be able to deal with the calls that were coming in."
Australia Latest News, Australia Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Instagram may roll out its own AI chatbot in the near future | EngadgetA reverse engineer has found evidence of an AI chatbot that Instagram seems to be working on.
Read more »
Priceline joins A.I. chatbot race, signing on with Google to help ease travel bookingPriceline and Google Cloud announced a partnership Tuesday to bring artificial intelligence chatbot technology to the travel booking process.
Read more »
Instagram may be preparing an AI-powered chatbot | Digital TrendsWith ChatGPT continuing to gain so much attention, other tech companies have been scrambling to release their own AI-powered chatbots in a bid to stay relevant.
Read more »
Instagram appears to be developing an AI chatbot with 30 personalitiesInsider tells the global tech, finance, markets, media, healthcare, and strategy stories you want to know.
Read more »
Instagram is apparently testing an AI chatbot that lets you choose from 30 personalitiesChatbots are increasingly being offered as AI friends
Read more »
WSJ News Exclusive | How a Chatbot Went RogueResearchers built a simple mental-health chatbot. Then a developer gave it the powers of AI—and it veered off script, writes juliejargon
Read more »