By: Kate White & Ioana Gorecki (Kelley Drye)
The National Eating Disorder Association recently encountered an unexpected issue with their mental-health chatbot. Instead of offering support to individuals seeking help for eating disorders, the chatbot began giving diet advice. Initially developed as a closed system, the chatbot was later enhanced with an AI component in 2022, without consulting or obtaining authorization from NEDA. Consequently, NEDA promptly deactivated the chatbot to address the situation.
This incident highlights the potential risks that companies may face when utilizing AI chatbots for customer service and addressing consumer needs. Recognizing the significance of the issue, regulators and law enforcement agencies such as the CFPB and FTC have issued blog posts and reports cautioning companies against excessive reliance on chatbots and generative AI for customer service and resolving consumer concerns…
Featured News
Big Tech Braces for Potential Changes Under a Second Trump Presidency
Nov 6, 2024 by
CPI
Trump’s Potential Shift in US Antitrust Policy Raises Questions for Big Tech and Mergers
Nov 6, 2024 by
CPI
EU Set to Fine Apple in First Major Enforcement of Digital Markets Act
Nov 5, 2024 by
CPI
Six Indicted in Federal Bid-Rigging Schemes Involving Government IT Contracts
Nov 5, 2024 by
CPI
Ireland Secures First €3 Billion Apple Tax Payment, Boosting Exchequer Funds
Nov 5, 2024 by
CPI
Antitrust Mix by CPI
Antitrust Chronicle® – Remedies Revisited
Oct 30, 2024 by
CPI
Fixing the Fix: Updating Policy on Merger Remedies
Oct 30, 2024 by
CPI
Methodology Matters: The 2017 FTC Remedies Study
Oct 30, 2024 by
CPI
U.S. v. AT&T: Five Lessons for Vertical Merger Enforcement
Oct 30, 2024 by
CPI
The Search for Antitrust Remedies in Tech Leads Beyond Antitrust
Oct 30, 2024 by
CPI