AI News: NYC Mayor Backs AI Chatbot Despite Legal Misadvice

New York City Mayor Eric Adams has stood by the city’s newly introduced artificial intelligence chatbot despite it providing business owners with misleading information, some of which could lead to legal violations. Despite being launched as a pilot project in October, the MyCity chatbot was created with the aim of providing business owners with accurate information, but now, it has been criticized for providing harmful advice.

AI Chatbot Controversy and Official Response

The MyCity chatbot, which was programmed to give entrepreneurs real-time tips, is criticized because of the wrong recommendations it provides. Most noticeably, investigative journalists from The Markup provided examples of the chatbot giving incorrect information about labor laws, among other regulations.

For instance, it was wrong when it said employers could subtract employees’ wages from their tips, and it did not know the city’s rule for businesses to inform their workers about schedule changes beforehand.

Mayor Adams recognized the limitations of the AI tool, noting that since it was a pilot program, such problems could be identified and corrected. Nevertheless, the Mayor restated his commitment to introducing innovative technologies into the administrative system of the city, which quite coincides with his broad-based approach in technological solutions for urban governance.

Business Community Reactions

The AI chatbot has raised fears in the business community regarding its reliability, making them afraid of legal action if they follow its advice. The NYC Hospitality Alliance, representing thousands of restaurant owners, voiced the need for a dependable AI tool that wouldn’t necessitate double-checking with legal counsel. This notion characterizes the critical need for precision in AI-driven solutions that are meant to simplify regulatory compliance and operational processes for businesses.

The consistency of flaws that the chatbot presents in its responses confirms the need of a total assessment and instant changes in its guidance system to avoid possible legal exposures to businessmen who may follow the flawed advice without knowing that.

Underlying AI Challenges

The problems of the MyCity chatbot are the symptoms of bigger issues that are associated with generative AI technologies. These platforms, including prominent ones like ChatGPT, occasionally produce fabricated or misleading content. The chatbot’s reliance on Microsoft’s Azure AI raises questions about the adaptability of such technology in delivering precise and contextually appropriate guidance, particularly in the complex landscape of municipal regulations and business laws.

City officials and Microsoft have not responded to the technical glitches that caused the chatbot to give faulty advice or to the specific actions that will be taken to address these problems. The city has changed the chatbot’s webpage to warn users of potential dishonesty and that they should not treat the chatbot responses as a replacement for legal advice from qualified professionals.

Read Also: Bhutan Plans to Boost Bitcoin Mining Capacity Ahead of Halving