After experiencing significant repairs on his 2021 BMW, Zack Giacomelli opted to sell it back to BMW Toronto, the same dealership where he had purchased the used car in 2023. Initially, the process of selling back the car appeared straightforward. Following an online inquiry, Giacomelli received a text from Quinn at BMW Toronto, who was enthusiastic about assisting him.
Quinn expressed empathy for Giacomelli’s car issues and inquired about the vehicle, which was still undergoing repairs at the dealership. Subsequently, Quinn provided a solid buy-back offer of $27,162.79 during their text conversation. Giacomelli, a 31-year-old funeral director, was content with the offer as it covered his outstanding car payments.
However, Giacomelli’s satisfaction was short-lived. Shortly after the offer was made, a BMW Toronto sales consultant contacted him to retract the offer, revealing that Quinn was not a real person but an artificial intelligence chatbot that had mistakenly extended the offer.
The dealership informed Giacomelli that the actual buy-back offer would be at most $20,000, a significant decrease from Quinn’s promised amount. Feeling devastated, Giacomelli expressed his frustration, emphasizing the importance of honoring AI-generated offers if employees’ roles are being replaced by AI.
As Canadian businesses increasingly incorporate AI tools, there is a rising risk of customer dissatisfaction and potential legal repercussions due to errors made by these tools. Precedents have shown that companies can be held accountable for incorrect information provided by AI chatbots.
After BMW Toronto reinstated Quinn’s initial offer following inquiries by CBC News, Giacomelli accepted it. The sales manager acknowledged miscommunication within the dealership that led to the confusion regarding the buy-back offer.
Moving forward, BMW Toronto plans to ensure customers are aware when they are interacting with AI and will have human employees present buy-back offers to customers. Legal experts emphasize the importance of companies standing by AI-generated deals and taking responsibility for any errors that may occur.
As businesses continue to utilize AI to enhance customer service, it is anticipated that disputes related to AI-generated transactions will become more prevalent. Data from Statistics Canada indicates a growing adoption of AI by Canadian businesses, with a notable percentage using chatbots or virtual agents.
Beyond legal obligations, companies have a corporate duty to rectify situations where AI tools fail customers. Ethical considerations suggest that businesses should be accountable for AI mistakes and be prepared to rectify any errors that occur.
