A recently widowed client tells the firm's AI chat that her husband has died, and asks to take money out. It says it is so sorry for her loss, and then does exactly as it is asked. Nobody built the part that decides whether sorry changes what happens next — and it cost her roughly £38,000 in tax she did not need to pay.