It is extremely confident especially when it’s wrong

This reminded me of a recent study I saw posted about the accuracy of AI and trying to remove hallucinations. One of the conclusions of which being, besides that it’s impossible to stop them from hallucinating, that the tests companies use to grade the quality of an AI and the expectations of users grade confidence in an answer higher than the accuracy of the answer.