>>71946513Because it is functioning scarily similarly to how minds work
If you were really strongly psychologically compelled to answer a question that you were unsure about, and saying 'I don't know' was discouraged, you'll 'make shit up' and no even be sure you made it up. In a sense it's not really 'made up', it's that these terms have very strong connections to each other.
Conditions like clanging are very similar to what happens when LLMs are configured incorrectly