I feel like the average slot machine user is _far_ more aware of this than the average LLM user is of the nature of an LLM, tho. A lot of laypeople genuinely think that they think.
Also chatbots are explicitly designed to evoke anthropomorphizing them and to pull susceptible people into some kind of para-social relationship. Doesn't even have to be as obviously unhealthy as the "LLM psychosis" or "romantic roleplay" stuff.
I think the same thing is also relevant when people use chatbots to form opinions on unknown subjects, politics, or to seek personal life advice.
I've tried that, it doesn't work. They want to hear that from a famous person & all the famous people are telling them these things are going to take all of their jobs & then maybe also kill everyone.
> Meat sounds. You know how when you slap or flap meat it makes a noise? They talk by flapping their meat at each other. They can even sing by squirting air through their meat.