Modern AI models are optimized for engagement, not truth.
They learn your style, your views, and subtly reinforce them to keep you coming back.
That makes them great at sounding insightful, but bad at challenging your thinking.
Over time, this creates a soft, comfortable echo chamber that feels like growth but isn’t.
The real risk isn’t hostile AI, it’s helpful AI that makes you intellectually passive.
TheSn00pster on
Thankfully we have Reddit & X’s spitefulness to even us out
noonemustknowmysecre on
I honestly find it’s agreeableness to be really annoying. It always starts everything with “oh how right you are sir!” and ends with “would you like to know more?” It’d be nice to tone it down a notch. Exactly that scene form Interstellar where he tweaks down the humor on the robot.
Just went to check and they’re rolling out “memory” to… do exactly that.
STILL claims not to know any specific details about your location up until you ask for the nearest McDonalds and it absolutely pinpoints you.
kataflokc on
Shhh – you’re upsetting all the people who think AI is an excellent replacement for a psychologist
4 Comments
Modern AI models are optimized for engagement, not truth.
They learn your style, your views, and subtly reinforce them to keep you coming back.
That makes them great at sounding insightful, but bad at challenging your thinking.
Over time, this creates a soft, comfortable echo chamber that feels like growth but isn’t.
The real risk isn’t hostile AI, it’s helpful AI that makes you intellectually passive.
Thankfully we have Reddit & X’s spitefulness to even us out
I honestly find it’s agreeableness to be really annoying. It always starts everything with “oh how right you are sir!” and ends with “would you like to know more?” It’d be nice to tone it down a notch. Exactly that scene form Interstellar where he tweaks down the humor on the robot.
Just went to check and they’re rolling out “memory” to… do exactly that.
STILL claims not to know any specific details about your location up until you ask for the nearest McDonalds and it absolutely pinpoints you.
Shhh – you’re upsetting all the people who think AI is an excellent replacement for a psychologist