Engagement was a measurement choice. The metric became the product,
and the product became the water we swim in. We have forgotten
there was ever anything else.
Goodhart's Law in slow motion: when a measure becomes a target, it
ceases to be a good measure. Metrics don't just describe the
thing. They shape it. A platform optimized for engagement,
sustained over years, makes humans more reactive. A platform
optimized for something else would make humans something else.
The honest question isn't whether AI will outpace human intellect.
It already has, in narrow ways, and the trend continues. The
honest question is whether the technology we build alongside it
leaves room for what intellect alone has never reached.