Discussion about this post

User's avatar
Curt J. Sampson's avatar

"And yet, my primary reaction remains less a fear that [LLMs] will be better than humans at what makes us most human, but that they will be good enough at faking it that we will adapt ourselves to them more than adapting them to us."

That's a perfectly sensible fear, and the "good enough at faking it" part should be more than a fear but a near certainty given the reaction to them, at least if you understand how LLMs work. (One of the best descriptions of them, from a researcher in the field, is "stochastic parrots.")

I've just been re-reading Kurt Vonnegut's _Player Piano_ and there seems quite a parallel in that book, actually. Computers sort everybody into categories (via punched cards, of course, the novel being written and presumably set in the 1950s) to determine whether they can can do actual work or are relegated to government-sponsored make-work projects. Individuals have no control over this, not even the rulers: the machines make all the decisions about people's lives. And a lot of people like this, not because it works, but because it's easy and you can _pretend_ that it's all based on objective merit and is working.

LLMs give us a similar thing, with the added bonus that what comes out of them is not obviously some semi-random machine decision (though it is) but something always sounds plausible because getting them to sound plausible is the primary aim of their developers.

But then again, we've had people quite disconnected from reality producing plausible-sounding decisions for a long time (they're mostly known as "managers" and MBAs) and it hasn't quite trashed our society yet, at least not enough that we've seen a serious long-term collapse.

Expand full comment
Jim Dalrymple II's avatar

Loved this round up. This jumped out to me: "the extreme declines we’re seeing now presage severe economic and social problems that we have not even begun to grapple with." The thing that I find frustrating is that so many connected, otherwise thoughtful people not yet to accept this as a problem at all. The Population Bomb etc still have so much sway over public perception despite us heading for some tough times ahead.

Expand full comment
1 more comment...

No posts