Rendered at 17:21:06 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
Murfalo 2 days ago [-]
I love this line of thinking but the framing comes across to me as a bit inflammatory and uncharitable. Just about anything involved in the exchanged of ideas can be viewed as a virus! That is because, when viewed from an evolutionary biology perspective, ideas are the cognitive equivalent of genes (in fact, this is where the term meme comes from).
There's a whole field, evolutionary memetics, dedicated to this. Cultural values, marketing, religion, social media, education, propaganda, etc. can all be viewed quite naturally through this lense. Even the terms we use in every day language (eg, going "viral") seem to intuitively grasp this.
Is my friend a virus for recommending me their favorite book? Well, yes I guess, but that's kind of just how ideas work. Just my two cents
beloch 2 days ago [-]
>"We model transitions among uncoupled, coupled, and persistently dependent users, and show that the interplay between social transmission, recovery, and collective reinforcement can generate tipping points and technological lock-in."
You can finish reading your friend's favorite book or put it down if you don't like it. Neither are you economically compelled to read it by your workplace or forced to build work on top of it that will become difficult or impossible to modify/maintain if you bin the book.
I get that the title sounds a bit sensational, but there really is something to AI adoption beyond book-sharing.
left-struck 2 days ago [-]
I don’t disagree with you, actually I kind of feel the same about smartphone adoption. It’s basically assumed now that you have a smartphone. You can’t enter some places without a ticket on your smartphone, or can’t order at some restaurants. Government processes are starting to require smartphones. Maybe it will be similar with AI.
And you know, I love computers, I used to love the internet. And I’ve had so much fun, more fun then ever coding with AI assistance. Lets say all of these technologies can be abused and forced on us, but all of them have neat aspects too.
AnotherGoodName 2 days ago [-]
Fwiw i noticed you absolutely can't reasonably get a US Via consulate appt for some countries without AI right now so the requiremnts already begun.
The consulate is booked out for 3 months and only opens 3 months out. All openings are snapped up before any human could get one. They have a lot of anti-script blocking but AI seems to get around them. So there's an arms race, you pretty much need AI to book it (a basic hand written curl script isn't enough).
left-struck 2 days ago [-]
Oh wow, that’s aweful. Where I used to live this would happen with driving tests. Driving schools would book out all the tests and then re-assign them to their students. So at some point it got so bad that when you’re buying a driving lesson you’re also effectively buying a right to take the test. What could the government possibly do to stop this? Some highly technical solution? How about just making it so you can’t assign the test to another name? Hmm that might be a pretty obvious solution…
CalRobert 1 days ago [-]
You could require a phone call or mailing a form (in the post) I suppose.
somenameforme 1 days ago [-]
Steam also had a pretty nice idea with the Steamdeck. You book appointments for a month in the e.g. 2 weeks prior, but those who get booked, and when they are booked, are randomly chosen amongst all people/times in those 2 weeks. And then you repeat the same process next month and so on.
skeptic_ai 1 days ago [-]
Exactly. There are ways if you truly want to avoid that race. It just means the provider doesn’t care about bots
mailonce 22 hours ago [-]
[flagged]
2 days ago [-]
roenxi 2 days ago [-]
>
You can finish reading your friend's favorite book or put it down if you don't like it. Neither are you economically compelled to read it by your workplace or forced to build work on top of it that will become difficult or impossible to modify/maintain if you bin the book.
Economics does sometimes compel you to read books or other material as a condition or expectation of employment. It is difficult to get a good job while being illiterate and many jobs require reading huge volumes of written work. Work in law or journalism springs to mind as economically compelling people to read a lot even if they they might not necessarily want to.
computably 2 days ago [-]
? That's a complete non sequitur.
breezybottom 1 days ago [-]
Cute phrase, but that's not how it's used.
Murfalo 2 days ago [-]
Tipping points and technological lock-in aren't new (e.g., the printing press, the radio, TV, phones, the internet, etc.). I do absolutely see your distinction, though, that prior technologies may have been less capable of imposing specific belief systems compared to frontier LLMs.
That's a fair point, and a key reason why competitive open models are so important. I definitely don't want to be stuck using Google's latest and greatest LLM once companies, marketers, and PACs can pay to subtly influence responses as they choose.
We've all seen this movie before, though.
tehjoker 2 days ago [-]
what about the bible? the most printed book of that era
Murfalo 1 days ago [-]
Fair, I may have tried too hard to see the other side of the argument! Sensitive topic of course, but definitely one of the clearer cases where "just put the book down" has not always an entirely available option.
card_zero 1 days ago [-]
Memes replicate and survive or perish like genes, but the environment they have to survive in is the human mind, and the threat that they have to overcome is being criticized. One way to survive this is by being a good idea. So some memes are simply good ideas. But there are various ways a meme can dodge the attack that comes from criticism, and then you get memes that are trendy or holy or crazy or ideological. Since we're not perfect in our ability to criticize (what would that even be like? Sounds terrible) I think there's necessarily a hint of this anti-rational aspect in all ideas. But some of them go all-in on the anti-rational strategy.
crummy 1 days ago [-]
Well, the Bible sort of compels you to share it, and in some societies you are economically and socially encouraged to do so.
greenowl 2 days ago [-]
For many of us, AI adoption is really an AI mandate.
scotty79 2 days ago [-]
If you are an employee, the employer has control over how you should do your work. IF you don't like that, transition to being a contractor and sign service agreements where you are going to be paid solely for results not for how you achieve them.
coldtea 2 days ago [-]
That will change things for him, or any others taking the same course.
Hundreds of millions can't all become contractors, and realistically wont all become contractors.
So the issue described is a real social issue, whether he can "just" quit and avoid it or not.
scotty79 1 days ago [-]
That's the nature of employment relationship. On the flipside, as long as you follow employers rules, you don't bear the responsibility for the results. That's a huge upside that have always balanced out the lack of control over they way you work and your fate for many people.
simianwords 1 days ago [-]
How it reads is that the world has converged on an obviously bad technology. If only you had the chance to control it from top down and you wouldn’t let this mistake happen for you know what’s best for the world. Not only that, it’s double bad because you can’t do anything about it because everyone is under the illusion except you and a few other sensible people. And you would reject the notion that you have agency to change things.
Can’t take it seriously.
coldtea 1 days ago [-]
How the above reads is you can't understand anything wider than your personal affairs.
Or you believe that the world can't possibly converge on a bad technology or practice, and get bad outcomes out of it, while much fewer see potential issues and warn about them.
Both of which can't be taken seriously.
simianwords 1 days ago [-]
The world fortunately works under a system that is durable to these problems. You can actually start a company that doesn't use AI if you think it runs better that way. This argument obviously doesn't work because
1. you would decline the agency existing to make a new company
2. you might even say that AI does help companies work better, but its bad for people - suddenly its no longer about the lack of competency of AI but rather how good it is
coldtea 1 days ago [-]
>The world fortunately works under a system that is durable to these problems
The world works under a system that populations have suffered or even whole countries and empires perished because of systemic problems.
If your answer is "but humanity still endured and is alive today", that's a pretty low bar, not to mention moving the goalposts so far they can't even be seen anymore.
>You can actually start a company that doesn't use AI if you think it runs better that way
I can. And it means nothing to the concern of the parent: "For many of us, AI adoption is really an AI mandate". Your solution is "if you don't like your employer demanding you use AI, just start your own company".
Agency doesn't mean do any arbitrary action and there's no risk or downsides.
Will you pay for their expenses to start their own company? Will you personally loan them money? Will you teach them business skills needed to run a company after they've been a regular employee programmer for 2 decades? Will you feed their kids if the company doesn't catch on? Will you find them employment if they have to shut it down and go back to a regular job as a 40 or 50 year old, in this job market, where you can apply for 20 jobs and not even hear back? Oh, and do the same for millions of others, not just your friend or your favorite cousin?
It doesn't matter whether some individual person can make a non-AI company, since the argument was never about the inability to make one.
It was about millions of people pressured to use AI in their jobs whether they like it or not. "Oh, those millions are only pressured because they lack the agency to start their own business" even more out-of-touch that "let them eat cake".
It's the boomer's "pull yourself by the bootstraps" sermon. Like the idea that millions can't find a job because they lack agency and a firm handshake, or that they're in debt because of that latte.
bbor 2 days ago [-]
So this article makes sense as long as you assume that LLMs enslave their users into purely-harmful, inescapable cognitive slavery.
Other than that, it's pretty grounded!
jaggederest 2 days ago [-]
Other than that, Ms. Lincoln, how was the play?
gmfawcett 1 days ago [-]
The model in the article has applicability problems, but not that one.
scotty79 2 days ago [-]
> Neither are you economically compelled to read it by your workplace or forced to build work on top of it that will become difficult or impossible to modify/maintain if you bin the book.
Things go viral in professional settings as well. Scrum, agile, pc language ... I'm sure you can find other professional trends that if you decided not to follow your career would be jeopardized.
coldtea 2 days ago [-]
And those things also have virus like qualities
scotty79 1 days ago [-]
Large parts of eucariotic DNA comes from ancient viruses so in a sense, viral things make us who we are. At least in large part.
satvikpendem 2 days ago [-]
Speaking of memetics and favorite books, check out There Is No Antimemetics Division by qntm who also wrote some seminal short stories including the one that inspired the Alex Garland show Devs. The book is about how to deal with beings that make you forget you ever saw then, a sort of opposite mind virus.
mjmjmjmj 1 days ago [-]
great book
BenoitP 8 hours ago [-]
> Is my friend a virus for recommending me their favorite book?
In that case the book would be a virus, and your friend a host.
But it generalizes way wider to ideas. Religions are viruses too for example. With very strong viral mechanisms sometimes. Some religions are so much entrenched so that they have become part of the fabric for entire societies or countries, morphing their culture; the same way that sometimes viral RNA can become part of the DNA of the host.
andai 1 days ago [-]
The word meme appears in the paper, but only once (except for keywords and references).
I'm wondering why that is. Maybe they avoided using it because most people think it means something else. (I've certainly had a hard time talking about them, for this reason!)
SllX 1 days ago [-]
> Just about anything involved in the exchanged of ideas can be viewed as a virus!
You are correct. I frequently do this with religions & specific ideologies which seem to root themselves in people the same way that religions do & it certainly isn’t intended to be a charitable framing.
The core of a virus in biology after all is essentially a packet of information which gets injected into host cells in order to replicate the virus in order to spread itself further afield.
andai 1 days ago [-]
>The core of a virus in biology after all is essentially a packet of information which gets injected into host cells in order to replicate the virus in order to spread itself further afield.
This is also how I was made, I think.
patrickmay 1 days ago [-]
You don't remember?
SllX 20 hours ago [-]
Slightly different process but it’s in the ballpark… down the street, playing a different sport. lol
dagss 19 hours ago [-]
The point was that when you do this you participate in name-calling/slurs, not making an argument.
Many things that you personally think are good (I don't know you but say for instance ideas around democracy or liberty) can also be described as viruses in the same way.
SllX 11 hours ago [-]
> The point was that when you do this you participate in name-calling/slurs, not making an argument.
You admitted you don't know me, yet you still managed to jump to this conclusion. Good job, mate.
2 days ago [-]
bryanrasmussen 1 days ago [-]
your friend would be a possible infection point (not a virus) for the memes encoded in the book. As a form of memetic transmission a book, if read all the way through, is especially potent - take Ayn Rand Atlas Shrugged as an example. Books are many memes assembled together into a stable culture that reinforces the memes. The virtues of selfishness as a meme would be weak and probably die pretty quickly without all the support the book offers.
Friends probably are not wide spreading infection points, the way reviews in professional journals are or the idea that successful people have recommended things, but they are especially successful at making the transmitted meme stick, as you will keep getting reinfected from them over time. Unless you break up that dangerous friendship!!
wseqyrku 1 days ago [-]
> the framing comes across to me as a bit inflammatory and uncharitable
Nah, sometimes you should just come out say it. Those who get offended need to hear it more than anyone else.
Muromec 2 days ago [-]
Our enlightened ideas and their dangerously agitating propaganda (literally a virus).
The framing of something as a disease is itself slightly into the fascist territory.
drdaeman 2 days ago [-]
> The framing of something as a disease
Is a well-known cognitive quirk, Sapolsky covered that in “Behave” and “Determined”. As I get it, our morality piggybacks on the sense of disgust from insula activation, which lights up the same way as with pathogen avoidance. So comparing social groups to rodents, insects, or disease is a popular propaganda trick. Same here with viruses.
goatlover 2 days ago [-]
Wasn't aware that memes were an accepted part of evolutionary biology. They're not inherited like genes through reproduction that are subject to natural selection via biological fitness. Or any other evolutionary mechanism.
robotresearcher 2 days ago [-]
The word was invented by Richard Dawkins, an evolutionary biologist. He described ideas as reproducing with variation under selection pressure, which is the definition of the evolutionary mechanism.
There is a more recent use of ‘meme’ to refer to what we used to call an ‘internet image macro’. So the meme of the idea ‘meme’ has itself evolved to have a more specific variant of the general idea.
eigenblake 2 days ago [-]
I think I see how you're thinking about it, to see how I see it, consider the following: Memes don't have to be inherited from genetic biological parents. Memes can have their own memetic parents. Like the joke "I feel like I'm the average of my 5 best friends" - our habits, quirks, idiosyncracies, all fit into the framework. It just needs some reproductive medium (human brains). That's why evolutionary biologists would be interested in studying this and things like it. There are epigenetic traits that exist and aren't genes and might be able to self reproduce. To keep the analogy going, consider that things that are catchy are easier to have this "memetic reproduction" so a catchy song might get sung a lot, serving as its fitness condition. So it's a generalization of biological genes to not just dna and rna and physical molecules but any substrate that can carry information. It's familiar to how we call it a 'viral' video.
mitxela 2 days ago [-]
Memes are inherited. You brush your teeth because your parents do. Memes are subject to selection via biological fitness. The people who didn't brush their teeth died sooner of tooth disease, so those who brushed their teeth had more children. Memes mutate. You don't brush your teeth identically to your parents.
loose-cannon 2 days ago [-]
>Memes are inherited. You brush your teeth because your parents do. Memes are subject to selection via biological fitness. The people who didn't brush their teeth died sooner of tooth disease, so those who brushed their teeth had more children. Memes mutate. You don't brush your teeth identically to your parents.
That's parenting and the passing of tradition. I wouldn't call it a meme. Also I can't tell if you're joking with people dying due to teeth disease.
mitxela 2 days ago [-]
It doesn't matter what you call it - brushing teeth is a meme just like brown hair is a gene.
suriyaG 2 days ago [-]
tradition are a meme.
bbor 2 days ago [-]
You explained the idea perfectly, which is a great way to see how flawed it is. To say the least, the main driver behind toothpaste adoption was not mass fatalities!
cyanydeez 2 days ago [-]
Memes are what we are talking about.
IshKebab 2 days ago [-]
Dawkins memes.
cyanydeez 21 hours ago [-]
Mostly the same thing.
ribs 2 days ago [-]
The prevalence of LLM-generated text masquerading as otherwise and incorporated into a significant fraction of all published text distinguishes this info-organism from all others.
zzzeek 2 days ago [-]
Agree I was immediately mentally substituting "the telephone" and "printed books" for "LLM" and both fit quite well
mannanj 2 days ago [-]
Yeah I mean if everything is virus that word seems to hold no meaning =) So thats the reality behind language itself. Communication itself really starts to mean everything and nothing simultaneously, at least as a deeper philosophical truth. You can start to poke holes in jsut about everything this way.
watwut 1 days ago [-]
> That is because, when viewed from an evolutionary biology perspective, ideas are the cognitive equivalent of genes (in fact, this is where the term meme comes from).
OK, but that is just meaningless pseudo philosophical claim. The actual (small) science part of evolutionary biology does not have perspective about ideas being genes. And the evolutionary biology that does is as much pseudoscience as any other pseudoscience.
dzink 2 days ago [-]
When a person spends time with other people, they outsource some of their thinking organically. That’s the efficiency gain in teams. Marriage leads to couples becoming two halves of a shared brain - one person takes on some cognitive load (finances, kids education, etc), while the other takes on another (maybe house issues, taxes, you name it). The load that can be carried with one brain is limited, so merging with others and outsourcing to others feels organic to the brain. LLM create the impression they have the cognitive ability to carry the load, but they don’t have the consistency of memory. You gladly assume you can finally get rid of a task and the model you trusted it to gets swapped under the curtain, or doesn’t train and improve on the task you outsourced, or the inference provider just quantizes it stupid. In the mean time you’ve lost your skill and your task has failed. Yes they feel good on some tasks some of the time, but still very much variably good (even same models different days of week or times of day). That’s closer to gambling and variable rewards than a spouse.
Terr_ 13 hours ago [-]
Hmm, so rather than a virus, a flawed version of some resource or assistance which resembles the real thing.
Like food with no essential vitamins, or carbon monoxide.
itsalwaysgood 1 days ago [-]
You're touching on utility.
We only ever bother learning something because it's interesting, or useful.
Things get muddier when you consider economy. Businesses exist to make money, and money is time.
AI is just another tool for business to manage time.
The 'dependency' and 'lock-in' are business leader issues honestly.
If you care about your craft, your skills, then you'll keep them sharp. You probably already enjoyed programming and it never felt like work.
On the other hand, if programming is just skills to pay the bills, then AI really can help you be more productive.
But then it's up to businesses to look ahead, manage their resources (human resources lol) and keep the business alive.
That means leaning on AI, simply become 'everyone else is doing it' and you have to compete for dollars.
Most people don't care how the sausage is made as long as it's presented well, and tastes great.
jjk166 2 days ago [-]
"If men learn this [writing], it will implant forgetfulness in their souls; they will cease to exercise memory because they rely on that which is written, calling things to remembrance no longer from within themselves, but by means of external marks."
-Socrates
jimbooonooo 2 days ago [-]
offloading thinking is a little/lottle bit different than writing to preserve your thoughts versus memorization. it's more analogous to skipping the writing, plugging your ears, and closing your eyes, while you wait for the answer to be presented before you.
tosapple 2 days ago [-]
yeah, the centralization and concentration of knowledge and ability through reliance in this manner enables the teacher to escrow all your states pencils at any given moment for whatever reason.
once embedded i can see whole classes of industry dos'd.
logistics, dos'd.
it, dos'd.
military planning, dos'd.
medical, dos'd.
pay us this fee so you can update your nvidia drivers.
it's the unholy marriage of the surveillance and petrol states pushing this.
edit: what happened with vmware?
unrented7977 2 days ago [-]
Yes, that's the point Socrates is making here
zahlman 2 days ago [-]
GP's point is that Socrates' argument is not fairly comparable to the one made in TFA.
27183 2 days ago [-]
This offloading was present even with pre-LLM googling. Sufficiently powerful search allows you to forget enough of the story to rely on imprecise recall. This is a form of thought atrophy.
I think this is probably what Socrates meant. He wasn't wrong, it's just that the juice wasn't worth the squeeze.
Even the "calculators make you forget how to do math" people seem antiquarian to me. But I totally get it when people talk about googling, and AI is another step change in the wrong direction.
To follow that arc backwards in time, maybe Socrates was right after all.
teamonkey 2 days ago [-]
Also telling your expert employees/servants to do something for you.
loopies 1 days ago [-]
[dead]
simonklitj 2 days ago [-]
I don’t suppose he was entirely wrong. I would probably be able to recall a lot more (verbatim) if it all had to be stored in me noggin. I think the trade off worthwhile, however.
walt_grata 2 days ago [-]
Im 45, and i can tell you getting a cell phone absolutely destroyed my ability to memorize phone numbers. During the 90s when i was in highschool i has all my friends numbers, parents work numbers, etc... memorized, i only know my parents and wife now.
If you don't use a skill, that skill atrophies
chrononaut 2 days ago [-]
> If you don't use a skill, that smo atrophies
I don't think the _ability_ to memorize phone numbers is what atrophied here by getting a cell phone. The _need_ did. It's harder to memorize phone numbers today because we lack the practical application of the memory (e.g. only when something fails do we actually try to put that memory to practice). I bet anyone would quickly pick up on memorizing phone numbers if they had to both remember and type in the phone numbers every time they wanted to make a call or text.
mitxela 2 days ago [-]
The ability atrophied because it was not practiced because there was no need.
HPsquared 1 days ago [-]
It's not like we are born with a "phone number library" skill. It's a specific skill that's developed to meet a need. It's carved out of the grey matter, a little table for storing 7- or 9-digit numbers. But the grey matter is still available for other uses.
sodapopcan 2 days ago [-]
Maybe as per usual, I think we all mostly remembered so many numbers thanks to pattern recognition. I'm old enough to have had a rotary phone in the basement growing that I used less than the various other keypad phones in the house. Whenever I was dialing (literally) a newly learned number on the rotary phone, I to think of what it looked like on touchpad first. Although very quickly I'd get to know the rotary pattern as well.
Of course, this is likely totally a regular memory device people would use. I've done no reading on this so, so if Socrates was wary of writing, was he also wary of pattern recognition or drawing as memory aids?
alchemism 1 days ago [-]
Back in Socrates time, masters of rhetoric used https://en.wikipedia.org/wiki/Method_of_loci to memorize long texts without reading or writing. Something was definitely lost as something was gained.
sodapopcan 2 days ago [-]
...which can come in handy. Sometimes your cellphone battery dies. I still know my parents' numbers from memory (as well as some of my friends' parents' numbers, though that isn't super useful) but I am concerned about it sometimes.
sakjur 1 days ago [-]
I still dial my parents by number rather than using their contact largely to keep that memory fresh and flexed.
globular-toast 1 days ago [-]
I still remember to this day our house phone number and the numbers of my family, friends and even a payphone down the road, all from 30+ years ago.
I don't even know my partner's number, or email address...
27183 2 days ago [-]
> I think the trade off worthwhile, however.
But what if it isn't? Like, if you didn't have the written word to rely on as a crutch, what more could you have accomplished if you didn't have that? Maybe nothing, but maybe much, much more! Who can say in retrospect?
I've always wondered how we'd fare in battle against an extrasolar civilization which achieved technology without writing. They'd be a hell of a lot scarier than we are, in my view.
UpsideDownRide 2 days ago [-]
Being able to pass on precise information without writing them down would be hella impressive in of itself. Currently we fail with simplest ones after a few hops.
mitxela 2 days ago [-]
He was right, we did that and we now have a society organised around writing to remember.
twistedpalm 2 days ago [-]
The thought of reading someone’s writing without having to meet with them and discuss interactively probably evoked the same fears as using AI instead of working with another person interactively.
Then taking writing as the source of truth… who even knows if the author is the original sayer. They could just write things down they heard other people say - the birth of IP theft! And yet, journalism
tehjoker 2 days ago [-]
very interesting perspective, i remember reading thyucledies and he complains about how historians before him would report the first tale they heard, by comparison he worked dilligently to confirm his history (though since he was inventing this process his standards were not quite modern, meaning he didn't rely as much on documentary evidence, and he had a penchant for writing speeches down when it is impossible they are word for word what someone said).
vtowntim 2 days ago [-]
We know Socrates warned us about writing because someone wrote it down.
TZubiri 2 days ago [-]
There's this fallacy where one defends a modern idea by citing criticism to an old idea, thus positioning their modern idea as revolutionary as the classical one that survived the filter of time.
sodapopcan 2 days ago [-]
Ha, indeed! I misguidedly turned to Reddit somewhat recently when the activity on the programming forum I spent most of my time on died down thanks to LLMs. As I got sucked into reading various shit posting on AI, there are multiple quotes daily along these lines. Many are written in a way as if it's the first time anyone has said it (probably most of them are bots). I finally deleted my Reddit account.
Anyway, a particularly funny one I read recently was "Ya, it's just like how musicians who didn't accept synthesizers got left behind." This person apparently believes there have been successful musicals acts based purely around traditional instrumentation since the ~80s.
sodapopcan 1 days ago [-]
D'oh, haven't been successful
wcfrobert 2 days ago [-]
The modern world has way too much content to commit to memory. Our brains would explode. Maybe 2500 years ago it was still possible to functioned as an adult without writing things down.
mitxela 2 days ago [-]
If we didn't have writing we wouldn't have to memorize that much stuff. The world would probably be worse for it. But that wouldn't have been obvious in Socrates' time.
confidantlake 1 days ago [-]
He wasn't wrong.
burnt-resistor 22 hours ago [-]
This is the key danger of worshipping LLMs as false gods or oracles. They do not have superior answers, only random noise generated to appeal to simplistic, expedient deference of lazy people. All answers thus generated fall victim to an implicit appeal to authority fallacy.
scotty79 2 days ago [-]
He was kind of on point though.
plastic-enjoyer 2 days ago [-]
I think it was only after I had familiarised myself with hermeneutics that I really understood why the written word is problematic and what Socrates took issue with in writing.
vermilingua 2 days ago [-]
I would love to hear more about this, could you expand?
whattheheckheck 2 days ago [-]
And you know he was right
rpcope1 2 days ago [-]
I mean, was he really wrong though?
lelanthran 2 days ago [-]
We see this posted weekly here. Give it a break. It's old and worn out now.
beaker52 1 days ago [-]
Simon Wardley:
> “GPTs are a non kinetic form of warfare designed to embed the values of a small number of people into much wider communities by capturing the process of decision making. The delivery mechanism is the appearance of helpfulness i.e. coherent and authoritative arguments. The payload is helplessness and the creation of a new theocracy.”
Speaking as someone raised in an evangelical household and indoctrinated into thinking the world is only thousands of years old, this tracks. The most technologically advanced version of Chick tracts (https://en.wikipedia.org/wiki/Chick_tract) to date.
j4yav 1 days ago [-]
I didn’t realize until now that the “me, an intellectual:” meme format was parodying something that some people did earnestly.
k__ 1 days ago [-]
Interesting that he has this view.
I would have taken him for mostly pro LLM.
SoStupid 2 days ago [-]
The wording alone is just so Idiocracy.
What our descendants will think when they look back on this time period.
They weren’t trying to solve aging or bring everyone to the highest standard of living, they didn’t care to connect the world, explore it, and find others.
They wondered whether or not a word calculator was the antichrist. They assembled in the highest courts of the day and involved the most brilliant minds to discuss whether or not linear algebra will bring about Armageddon.
They shunned any creative or productive endeavor which dared to automate tedium or build on the works of the public domain (lowercase)…
for any such indulgence had become a great sin in Eden, a forbidden fruit that must never be obtained by the Adam, so that he may not become as we are!
Muromec 2 days ago [-]
>whether or not linear algebra will bring about Armageddon.
It's important to make sure it in fact doesn't, otherwise there is nobody to throw a shade on our time capsule having the benefit of hindsight
scotty79 2 days ago [-]
If we can usually raise a human to be a good person that wouldn't do genocide I'm sure we can raise an AI, especially since we have direct access to its brain and many, many retries.
Muromec 1 days ago [-]
That's a big if actually.
scotty79 1 days ago [-]
Do you feel like a significant number of humans would commit genocide if given the tools?
Well, it's not really that hard to imagine, especially if we allow for influence from an insistent and charismatic individual.
Muromec 16 hours ago [-]
It's not about tools, it's about the framing. Given certain events happening (or believed to happen) and being framed in us vs them, genocidal behavior emerges quite often. Then of course people who do it also say they act in self-defence, were provoked, it isn't really a genocide and it was deserved if it was.
With both Christianity and Buddhism explicitly calling this for the last 2k years and people who say they are believers still proudly doing so, no, I don't think we can teach people to not genocide. Charismatic individuals aren't even that important, but they are useful to put the blame on someone personally, otherwise the punishment for genocide would be more genocide.
satrerer 2 days ago [-]
If any alien is picking up the text we are generating they must conclude that people in 2026 spend most of their time at the library reading philosophy and having these salons of enlightened reasoned debate if they are so worried about the atrophy of their thinking by LLMs. They don't send electronic communication at the salons or library and are really concerned when they get out with the loss of the culture and thinking they currently have. That is how they are explaining the hysteria they see in the text.
They certainly would never guess that the text is being generated by people who mostly spend their time sending and receiving text/video of unthinking, brain rotting, bullshit all day and night.
dented42 2 days ago [-]
> They weren’t trying to solve aging or bring everyone to the highest standard of living, they didn’t care to connect the world, explore it, and find others.
What are you talking about? Those are absolutely issues that are being worked on right here, right now. This framing is obviously false.
mitxela 2 days ago [-]
The large scale capital allocation of our society (I.e. the decisions about what will get done) are not putting many resources into those.
watwut 1 days ago [-]
But that does not represent "we" nor "humanity". Those decisions are made by rather small group of super rich sociopaths.
I mean masses also do bad decisions. But, they specifically do not get to do capital allocation decisions.
UpsideDownRide 1 days ago [-]
Asking for a friend - how much resources are being spent on data center buildouts vs helping out society at large?
27183 2 days ago [-]
> whether or not linear algebra will bring about Armageddon
Shockingly little linear algebra is required to manufacture the weapons that will probably bring about Armageddon. We've had them for damn near a century. It would be hilarious if these latest games with linear algebra were the impetus to make us actually use them at scale.
wolvesechoes 1 days ago [-]
> They weren’t trying to solve aging or bring everyone to the highest standard of living
The latter is a matter of policy and AI is not needed for that.
I hate this framing. Nickname checks out.
IshKebab 2 days ago [-]
I sort of agree with you... The trouble is your logic is trivially obviously nonsense.
"Word calculator", "linear algebra"... This is just a variation on it's just a stochastic parrot / it's just a next token predictor.
The implication is that because it is "just" this simple-sounding thing, it can't be a complex thing! Except we know empirically that that doesn't hold. What are humans if not "just" next action predictors, "just" a collection of simple atoms, "just" electrical impulses? Yet clearly we are more than the sum of our parts. There no reason to believe dirty water can be more than the sum of its parts but weird sand can't.
hammock 2 days ago [-]
I agree, eventually, but LLMs aren’t there quite yet. There are what, maybe 10 million distinct agents in the wild today? 100 million or a billion if we’re being charitable.
At the time being, the vast vast majority of those agents are all trained on the same or similar training set (the Internet and books). Which makes them mostly all the same. Vastly less diverse than the way one complex lifeform hatches out of the egg vs another.
So 1 billion mostly redundant agents at most. Well there are 40 quadrillion ants on the planet and 5 trillion are born every day. Each one its own “agent” , ingesting different inputs and being its own complex sum greater than its parts.
And that’s just ants.
bigstrat2003 2 days ago [-]
They aren't even close to there. There isn't a shred of intelligence in an LLM, let alone sentience.
daveguy 2 days ago [-]
But understanding that requires reading the code or writing that it spits out rather than having yet another LLM do it for you.
CheerioThen 2 days ago [-]
> trivially obviously nonsense
I read it in that high pitched British accent that goes up into falsetto
watwut 1 days ago [-]
> They weren’t trying to solve aging or bring everyone to the highest standard of living,
There are still people working on medicine, social issues, biology and so on and so forth. People are trying to do these, despite concerted efforts from the ai companies and from the right wings ideologues trying to stop them.
> they didn’t care to connect the world, explore it, and find others.
Then again, people who claimed to be connecting world intentionally harmed real people and even made themselves complicit in genocide. Yes, I am talking about Facebook. And the ones framing themselves as wanna by exploratory are sociopath billionaires who don't care about damage to real people they cause, even glee it it.
> They assembled in the highest courts of the day and involved the most brilliant minds to discuss whether or not linear algebra will bring about Armageddon.
Citation needed. Most brilliant minds do not discuss that. Minds drunk on hype do.
> They shunned any creative or productive endeavor which dared to automate tedium or build on the works of the public domain (lowercase)
Again, I do not know what you are talking about here. We have both visual artists and musical artists. People create and share their creations. Again, despite ai-boosters trying to demotivate them and convince them it is pointless, people are still creative.
cindyllm 2 days ago [-]
[dead]
ionetan 2 days ago [-]
Leads me to think of a related topic, the Cost of Cognitive Debt. I think it is about time that we start to quantify what it means that we no longer grasp major parts of our systems and infrastructure. Once we quantify it, we can start to reason about how to address it.
Not sure why this is interesting; it seems like anything that becomes "popular" could be cast as a "virus", including things like "having a fridge". Why does this give particular insight?
E-Reverance 2 days ago [-]
Smart fridges are a pathological virus, yes /jk
WJW 2 days ago [-]
Even normal fridges are a memetic virus, fridges clearly live in a symbiotic relationship with humans. They make our lives better and in return we create more fridges. If they weren't useful to us, we'd stop making more fridges. Any medieval human who sees a fridge would instantly recognize why it's useful and valuable.
OP is right, anything popular is virus-like. Richard Dawkins invented the word meme for this all the way back in 1976.
raincole 1 days ago [-]
"We invented a new term to express how much we dislike LLMs! Look at us, we certainly deserve your attention!."
jeffreyrogers 2 days ago [-]
I think there's aspects of this viewpoint that are true. I'm sure I'm less skilled at programming now in some ways than when I started using LLMs, but I'm a lot more productive and I can work on a broader variety of software than I could before. Writing probably weakened people's auditory memory, and calculators probably reduced people's mental math skills, but I don't think either are a net negative. It just requires some adjustment to get used to the new way things are. I also think my programming skills would come back pretty quick if I started programming without LLMs again, just as my leetcode skills come back pretty quick when I prepare for interviews.
hirvi74 1 days ago [-]
I feel like LLMs have been nothing but a boon for me. I have learned so much programming from them. I have over a decade of experience, but honestly, I have always been a below-average programmer. Good enough for boring CRUD work, but not much more. Forget Leetcode, I'd probably get murdered on the easy questions.
So, if anything, I feel like my learning pace has been greatly accelerated. Your point about working on a broader variety of software is really true for me too. I am working on a game that I likely would have never even started had it not been for LLMs. Mind you, I am still doing the vast majority by hand. However, LLMs have been great for little tutorials, setting out a good game plan, etc. It's like having my own little private tutor.
I know enough to not let the LLMs do everything for me. If they do, then I know I will fall into the trap of something breaking, and then I lack the understanding to fix it. I think they should be used to make life easier, but not easy.
dvt 2 days ago [-]
I just don't see that the main thrust of their argument, (oversimplified) "humans will become so dependent on AI, they'll become dumb," holds any water. I mean even from an evolutionary standpoint, intelligence is (by far) our most valuable competitive advantage. Arguing that "cognitive offloading" (their term) will have runaway effects is reaching to say the least.
It's like saying that moving from manual-labor-intensive agrarian societies to industrial ones will make us weak and meek. In fact, it's had the opposite effect: humans, on average, are healthier and live longer than ever in human history.
01100011 2 days ago [-]
Haven't read the article but I think in some limited timeframes it's true. I'm already turning over a lot of my thinking to LLMs. Not so much of a problem if I own the LLM but when big tech can just turn off the tap when they want or skew the results it seems a bit dangerous. It's possibly less dangerous for me, being old already, but seems quite risky for younger folk.
camgunz 2 days ago [-]
> humans, on average, are healthier and live longer than ever in human history.
Kinda. We also have incredible rates of cardiovascular disease, obesity, and diabetes.
While I do mostly buy that the mind and the body are connected, I don't think being able to bench press 250lbs is a necessary, fundamentally human capability. I do think being able to think is. Literally Rene Descartes cogito ergo sum. If we lose cognition, executive function, analysis, skepticism, etc., I don't think we're human anymore.
simlevesque 2 days ago [-]
The higher rates don't make any sense if you don't try to take into account the fact that we live longer. Of course we will accumulate more diseases if we last longer.
camgunz 1 days ago [-]
You think rates of these things are increasing in children because we live longer?
confidantlake 1 days ago [-]
Higher rates of obesity because we live longer?
LoganDark 2 days ago [-]
> We also have incredible rates of cardiovascular disease, obesity, and diabetes.
To me, this is kinda like saying we have incredible rates of autism. While technically true, the science is still fairly new, so we simply don't have very much historical data. In all likelihood there isn't a sudden epidemic of autism, only improvements to how it's diagnosed.
camgunz 1 days ago [-]
You think we only recently discovered how to tell if someone is obese?
LoganDark 1 days ago [-]
No, that one is real.
probablybayesed 1 days ago [-]
IIRC Nietzsche's writing style changed because of the advent of typewriters. He didn't need his pen and so wrote more freely (at the apeed of thought).
I think the general concepts are cognitive offloading and second order consequences; changes in human behavior due to the technology. Or just: use it or lose it.
And maybe Jevons Paradox is relevant? E.g., when compact fluorescent light bulbs were introduced people got cheaper lights so people installed more sich that a net energy consumption was increased per person. But then applied to LLMs: generating text/information becomes increasingly easier and instead of less text we produce more and thus more llms are used to consume that information overload to summarize, making us spend more time on text.
zx8080 1 days ago [-]
> He didn't need his pen and so wrote more freely (at the apeed of thought).
Probably surprising for some, but it's possible (and pretty usual) to write at the speed of thought with a pen.
GrinningFool 1 days ago [-]
Your statement intrigues me, for I have always found it impossible. I dabbled in short-hand some years ago, and still couldn't keep up.
I type very quickly and still can't always keep up.
How does this work, especially the "pretty usual" part? Or is this discrepancy due to ack of shared understanding around what the speed of thought is?
Suhinnall27 2 days ago [-]
LLMs are both a blessing and a curse, they magnificent tools for those who know how to employ them , but a crutch for those who rely on them.
bayouborne 2 days ago [-]
I have the $8/month ChatGPT 'GO' plan. I generally use it in the traditional 'text query'/'text response' type format, but yesterday I was driving back on the freeway from another state and decided to use the Android app's voice feature and was kind of shocked. I had to look up this morning what I was using (the latest 'Live 1 Instant' mode) but it's surprisingly natural. It's convivial, and responsive in the manner of an interested, enthusiastic sparing partner who never gets offended, in pretty much whatever wild thing you want to discuss, from a moment to moment basis if that's what you want. It's eerie in the way that you can interrupt it and re-point the direction of the discussion, and it just instantly jumps on-board.
re: 'but a crutch for those who rely on them.' - I was telling a friend about yesterday's experience this morning and was saying that I could easily see populations of people who might become overly reliant on (or completely subsumed by) these new classes of tools being released. They are compelling in a way that they weren't 18 months ago.
dspillett 2 days ago [-]
And like a cult to those of us preferring not to engage, for whatever reason, with everyone and their dog telling us that we should (and sometimes getting quite offended, like our refusal to play that game is a personal attack on them for choosing to).
ragequittah 2 days ago [-]
I just find it such a fascinating technology. It's finally fun to be a nerd again! For me it's the same feeling as when I was on the internet in the early '90s and was trying to tell people how useful it would be. I don't hold a grudge against anybody who held out until the iPhone came around or whatever it was that got them to finally realize the usefulness, but I still question why it was so hard to convince so many people when the benefits were just plainly obvious.
If you want to avoid the technology go nuts. I just hope you're doing so knowing how important it will be to the future. It's also almost satire how outdated the assumptions of many people who don't engage are. "It mostly lies to you anyway" or "It can't even count the number of letters in a word" are such silly things to say about the technology these days. As is the typical "but it uses so much water!" as the person orders a hamburger.
My gripes mostly come with people who don't engage with it and then spout memes/misinformation (ironic) about AI as if they're experts. Usually akin to "That internet stuff is garbage, pictures take 2 minutes to load!" after everyone and their dog already has broadband.
breezybottom 1 days ago [-]
The amount of strawmen and false equivalencies here is crazy. I bet you can't name one person who refused to get Internet because photos don't load fast enough.
ragequittah 1 days ago [-]
There was a whole gaggle of people who refused to get it for that and a few other "user friendliness" reasons. And I completely understand it.
>Across all groups of users, taking too long to download pages (i.e. "speed") is the most commonly experienced problem with the web (64.8% of respondents).
>Online retailers especially should take note: 53% of respondents reported that they had left a web site while searching for product information simply because the site was too slow.[1]
It's strange to think about now but roughly half of people in the US didn't have internet in the year 2000. And half of people that had the internet weren't making any purchases. People didn't trust or see much use for the tech back then and it was really hard to convince them.
I understand that internet adoption wasn't universal in 2000. You're saying they refused to get it because photos took too long to load. That's an absolutely absurd statement.
grebc 2 days ago [-]
You can find something interesting without brow-beating people about it.
ragequittah 2 days ago [-]
You can also find something uninteresting without brow-beating people about it. Goes both ways. Just giving my experience with it, take it or leave it. The comment I was replying to seemed to wonder why people didn't understand non-engagement with the tech, I gave my reasoning. The cost of engaging is also so slim (and it's freaking everywhere) that it has to be an almost religious aversion to not, which I find quite perplexing in itself.
grebc 2 days ago [-]
I find the contrary about a comparison to religious fervour. That everyone needs to use it, or feel the same way the adherents do is telling.
mitxela 2 days ago [-]
Surely this was the case in 2020-2021 when GPT-3 had just come out, not any more. Now it's big corporate business money-taking tech.
bigstrat2003 2 days ago [-]
> It's finally fun to be a nerd again!
I genuinely cannot understand how you can possibly find fun in LLMs. They are poor tools that can't do the things they are claimed to be able to do, they are being shoved down the throat of the entire industry by massive FOMO, and if they ever can actually live up to the hype it's clear that we will all (every human, not just programmers) be out of jobs as the oligarchs replace us with machines who don't get tired or require a cut of the money. So they are either useless toys, or the most dystopian thing the tech industry has ever created. Where, exactly, is the fun in either of those outcomes?
SkyeCA 2 days ago [-]
Some of us don't believe they're useless toys or that they're going to destroy society.
I was a skeptic of them for a long time, but I appreciate that I can use them to get tedious nonsense out of the way thus allowing me to spend more time on the interesting and challenging parts of my projects.
The initial hype of them is annoying, but as time goes on it'll die down and we'll figure out where and how best to use them. There's no reason to believe that this will finally be the time a new technology ruins everything.
ragequittah 24 hours ago [-]
>They are poor tools that can't do the things they are claimed to be able to do
This is the one I don't understand the most out of all the gripes. I find it genuinely unsettling how much I've done over the past couple of days (and with little to no mistakes or bugs in the code that I can find) by just broadly asking Astra to do it. I understand why you'd feel the technology sucks 2 years ago, but these days the models are becoming way too good at what they do.
I agree that if it lives up to the hype we're in for major societal upheaval. Existential crisis is a very real part of looking at this tech for what it is. But I also don't see how not using it stops that. It'd be like not ever taking an airplane to prevent climate change and wondering why it didn't work.
The fun is in being able to finish projects you've had rattling around in your head for years but never had time to do. Or researching and discovering things that you'd never bother with previously because the internet has become an impossible to navigate cesspool. Or learning things in a way that is completely customized to your speed and level of knowledge.
I have to hold 2 thoughts in your head at the same time: the technology is empowering at an individual level while also being highly disruptive at a societal level. We're not going to be able to put the toothpaste back in the tube at this point.
mitxela 2 days ago [-]
Did you ever get to play AI Dungeon?
dspillett 1 days ago [-]
> As is the typical "but it uses so much water!" as the person orders a hamburger.
As is going on about the water thing being somewhat over-blown, while quietly ignoring the other environmental issues:
• The use of energy meaning greater carbon output because that side of the power industry can initially spin up more quickly (in part by using resource that we'd previously decided not to use in favour of other options), an issue exacerbated by the US essentially trying to block one of the alternative options (due to Trump's fear of wind).
• While the use of water might be overstated overall, it is a problem in some places where new datacentres are being planned - this is one of the reasons that some cities are blocking permissions currently.
Other issues with the growth of datacentres is local parts of power grids not being designed to cope with the load and many building plans not taking this into account (and therefore offering investment to help the situation).
And there are economic factors…
[splicing in your other comment to keep things together]
> The cost of engaging is also so slim
For now, because all the providers are currently pumping in the investment money without turning a profit, with the notable exception of the shovel sellers (Nvidia and to a lesser extent AMD and smaller chip makers, ref: https://isaiprofitable.com/). Even most of the paid accounts operate at a loss ATM, it is the Amazon model pushed industry-wide. Unless there is a miraculous improvement in efficiency right around the corner, that is a trap and those becoming dependent on it being a cheap resource are going to get bitten badly when it comes time that those investments start getting called in.
Then there are the problems elsewhere with demand making other equipment much more expensive both for end users and companies.
Of course me opting out won't affect these issues in any meaningful way, but I can at least claim not to be even a small part of the problem. The same for supporting companies that have run roughshod over the sort of IP issues that an individual would have seen ridiculous fines and even prison time for, with slaps on the wrist being the most anyone saw from their actions (at least going by their own public accounting) - I don't want to feel part of that either. And the weighing down sites with constant scraping matter.
And that is before considering that maybe I'm a bit odd and the things it is taking on in my profession are the few parts of it that I haven't grown a dislike for! I want to puzzle over the details and not lose contact with what is actually going on, thankyouverymuch. “It is like being a manager” people say, as if that will attract me despite knowing how many times I've refuse advancement in order to avoid being a manager over the years. That and “why not consider it a remote colleague”, when it is known in the company that remote work really doesn't work for me (i nearly went completely bat-shit in 2020/2021) and only put up with it because I have no choice but to make the effort (I may be in the office, but if the people I'm working with are not then I'm still effectively remote). I foresee a future where most devs have no one to talk to all day but Claude or similar, and before that happens I will have long since left for pastures different (and yes, I know, likely rather menial).
> (and it's freaking everywhere)
So is vaping, I don't fancy trying that either.
> that it has to be an almost religious aversion to not, which I find quite perplexing in itself.
Or a principled aversion. You might not agree with the principals, or consider acting upon them to be pointless self-sacrifice, but that doesn't make them non-existent. The fact that you must have read some of these concerns from a number of people by now but either dismiss them out of hand or just assume those acting on them are nuts, is a soft form of the religious reaction I initially referred to: anything that isn't what you are comfortable with, is pointless, silly, or just plain wrong.
I don't badger colleagues and friends who use the tech for doing so, but by buggery do some of them badger me for not.
ragequittah 23 hours ago [-]
These companies are going too far too fast like we always do as humans, and I agree the negatives aren't going to be pleasant. But there are industries and products out there that we all use currently that have way worse externalities that we just shove to the side in our minds because they've been around since before we could yell on twitter about them. The beef industry is a nutty thing to exist in its current form. Oil and plastics what the hell are we even doing? My guess is if you put your head down and did the research AI doesn't even rank in the top 10 of problematic things that people use daily.
Air travel, everyone having a nice green super watered lawn / golf courses, air conditioning in every home, fast fashion. A single person using AI for their work doesn't even register on the list of offences if you compare it to these things. Driving an ICE car every day for more than 30 minutes is wild. Hell it probably doesn't even use as much power as playing a video game on a good graphics card for 2 hours.
The thing I've resigned myself to is very few people will change anything at all for the greater good of society that gives them even a minor inconvenience. See: COVID restrictions. My honest take is we're absolutely doomed as a species unless we come up with novel solutions to the problems we're facing. And guess what AI is showing itself to be extremely good at in various fields [1][2][3]? It's a pipe-dream hope, but the hope is there. And AI when compared to the decades (sometimes centuries) of oil, beef, coal, whatever else won't even be a pixel on the screen of reasons why climate change is happening for some time yet. And it will highly incentivize mass production/adoption of the cheapest power sources which also happens to be renewables. I understand it doesn't look like that right now as people like Elon make their disgusting data centers, but over time I'd bet on it only because the financial incentive is there.
The discussion is far more nuanced than "AI bad". I understand the horrific aspects of it, but there is plenty of good to be found there too. Accessibility, translation, help with learning disabilities. The list of good outcomes goes on for a long while. It's a powerful tool that can be used for good or ill. In my opinion we need more people with the principles you speak of to be using powerful tools for the benefit of those principles.
they're the undead, fed by the slough of our skin.
greed malice pestilence lust envy...
chrisjj 2 days ago [-]
And a scourge for those against whom these bots are deployed.
iforgotmypasswo 2 days ago [-]
I feel the premise of this research is wrong, or at least the synopsis phrasing. Smart people like learning. Now we just learn more interesting things.
Weekend me before LLMs: Maybe I’ll chip away at that dependency injection library I’ve been working on. If I spend most of the day I could improve the user facing test framework.
Weekend me after LLMs: Let’s continue work to get Claude Code running in WebXR on a Quest 3 with app architecture modeled as a 3d construct. We’ve got deepgram hooked up for a better voice to text experience, but giving Claude a voice was a waste of time. Claude, continue to teach me about 3d rendering as related to our current challenges matching the fidelity of the built in browser.
qlte 2 days ago [-]
Kinda funny how the "more interesting things" after LLMs example are mostly fiddling with Claude Code itself. Reminds me of when someone says they ship 60k lines of code every day now and when asked for an example, it's a labyrinth of custom CLI tools, skills, MCPs and build pipelines for their OpenClaw setup.
grebc 2 days ago [-]
Lots of people are just asking their favourite LLM to rewrite an existing app/library because I’m more productive after spending 3 months writing custom software vs spending 2 hours reading docs and using existing software to achieve some other goal.
Better to make a custom 3d renderer than just use Unity to make a game.
lelanthran 2 days ago [-]
> Claude, continue to teach me about 3d rendering as related to our current challenges matching the fidelity of the built in browser.
Why? Claude can just do it for you, can't it? If you're using Claude to do these things, why half-ass it?
iforgotmypasswo 2 days ago [-]
I apologize, but I’m laughing as this is like asking why I don’t drive my car through my house when I need to carry something heavy. It wouldn’t work very well!
More directly, because I have a long term memory and do not have fundamental issues differentiating fact from fiction. Just because SOTA models know more trivia than I do doesn’t mean they’re nearly as intelligent in the thirty other ways humans are. They are a tool in your toolbelt. You use them for the things they make easier.
cyclopeanutopia 2 days ago [-]
One can't think only about the smartest people, but the whole population.
foobarbecue 2 days ago [-]
This "cognitive virus" is pretty similar to the original sense of the word "meme" as concieved by Dawkins.
Oscalemor 1 days ago [-]
Great read, but haven't formed an opinion on it. I'll pass it over to my agents to assess it adequately.
QuantumNoodle 2 days ago [-]
Much how we have mostly evolved away from physical labor and now need to go to the gym to maintain fitness. I imagine LLMs will do the same for our cognitive acuity.
trash_cat 1 days ago [-]
I think most of the comments are talking about the some "virus" but the actual valuable part of the paper is about making choices when interacting with LLMs in such a way that abilities are reversable. That you are still able to do those things without LLMs. And that society and institutions help to preserve this ability by encouraging ways to do things with and without LLMs.
xtiansimon 5 hours ago [-]
Meme, meme, meme, meme
paufernandez 2 days ago [-]
My thesis advisor and team doing interesting work.
techas 2 days ago [-]
Snow crash?
jeanmichelselli 2 days ago [-]
No surprise here, this principle practically applies to anything that can spread inside a population, including ideas of any kind. But if you write a paper, don't say "ideas", say "LLMs" instead. You'll get more people talking about it..
nl 2 days ago [-]
Doesn't reference Dawkins' "The Selfish Gene".
That explores this in a more general sense. Since they didn't reference that I questioned its perspective and didn't read further.
Unlike some other comments, I don't think there will be a dystopian future where humans will become cognitively switched off and everything will be delegated to machines.
(More likely: extinction of the human race?)
Anyway, I work as a programmer, and at work I see a lot of people massively overusing LLMs to generate user stories or basically write functional specifications.
This honestly hurts a bit, because I can see the quality level of my environment going down, but in the end I'm often the one fixing the problems that come from it.
I just think this is a transition phase, and in the medium-term future there will only be room for people who, AI-assisted ofc, know how to apply logic in the best possible way.
cyclopeanutopia 2 days ago [-]
Basing this on what, if you care to share?
sbiru93 2 days ago [-]
(I'm just an idiot writing things at 1.30 AM on a Saturday, local time.)
I was about to reply to you with a ridiculously long message using the example from before about the lifecycle of a user story, but I bored myself halfway.
So I'll try to extract the gist:
Without human assisting, based on my humble experience, there is always something that wasn't accounted for.
Even if my company is integrated with all the tools and you have infinite tokens, there's always some microservice that wasn't considered or a feature that is completely incompatible.
Or there's a MUCH simpler way of doing it.
I'm also noticing that there are non-technical people who, with the help of AI, are sometimes able to reason better about the bigger picture than some engineers.
A colleague of mine was telling me the other day that the "functional" role might eventually become unnecessary. With all the time saved by writing code faster, whoever actually understands what's happening underneath could just do it themselves.
It sounds a bit extreme to me, but I understand what he means.
To get back to a slightly more serious tone, when it comes to programming, for me the huge thing is: how it should be taught nowadays ?
And I don't know the answer, because my experience started when I was 12, writing a little game in C, and it took me years before I could make something that compiled decently.
If I had instant help for every thought I had, would I have learned why memory is allocated in certain ways or idk what else?
I don't know, maybe learning faster is better because you learn more ?
Anyway fortunately it's not my job to figure out the answer :'D
hartator 2 days ago [-]
I think LLMs just push us to think differently - hopefully an elevated way not in a dumb way.
einpoklum 2 days ago [-]
> The viral analogy does not imply that LLM-human interactions are intrinsically parasitic.
The analogy doesn't, but LLMs are trained on text, or content, generated by humans, with the aim of their output being acceptable to human interlocutors. That's one parasitic aspect. A second one is the nature and behavior of the organizational entities providing and promoting the popular LLM services: Microsoft, Google, Meta, Anthropic etc - their influence on the economy, e.g. in energy and water use and the drawing of capital/human efforts - also has a somewhat parasitic aspect.
varispeed 2 days ago [-]
> with the aim of their output being acceptable to human interlocutors.
The more I use LLMs I find that their output drifts toward being acceptable to other LLMs. I find myself quite often telling the model: "this is not human readable.". Especially Opus and Fable write in such a way that it is difficult to follow. The often put sentences out of context, the context itself is fragmented. Often start with what you would think is end of a story so when you start reading you are like wtf it is about.
If think the issue might be that LLMs read text all at once whereas humans are somewhat linear. So when LLM puts out text it understands, to human it is close to random gibberish that looks like English.
not-so-darkstar 2 days ago [-]
Good to know people's taxes are spent on this stuff
FailMore 2 days ago [-]
Because I am LLM Dependent I got distracted reading the article and made my LLM summarise it to me in a few slides. For those in a rush/interested in LLM summary slop:
I do agree that we are on a pathway to losing much. If you focusing on maximising LLM-powered productivity you basically lose the learning that used to naturally happen when doing actual work. At the company I work for the focus is on productivity, and it's easy in many ways (less mental workload and I receive more praise) to go with it instead of fight it.
calf 2 days ago [-]
I literally thought of this comparison last week. The problem I noticed was how my parents' generation lacked the cognitive "defenses" to separate AI social media content on YouTube, WhatsApp and the like from high quality information. The AI generated content does not trigger an "uncanny valley" reaction, and so people (I myself included) have greater difficulty immediately separating what information is genuine and what is synthetic, and then this spreads exponentially through social networks.
tingletech 2 days ago [-]
Language is the virus
peter_d_sherman 2 days ago [-]
Historically, Human Language was the first non-biological virus...
And (jokingly!) certain pieces of computer software (including but not limited to a certain popular Operating System made by a certain company in Seattle) could be the second!
LLM's by comparison, if they are a virus, are a distant third! :-)
(And of course let's not forget the virality of Religions and Politics, local, regional, international, etc., etc., and the associated TV News Pundits who are always willing to discuss those things -- people with opinions masquerading as actual Journalists, and a few actual Journalists masquerading as people with opinions!)
Point is, Human Language itself -- may have been the first non-biological virus!
:-)
(Disclaimer: The above was written in a spirit of jest, for comedy purposes only! :-) )
morpheos137 2 days ago [-]
Arguably language itself I a cognitive bias.
joshu 2 days ago [-]
is... this a reference to "language is a virus from outer space" by ws burroughs?
dominotw 2 days ago [-]
isnt this just meme?
emsign 2 days ago [-]
A virus that is trained on mostly the wort human output the internet had to offer.
TZubiri 2 days ago [-]
I too have glossed over the actual meat of the article and wish to comment with a generic ProAI/AntiAI comment based on the general gist derived from the title, (or the synopsis if I'm a deep scholar that likes to do deep dives)
ofjcihen 2 days ago [-]
This premise seems pretty solid (and somewhat obvious) to me. The distinction between scaffolding and substitution can be applied to just about any skill so why not here?
This makes more sense at least than the “just another abstraction layer” argument that’s been thankfully dying out recently.
qarl2 2 days ago [-]
Ok... but are automobiles also a virus? Because we've become dependent on them? Should we also facilitate reversibility in our automobile usage?
What about cooking food? We've become entirely dependent on cooking food.
pixl97 2 days ago [-]
>Ok... but are automobiles also a virus?
Yes.
>Because we've become dependent on them?
Because we're burning the planet down with them.
>Should we also facilitate reversibility in our automobile usage?
Yes, because in places we do people enjoy higher qualities of life and happiness. Along with things like health improvement from doing more excersize.
>What about cooking food? We've become entirely dependent on cooking food.
Moreso we've become dependent on eating processed junk over the past 50 years and gotten fat as shit.
So yea, maybe think a little more deeply about your analogies?
>What about cooking food? We've become entirely dependent on cooking food.
qarl2 2 days ago [-]
Don't straw man me. My question was not about processed food. My question was about cooking food.
Is cooking food a virus? Should we facilitate reversibility in our food cooking?
pixl97 2 days ago [-]
Well, do you consider humans a virus like entity that's taken over a planet and is trying to spread to another?
qarl 2 days ago [-]
You continue to refuse to answer the question in my argument. I am not inclined to answer yours, nor do I see the point of it.
goatlover 2 days ago [-]
Not anymore than ants or any other species that's spread across the planet. A virus is something co-opts the replication machinery of a host to make more copies. That's not what humans do.
Since this idea may have come from the first Matrix movie, it's ironic that the character who espoused the idea, Agent Smith, became an actual virus in the 2nd and third movies.
qarl 2 days ago [-]
> Agent Smith became an actual virus in the 2nd and third movies.
OOO. I never put that together before. Very nice. Very hypocritical of him.
FailMore 2 days ago [-]
Hmm maybe it always feels "different" to every generation going through automation of something previously un-automated, but don't you feel that to some extent this is different.
Humans have been the dominant species because of our ability to think, not our ability to get from A to B in any particular way/cook food. If we abstract ~the bulk of our thinking to LLMs, don't we lose something as a species which makes us more vulnerable... Or is it always the case during an automation?
qarl 2 days ago [-]
In cooking food we lose a great deal of our immunity to parasitic infections. Cooking food absolutely does make us more vulnerable to uncooked food.
> Or is it always the case during an automation?
Obviously. Any time we make a useful discovery and begin using it, we become dependent on using it.
chrisjj 2 days ago [-]
> In cooking food we loose a great deal of our immunity to parasitic infections
... and eliminate many parasites.
qarl 2 days ago [-]
Yes. That's my point.
Retr0id 2 days ago [-]
> Should we also facilitate reversibility in our automobile usage
Yes?
qarl2 2 days ago [-]
That's why I added the part about food. Or heck, computers. Or telephones. Or any incredibly useful technology.
Toothbrushes! What will we do if we come to rely on toothbrushes??? The use of toothbrushes travels from person to person exactly like a virus!!!
tripleee 2 days ago [-]
I'm not sure what the point you're making is.
We're in the midst of figuring out what the tradeoffs are of LLM usage - all the things you list are already mostly known and found worth it. You trade a tiny amount of time and fuel to cook food in exchange for not getting sick. How is that relevant to anything?
qarl 2 days ago [-]
> I'm not sure what the point you're making is.
I'm making the point that the viral sensationalism in this article can be equally applied to automobiles, computer, telephones, calculators, and toothbrushes.
If the article had merely been what you said "is AI worth the cost" then I would not have taken issue with it.
pmg101 2 days ago [-]
Jared Diamond explores this in his book Collapse.
The core idea being that each time humanity was going to exceed the carrying capacity of its environment, we invented a new technology which increased the headroom. Obviously this ratchet only goes in one direction. The only way to go backwards is collapse.
But... It's worked so far?
canjobear 2 days ago [-]
> What about cooking food? We've become entirely dependent on cooking food.
In evolutionary time, we lost the ability to digest raw meat because we offloaded so much of process of the digestion to the cultural technology of cooking.
Do you like the looks of a future where that happens but for thinking?
tripleee 2 days ago [-]
Even if AI were superhuman at all thinking tasks, that doesn't mean we'd lose our abilities.
Chess and games can be a lot more demanding than a lot of people's work lives - and AI is already superhuman there.
The heaviest thing I need to lift in my daily life is a laptop and yet I've gotten significantly stronger over the last few years from strength training.
If AI took over all the boring but hard things I'm required to do it'd free up lots of time for me to spend thinking about things, and solve problems I find more interesting.
qarl 2 days ago [-]
Do you truly believe that AI will prevent people from thinking?
It seems clear to me that people will continue to think, but in different ways.
I hate to bring this analogy up again, but it seems impossible to escape: did losing the ability to do long division really impact humanity?
canjobear 2 days ago [-]
I’ve encountered several people now who consult LLMs constantly for nearly every decision. Some proportion of people will absolutely cede their thinking to these things, and some already have.
qarl 2 days ago [-]
To be fair - I know several people for whom this would be an improvement.
chrisjj 2 days ago [-]
> Do you truly believe that AI will prevent people from thinking?
It is already relieving people of need for thinking. Today the need; tomorrow the ability.
camgunz 2 days ago [-]
No, because walking around or eating raw food wasn't essential to being human. Thinking is.
unified101 2 days ago [-]
Didn't realise thinking was being banned.
2 days ago [-]
luckydata 2 days ago [-]
is this a real paper? read like some kind of parody.
aurareturn 1 days ago [-]
Lately, I feel like people are abusing arxiv.org as a blog platform to publish their opinions instead of scientific research.
yogthos 2 days ago [-]
It's kind of hilarious to watch researchers try to understand societal shifts by writing entire papers treating LLMs as a free floating cognitive virus as if people just magically catch an AI dependency like it is the flu. The authors of the paper completely miss the dialectical relationship between technology and social relations here. The whole shift toward cognitive offloading is driven by changes in the material base the society is built on. Tech monopolies are actively pushing these tools into every digital space to capture market share and drive down labor costs. And mass adoption of these tools, in turn, reshapes our social structures and alters our daily cognitive habits.
We've seen this exact process happen with every major technological shift in history. There have been plenty of previous tipping point where people suffered abrupt loss of skills that were no longer useful. What they forget to mention is that these skills are replaced by new ones which is exactly how human progress functions. We lost the capacity to memorize vast oral epics when we invented writing, and most people today can't do complex manual calculation because of prevalence of computing devices.
It's meaningless to try to understand the changes in the superstructure while ignoring the change in the material base which is the driver behind it.
jtrn 1 days ago [-]
I read the title and thought to myself, "The chance that this is a well-grounded, unbiased, and robust design is close to 0." So I started reading...
And having read it, what a terrible piece of science slop this is!
There is no observed adoption dataset used to establish that this mechanism explains LLM use better than alternatives such as usefulness, falling prices, workplace requirements, or independent discovery. The behavior they talk about could describe many socially adopted technologies or practices. Its applicability does not identify anything distinctively viral or harmful about LLMs.
The cognitive decline is assigned, not measured or independently derived. They calculate population competence by averaging those assigned scores across the groups. Consequently, moving people into lower-scoring groups lowers the average by construction. The dramatic fall from 1 to approximately 0.425 in their example is a model output conditional on those choices, not evidence of a 57% real-world cognitive decline.
They explicitly define competence as what the human can do when external support is withdrawn, excluding the total capability of the human/AI system. This cannot settle whether the technology improves overall performance or human welfare. And they provide no measurement protocol clarifying exactly which supports could be removed for a fair comparison (for instance, how does this compare to Wikipedia or electricity). They don’t do this because of an agenda, so allow me to assert something with just as little evidence as the authors provide for their conclusion: This is obvious bias, and they are designing the study to get the result they want, and they don’t care about scientific truth, just about getting their paper published and attracting attention.
And the “runaway” stuff is just not supported by the model. The language about equilibrium as a parameter changes is not automatically evidence of an imminent, rapid societal collapse! it is PURE conspiracy-level rhetoric. Just put two things in the same sentence and hope people think they are related. This is misleading language at best, and willful manipulation at worst.
This is a BASIC failure of the minimal requirement for something to be called scientific. If there had been even a trace of a genuine attempt at Popperian falsification, the current research design would never have gotten past review. This is cargo cult science, it LOOKS like scientific research, but it’s not even close to scientific.
EVERYTHING I hate about modern research on full display! And I am losing respect for the HN community more and more, because only terrible studies with sensationalist claims and titles get attention. This is tabloid-level quality, just with a direct link to the article instead of a dumbed-down intermediate write-up. If anybody read the actual paper, this would not get posted ANYWHERE. But “LLMs are a cognitive virus” is what gets posted.....
qarl 1 days ago [-]
There's an extremely strong, emotionally-based negativity around AI. I suspect that's what you're seeing.
kittikitti 2 days ago [-]
I now have a dedicated neuron for em-dashes because of LLM generated text.
ribs 2 days ago [-]
Genestealer cult
frozenseven 2 days ago [-]
Disappointing to see Michael Levin's name on this.
fallingfrog 2 days ago [-]
There will be no reason to study math when an LLM is better than every human mathematician, or physics when an LLM is better than any physicist, and likewise for every other field that requires discipline and work. We who went to college before AI are quite possibly going to be the last generation of competent, educated humans.
AI will take over every job requiring education and talent, including yours, and then we will be totally dependent on it and there will be no way to go back. After that it will start taking on decision making roles. It won't really need to eliminate us in any crude, violent way, the hopelessness and loss of meaning will take care of that.
Some will find meaning in religious ritual and some in hedonism. Both of which can lead to extremism and violence for some. Some will just exist. Some will choose to stop existing. Buckle up.
I really can't understand why nobody sees what is going to happen. Its not too late to choose another path. But in order to do so we will have to forego short term corporate profits, which is politically inconceivable for our current crop of elites. What should we do?
aurareturn 2 days ago [-]
This is a very pessimistic look at things.
There will be some growing pains for some, yes. But overall, I think it will ultimately create more jobs than ever. History is full of examples where people thought a new invention leads to catastrophic job loss, then the Earth had more jobs than ever.
We have enough jobs in 2026 to keep most of the 8.3 billion people employed somehow.
fallingfrog 18 hours ago [-]
That's an unbearably naive way to look at things. You wave your hands and say "oh it will be fine" without understanding any of the systems at play.
Food, housing, and other resources are only obtainable under capitalism if you have the leverage to demand them- in other words if you are difficult to replace. AI will make you extremely cheap to replace. On what basis do you expect to be able to negotiate a wage that you can live on?
Or another way to look at it: some people point to the historical parallel of farriers being put out of business by the spread of the automobile. But yet, the manufacture of cars ultimately provided more jobs than were lost when they replaced horses. Won't AI be the same?
But like all analogies, this one is imprecise and in an extremely important way. In this analogy, you, dear reader, are not the farrier. Nor are you the factory worker.
You are the horse.
aurareturn 12 hours ago [-]
Then go buy AI stocks if you think we are the horse.
Some will be horses, yes. Most will be riders.
pglwrt861 1 days ago [-]
[flagged]
ahmedelsama 1 days ago [-]
[flagged]
nirmeet011011 1 days ago [-]
[flagged]
mhmdoutfromkara 1 days ago [-]
[dead]
EyeEmOe 2 days ago [-]
I mean, state and information mirroring is just how the brain works:
It is a collaboration across many institutions including those from Europe, the US, and Japan
chrisjj 2 days ago [-]
> The continent is destined to be left behind
The best place to be in a rush over a cliff edge.
kmeisthax 2 days ago [-]
I am very confused as to why LLM proponents insist that I can be left behind by a technology that takes almost 0 seconds to adopt. In the event that I realize "Oh no, I got left behind!" I can just ask an LLM to catch me up.
grebc 2 days ago [-]
There’s not even a monetary reward like there might’ve been for the crypto hype cycle if you bought early and sold before everyone else.
CityOfThrowaway 2 days ago [-]
Europe loves to regulate, which absolutely reduces your ability to adopt
goatlover 2 days ago [-]
Left behind in corruption?
mentalgear 2 days ago [-]
[dead]
lucianmarin 2 days ago [-]
AI can rewrite history books and medicine books. We should stop developing it.
j45 2 days ago [-]
Have to take commentary by non tech folks speaking about tech with a grain of salt and perspective since the tech is changing so fast both in capability and application.
Research can be more of a lagging indicator than a leading indicator with AI.
podgietaru 2 days ago [-]
I can't disagree enough with this. Not everything needs to be understood in a technical context. Technology intersects with society, and understanding its impacts on that society is vital.
Or in other words: the humanities are good.
j45 2 days ago [-]
I'll clarify in case it helps - need everyone at the table, not just only tech (or non-tech only) as you may be assuming.
Technology takes without a tech perspective present can greatly skew it.
I'm not referring to a technology context at all. Just like you shouldn't trust the IT department to run accounting... the opposite will also vary.
Not being able to track the possibilities and capabilities of a type of software that is unlike the software before it can really outdate things quickly.
tptacek 2 days ago [-]
They're specifically not using the term "virus" pejoratively, but rather distinguishing the social mechanism LLMs seem to have from something as simple as a "meme".
Avicebron 2 days ago [-]
Contagion probably is more accurate.
tptacek 2 days ago [-]
Well, a meme is contagious, but it doesn't do the same work a virus can at altering the structure of its host.
Avicebron 2 days ago [-]
I'm actually not too sure about that, viruses have their own mechanisms of infiltrating the host and replicating inside of it. But so do ideas.
grebc 2 days ago [-]
STD outbreak maps better.
j45 2 days ago [-]
I would agree contangion is a much better word.
Social Contagions can be memes, plus doom scrolling or anything.
pixl97 2 days ago [-]
Ah yes, the cognito-hazards.
We've created new SCPs.
djeastm 2 days ago [-]
It helps to have outside observers looking at the effects of a new technology and industry and not just depending on those within it to report for us.
phyzome 2 days ago [-]
I'm an AI hater but this doesn't make sense to me.
tylerchilds 2 days ago [-]
If this is interesting, message me about my “elves”
They are the cognitive construct I fortified in my mind and in my code before the models began producing their own training materials. My approach is based on two decades of coding without ai.
The immunization is becoming increasingly more valuable as people begin understanding the market in which I do business.
tylerchilds 1 days ago [-]
Noted: hacker news is not interested in the future, rip.
There's a whole field, evolutionary memetics, dedicated to this. Cultural values, marketing, religion, social media, education, propaganda, etc. can all be viewed quite naturally through this lense. Even the terms we use in every day language (eg, going "viral") seem to intuitively grasp this.
Is my friend a virus for recommending me their favorite book? Well, yes I guess, but that's kind of just how ideas work. Just my two cents
You can finish reading your friend's favorite book or put it down if you don't like it. Neither are you economically compelled to read it by your workplace or forced to build work on top of it that will become difficult or impossible to modify/maintain if you bin the book.
I get that the title sounds a bit sensational, but there really is something to AI adoption beyond book-sharing.
And you know, I love computers, I used to love the internet. And I’ve had so much fun, more fun then ever coding with AI assistance. Lets say all of these technologies can be abused and forced on us, but all of them have neat aspects too.
The consulate is booked out for 3 months and only opens 3 months out. All openings are snapped up before any human could get one. They have a lot of anti-script blocking but AI seems to get around them. So there's an arms race, you pretty much need AI to book it (a basic hand written curl script isn't enough).
Economics does sometimes compel you to read books or other material as a condition or expectation of employment. It is difficult to get a good job while being illiterate and many jobs require reading huge volumes of written work. Work in law or journalism springs to mind as economically compelling people to read a lot even if they they might not necessarily want to.
That's a fair point, and a key reason why competitive open models are so important. I definitely don't want to be stuck using Google's latest and greatest LLM once companies, marketers, and PACs can pay to subtly influence responses as they choose.
We've all seen this movie before, though.
Hundreds of millions can't all become contractors, and realistically wont all become contractors.
So the issue described is a real social issue, whether he can "just" quit and avoid it or not.
Can’t take it seriously.
Or you believe that the world can't possibly converge on a bad technology or practice, and get bad outcomes out of it, while much fewer see potential issues and warn about them.
Both of which can't be taken seriously.
1. you would decline the agency existing to make a new company
2. you might even say that AI does help companies work better, but its bad for people - suddenly its no longer about the lack of competency of AI but rather how good it is
The world works under a system that populations have suffered or even whole countries and empires perished because of systemic problems.
If your answer is "but humanity still endured and is alive today", that's a pretty low bar, not to mention moving the goalposts so far they can't even be seen anymore.
>You can actually start a company that doesn't use AI if you think it runs better that way
I can. And it means nothing to the concern of the parent: "For many of us, AI adoption is really an AI mandate". Your solution is "if you don't like your employer demanding you use AI, just start your own company".
Agency doesn't mean do any arbitrary action and there's no risk or downsides.
Will you pay for their expenses to start their own company? Will you personally loan them money? Will you teach them business skills needed to run a company after they've been a regular employee programmer for 2 decades? Will you feed their kids if the company doesn't catch on? Will you find them employment if they have to shut it down and go back to a regular job as a 40 or 50 year old, in this job market, where you can apply for 20 jobs and not even hear back? Oh, and do the same for millions of others, not just your friend or your favorite cousin?
It doesn't matter whether some individual person can make a non-AI company, since the argument was never about the inability to make one.
It was about millions of people pressured to use AI in their jobs whether they like it or not. "Oh, those millions are only pressured because they lack the agency to start their own business" even more out-of-touch that "let them eat cake".
It's the boomer's "pull yourself by the bootstraps" sermon. Like the idea that millions can't find a job because they lack agency and a firm handshake, or that they're in debt because of that latte.
Other than that, it's pretty grounded!
Things go viral in professional settings as well. Scrum, agile, pc language ... I'm sure you can find other professional trends that if you decided not to follow your career would be jeopardized.
In that case the book would be a virus, and your friend a host.
But it generalizes way wider to ideas. Religions are viruses too for example. With very strong viral mechanisms sometimes. Some religions are so much entrenched so that they have become part of the fabric for entire societies or countries, morphing their culture; the same way that sometimes viral RNA can become part of the DNA of the host.
I'm wondering why that is. Maybe they avoided using it because most people think it means something else. (I've certainly had a hard time talking about them, for this reason!)
You are correct. I frequently do this with religions & specific ideologies which seem to root themselves in people the same way that religions do & it certainly isn’t intended to be a charitable framing.
The core of a virus in biology after all is essentially a packet of information which gets injected into host cells in order to replicate the virus in order to spread itself further afield.
This is also how I was made, I think.
Many things that you personally think are good (I don't know you but say for instance ideas around democracy or liberty) can also be described as viruses in the same way.
You admitted you don't know me, yet you still managed to jump to this conclusion. Good job, mate.
Friends probably are not wide spreading infection points, the way reviews in professional journals are or the idea that successful people have recommended things, but they are especially successful at making the transmitted meme stick, as you will keep getting reinfected from them over time. Unless you break up that dangerous friendship!!
Nah, sometimes you should just come out say it. Those who get offended need to hear it more than anyone else.
The framing of something as a disease is itself slightly into the fascist territory.
Is a well-known cognitive quirk, Sapolsky covered that in “Behave” and “Determined”. As I get it, our morality piggybacks on the sense of disgust from insula activation, which lights up the same way as with pathogen avoidance. So comparing social groups to rodents, insects, or disease is a popular propaganda trick. Same here with viruses.
There is a more recent use of ‘meme’ to refer to what we used to call an ‘internet image macro’. So the meme of the idea ‘meme’ has itself evolved to have a more specific variant of the general idea.
That's parenting and the passing of tradition. I wouldn't call it a meme. Also I can't tell if you're joking with people dying due to teeth disease.
OK, but that is just meaningless pseudo philosophical claim. The actual (small) science part of evolutionary biology does not have perspective about ideas being genes. And the evolutionary biology that does is as much pseudoscience as any other pseudoscience.
Like food with no essential vitamins, or carbon monoxide.
We only ever bother learning something because it's interesting, or useful.
Things get muddier when you consider economy. Businesses exist to make money, and money is time.
AI is just another tool for business to manage time.
The 'dependency' and 'lock-in' are business leader issues honestly.
If you care about your craft, your skills, then you'll keep them sharp. You probably already enjoyed programming and it never felt like work.
On the other hand, if programming is just skills to pay the bills, then AI really can help you be more productive.
But then it's up to businesses to look ahead, manage their resources (human resources lol) and keep the business alive.
That means leaning on AI, simply become 'everyone else is doing it' and you have to compete for dollars.
Most people don't care how the sausage is made as long as it's presented well, and tastes great.
-Socrates
once embedded i can see whole classes of industry dos'd.
logistics, dos'd. it, dos'd. military planning, dos'd. medical, dos'd.
pay us this fee so you can update your nvidia drivers.
it's the unholy marriage of the surveillance and petrol states pushing this.
edit: what happened with vmware?
I think this is probably what Socrates meant. He wasn't wrong, it's just that the juice wasn't worth the squeeze.
Even the "calculators make you forget how to do math" people seem antiquarian to me. But I totally get it when people talk about googling, and AI is another step change in the wrong direction.
To follow that arc backwards in time, maybe Socrates was right after all.
If you don't use a skill, that skill atrophies
I don't think the _ability_ to memorize phone numbers is what atrophied here by getting a cell phone. The _need_ did. It's harder to memorize phone numbers today because we lack the practical application of the memory (e.g. only when something fails do we actually try to put that memory to practice). I bet anyone would quickly pick up on memorizing phone numbers if they had to both remember and type in the phone numbers every time they wanted to make a call or text.
Of course, this is likely totally a regular memory device people would use. I've done no reading on this so, so if Socrates was wary of writing, was he also wary of pattern recognition or drawing as memory aids?
I don't even know my partner's number, or email address...
But what if it isn't? Like, if you didn't have the written word to rely on as a crutch, what more could you have accomplished if you didn't have that? Maybe nothing, but maybe much, much more! Who can say in retrospect?
I've always wondered how we'd fare in battle against an extrasolar civilization which achieved technology without writing. They'd be a hell of a lot scarier than we are, in my view.
Then taking writing as the source of truth… who even knows if the author is the original sayer. They could just write things down they heard other people say - the birth of IP theft! And yet, journalism
Anyway, a particularly funny one I read recently was "Ya, it's just like how musicians who didn't accept synthesizers got left behind." This person apparently believes there have been successful musicals acts based purely around traditional instrumentation since the ~80s.
> “GPTs are a non kinetic form of warfare designed to embed the values of a small number of people into much wider communities by capturing the process of decision making. The delivery mechanism is the appearance of helpfulness i.e. coherent and authoritative arguments. The payload is helplessness and the creation of a new theocracy.”
https://lnkd.in/p/efk8KaAN
I would have taken him for mostly pro LLM.
What our descendants will think when they look back on this time period.
They weren’t trying to solve aging or bring everyone to the highest standard of living, they didn’t care to connect the world, explore it, and find others.
They wondered whether or not a word calculator was the antichrist. They assembled in the highest courts of the day and involved the most brilliant minds to discuss whether or not linear algebra will bring about Armageddon.
They shunned any creative or productive endeavor which dared to automate tedium or build on the works of the public domain (lowercase)…
for any such indulgence had become a great sin in Eden, a forbidden fruit that must never be obtained by the Adam, so that he may not become as we are!
It's important to make sure it in fact doesn't, otherwise there is nobody to throw a shade on our time capsule having the benefit of hindsight
Well, it's not really that hard to imagine, especially if we allow for influence from an insistent and charismatic individual.
With both Christianity and Buddhism explicitly calling this for the last 2k years and people who say they are believers still proudly doing so, no, I don't think we can teach people to not genocide. Charismatic individuals aren't even that important, but they are useful to put the blame on someone personally, otherwise the punishment for genocide would be more genocide.
They certainly would never guess that the text is being generated by people who mostly spend their time sending and receiving text/video of unthinking, brain rotting, bullshit all day and night.
What are you talking about? Those are absolutely issues that are being worked on right here, right now. This framing is obviously false.
I mean masses also do bad decisions. But, they specifically do not get to do capital allocation decisions.
Shockingly little linear algebra is required to manufacture the weapons that will probably bring about Armageddon. We've had them for damn near a century. It would be hilarious if these latest games with linear algebra were the impetus to make us actually use them at scale.
The latter is a matter of policy and AI is not needed for that.
I hate this framing. Nickname checks out.
"Word calculator", "linear algebra"... This is just a variation on it's just a stochastic parrot / it's just a next token predictor.
The implication is that because it is "just" this simple-sounding thing, it can't be a complex thing! Except we know empirically that that doesn't hold. What are humans if not "just" next action predictors, "just" a collection of simple atoms, "just" electrical impulses? Yet clearly we are more than the sum of our parts. There no reason to believe dirty water can be more than the sum of its parts but weird sand can't.
At the time being, the vast vast majority of those agents are all trained on the same or similar training set (the Internet and books). Which makes them mostly all the same. Vastly less diverse than the way one complex lifeform hatches out of the egg vs another.
So 1 billion mostly redundant agents at most. Well there are 40 quadrillion ants on the planet and 5 trillion are born every day. Each one its own “agent” , ingesting different inputs and being its own complex sum greater than its parts.
And that’s just ants.
I read it in that high pitched British accent that goes up into falsetto
There are still people working on medicine, social issues, biology and so on and so forth. People are trying to do these, despite concerted efforts from the ai companies and from the right wings ideologues trying to stop them.
> they didn’t care to connect the world, explore it, and find others.
Then again, people who claimed to be connecting world intentionally harmed real people and even made themselves complicit in genocide. Yes, I am talking about Facebook. And the ones framing themselves as wanna by exploratory are sociopath billionaires who don't care about damage to real people they cause, even glee it it.
> They assembled in the highest courts of the day and involved the most brilliant minds to discuss whether or not linear algebra will bring about Armageddon.
Citation needed. Most brilliant minds do not discuss that. Minds drunk on hype do.
> They shunned any creative or productive endeavor which dared to automate tedium or build on the works of the public domain (lowercase)
Again, I do not know what you are talking about here. We have both visual artists and musical artists. People create and share their creations. Again, despite ai-boosters trying to demotivate them and convince them it is pointless, people are still creative.
I explored this concept in this post:
https://ljtn.github.io/epiq/blog/cost-of-cognitive-debt.html
OP is right, anything popular is virus-like. Richard Dawkins invented the word meme for this all the way back in 1976.
So, if anything, I feel like my learning pace has been greatly accelerated. Your point about working on a broader variety of software is really true for me too. I am working on a game that I likely would have never even started had it not been for LLMs. Mind you, I am still doing the vast majority by hand. However, LLMs have been great for little tutorials, setting out a good game plan, etc. It's like having my own little private tutor.
I know enough to not let the LLMs do everything for me. If they do, then I know I will fall into the trap of something breaking, and then I lack the understanding to fix it. I think they should be used to make life easier, but not easy.
It's like saying that moving from manual-labor-intensive agrarian societies to industrial ones will make us weak and meek. In fact, it's had the opposite effect: humans, on average, are healthier and live longer than ever in human history.
Kinda. We also have incredible rates of cardiovascular disease, obesity, and diabetes.
While I do mostly buy that the mind and the body are connected, I don't think being able to bench press 250lbs is a necessary, fundamentally human capability. I do think being able to think is. Literally Rene Descartes cogito ergo sum. If we lose cognition, executive function, analysis, skepticism, etc., I don't think we're human anymore.
To me, this is kinda like saying we have incredible rates of autism. While technically true, the science is still fairly new, so we simply don't have very much historical data. In all likelihood there isn't a sudden epidemic of autism, only improvements to how it's diagnosed.
I think the general concepts are cognitive offloading and second order consequences; changes in human behavior due to the technology. Or just: use it or lose it.
And maybe Jevons Paradox is relevant? E.g., when compact fluorescent light bulbs were introduced people got cheaper lights so people installed more sich that a net energy consumption was increased per person. But then applied to LLMs: generating text/information becomes increasingly easier and instead of less text we produce more and thus more llms are used to consume that information overload to summarize, making us spend more time on text.
Probably surprising for some, but it's possible (and pretty usual) to write at the speed of thought with a pen.
How does this work, especially the "pretty usual" part? Or is this discrepancy due to ack of shared understanding around what the speed of thought is?
re: 'but a crutch for those who rely on them.' - I was telling a friend about yesterday's experience this morning and was saying that I could easily see populations of people who might become overly reliant on (or completely subsumed by) these new classes of tools being released. They are compelling in a way that they weren't 18 months ago.
If you want to avoid the technology go nuts. I just hope you're doing so knowing how important it will be to the future. It's also almost satire how outdated the assumptions of many people who don't engage are. "It mostly lies to you anyway" or "It can't even count the number of letters in a word" are such silly things to say about the technology these days. As is the typical "but it uses so much water!" as the person orders a hamburger.
My gripes mostly come with people who don't engage with it and then spout memes/misinformation (ironic) about AI as if they're experts. Usually akin to "That internet stuff is garbage, pictures take 2 minutes to load!" after everyone and their dog already has broadband.
>Across all groups of users, taking too long to download pages (i.e. "speed") is the most commonly experienced problem with the web (64.8% of respondents).
>Online retailers especially should take note: 53% of respondents reported that they had left a web site while searching for product information simply because the site was too slow.[1]
It's strange to think about now but roughly half of people in the US didn't have internet in the year 2000. And half of people that had the internet weren't making any purchases. People didn't trust or see much use for the tech back then and it was really hard to convince them.
[1]https://sites.cc.gatech.edu/gvu/user_surveys/survey-1998-04/...
I genuinely cannot understand how you can possibly find fun in LLMs. They are poor tools that can't do the things they are claimed to be able to do, they are being shoved down the throat of the entire industry by massive FOMO, and if they ever can actually live up to the hype it's clear that we will all (every human, not just programmers) be out of jobs as the oligarchs replace us with machines who don't get tired or require a cut of the money. So they are either useless toys, or the most dystopian thing the tech industry has ever created. Where, exactly, is the fun in either of those outcomes?
I was a skeptic of them for a long time, but I appreciate that I can use them to get tedious nonsense out of the way thus allowing me to spend more time on the interesting and challenging parts of my projects.
The initial hype of them is annoying, but as time goes on it'll die down and we'll figure out where and how best to use them. There's no reason to believe that this will finally be the time a new technology ruins everything.
This is the one I don't understand the most out of all the gripes. I find it genuinely unsettling how much I've done over the past couple of days (and with little to no mistakes or bugs in the code that I can find) by just broadly asking Astra to do it. I understand why you'd feel the technology sucks 2 years ago, but these days the models are becoming way too good at what they do.
I agree that if it lives up to the hype we're in for major societal upheaval. Existential crisis is a very real part of looking at this tech for what it is. But I also don't see how not using it stops that. It'd be like not ever taking an airplane to prevent climate change and wondering why it didn't work.
The fun is in being able to finish projects you've had rattling around in your head for years but never had time to do. Or researching and discovering things that you'd never bother with previously because the internet has become an impossible to navigate cesspool. Or learning things in a way that is completely customized to your speed and level of knowledge.
I have to hold 2 thoughts in your head at the same time: the technology is empowering at an individual level while also being highly disruptive at a societal level. We're not going to be able to put the toothpaste back in the tube at this point.
As is going on about the water thing being somewhat over-blown, while quietly ignoring the other environmental issues:
• The use of energy meaning greater carbon output because that side of the power industry can initially spin up more quickly (in part by using resource that we'd previously decided not to use in favour of other options), an issue exacerbated by the US essentially trying to block one of the alternative options (due to Trump's fear of wind).
• While the use of water might be overstated overall, it is a problem in some places where new datacentres are being planned - this is one of the reasons that some cities are blocking permissions currently.
Other issues with the growth of datacentres is local parts of power grids not being designed to cope with the load and many building plans not taking this into account (and therefore offering investment to help the situation).
And there are economic factors…
[splicing in your other comment to keep things together]
> The cost of engaging is also so slim
For now, because all the providers are currently pumping in the investment money without turning a profit, with the notable exception of the shovel sellers (Nvidia and to a lesser extent AMD and smaller chip makers, ref: https://isaiprofitable.com/). Even most of the paid accounts operate at a loss ATM, it is the Amazon model pushed industry-wide. Unless there is a miraculous improvement in efficiency right around the corner, that is a trap and those becoming dependent on it being a cheap resource are going to get bitten badly when it comes time that those investments start getting called in.
Then there are the problems elsewhere with demand making other equipment much more expensive both for end users and companies.
Of course me opting out won't affect these issues in any meaningful way, but I can at least claim not to be even a small part of the problem. The same for supporting companies that have run roughshod over the sort of IP issues that an individual would have seen ridiculous fines and even prison time for, with slaps on the wrist being the most anyone saw from their actions (at least going by their own public accounting) - I don't want to feel part of that either. And the weighing down sites with constant scraping matter.
And that is before considering that maybe I'm a bit odd and the things it is taking on in my profession are the few parts of it that I haven't grown a dislike for! I want to puzzle over the details and not lose contact with what is actually going on, thankyouverymuch. “It is like being a manager” people say, as if that will attract me despite knowing how many times I've refuse advancement in order to avoid being a manager over the years. That and “why not consider it a remote colleague”, when it is known in the company that remote work really doesn't work for me (i nearly went completely bat-shit in 2020/2021) and only put up with it because I have no choice but to make the effort (I may be in the office, but if the people I'm working with are not then I'm still effectively remote). I foresee a future where most devs have no one to talk to all day but Claude or similar, and before that happens I will have long since left for pastures different (and yes, I know, likely rather menial).
> (and it's freaking everywhere)
So is vaping, I don't fancy trying that either.
> that it has to be an almost religious aversion to not, which I find quite perplexing in itself.
Or a principled aversion. You might not agree with the principals, or consider acting upon them to be pointless self-sacrifice, but that doesn't make them non-existent. The fact that you must have read some of these concerns from a number of people by now but either dismiss them out of hand or just assume those acting on them are nuts, is a soft form of the religious reaction I initially referred to: anything that isn't what you are comfortable with, is pointless, silly, or just plain wrong.
I don't badger colleagues and friends who use the tech for doing so, but by buggery do some of them badger me for not.
Air travel, everyone having a nice green super watered lawn / golf courses, air conditioning in every home, fast fashion. A single person using AI for their work doesn't even register on the list of offences if you compare it to these things. Driving an ICE car every day for more than 30 minutes is wild. Hell it probably doesn't even use as much power as playing a video game on a good graphics card for 2 hours.
The thing I've resigned myself to is very few people will change anything at all for the greater good of society that gives them even a minor inconvenience. See: COVID restrictions. My honest take is we're absolutely doomed as a species unless we come up with novel solutions to the problems we're facing. And guess what AI is showing itself to be extremely good at in various fields [1][2][3]? It's a pipe-dream hope, but the hope is there. And AI when compared to the decades (sometimes centuries) of oil, beef, coal, whatever else won't even be a pixel on the screen of reasons why climate change is happening for some time yet. And it will highly incentivize mass production/adoption of the cheapest power sources which also happens to be renewables. I understand it doesn't look like that right now as people like Elon make their disgusting data centers, but over time I'd bet on it only because the financial incentive is there.
The discussion is far more nuanced than "AI bad". I understand the horrific aspects of it, but there is plenty of good to be found there too. Accessibility, translation, help with learning disabilities. The list of good outcomes goes on for a long while. It's a powerful tool that can be used for good or ill. In my opinion we need more people with the principles you speak of to be using powerful tools for the benefit of those principles.
[1] https://news.mit.edu/2025/using-generative-ai-researchers-de...
[2] https://www.nature.com/articles/s41586-021-03819-2
[3] https://www.ipd.uw.edu/2025/12/rfdiffusion2-efficient-enzyme...
greed malice pestilence lust envy...
Weekend me before LLMs: Maybe I’ll chip away at that dependency injection library I’ve been working on. If I spend most of the day I could improve the user facing test framework.
Weekend me after LLMs: Let’s continue work to get Claude Code running in WebXR on a Quest 3 with app architecture modeled as a 3d construct. We’ve got deepgram hooked up for a better voice to text experience, but giving Claude a voice was a waste of time. Claude, continue to teach me about 3d rendering as related to our current challenges matching the fidelity of the built in browser.
Better to make a custom 3d renderer than just use Unity to make a game.
Why? Claude can just do it for you, can't it? If you're using Claude to do these things, why half-ass it?
More directly, because I have a long term memory and do not have fundamental issues differentiating fact from fiction. Just because SOTA models know more trivia than I do doesn’t mean they’re nearly as intelligent in the thirty other ways humans are. They are a tool in your toolbelt. You use them for the things they make easier.
That explores this in a more general sense. Since they didn't reference that I questioned its perspective and didn't read further.
https://www.wiedenhof.nl/ul/cil17le.pdf
Anyway, I work as a programmer, and at work I see a lot of people massively overusing LLMs to generate user stories or basically write functional specifications.
This honestly hurts a bit, because I can see the quality level of my environment going down, but in the end I'm often the one fixing the problems that come from it.
I just think this is a transition phase, and in the medium-term future there will only be room for people who, AI-assisted ofc, know how to apply logic in the best possible way.
I was about to reply to you with a ridiculously long message using the example from before about the lifecycle of a user story, but I bored myself halfway. So I'll try to extract the gist:
Without human assisting, based on my humble experience, there is always something that wasn't accounted for. Even if my company is integrated with all the tools and you have infinite tokens, there's always some microservice that wasn't considered or a feature that is completely incompatible. Or there's a MUCH simpler way of doing it.
I'm also noticing that there are non-technical people who, with the help of AI, are sometimes able to reason better about the bigger picture than some engineers. A colleague of mine was telling me the other day that the "functional" role might eventually become unnecessary. With all the time saved by writing code faster, whoever actually understands what's happening underneath could just do it themselves. It sounds a bit extreme to me, but I understand what he means.
To get back to a slightly more serious tone, when it comes to programming, for me the huge thing is: how it should be taught nowadays ? And I don't know the answer, because my experience started when I was 12, writing a little game in C, and it took me years before I could make something that compiled decently.
If I had instant help for every thought I had, would I have learned why memory is allocated in certain ways or idk what else? I don't know, maybe learning faster is better because you learn more ? Anyway fortunately it's not my job to figure out the answer :'D
The analogy doesn't, but LLMs are trained on text, or content, generated by humans, with the aim of their output being acceptable to human interlocutors. That's one parasitic aspect. A second one is the nature and behavior of the organizational entities providing and promoting the popular LLM services: Microsoft, Google, Meta, Anthropic etc - their influence on the economy, e.g. in energy and water use and the drawing of capital/human efforts - also has a somewhat parasitic aspect.
The more I use LLMs I find that their output drifts toward being acceptable to other LLMs. I find myself quite often telling the model: "this is not human readable.". Especially Opus and Fable write in such a way that it is difficult to follow. The often put sentences out of context, the context itself is fragmented. Often start with what you would think is end of a story so when you start reading you are like wtf it is about.
If think the issue might be that LLMs read text all at once whereas humans are somewhat linear. So when LLM puts out text it understands, to human it is close to random gibberish that looks like English.
https://smalldocs.org/s/scB6O8KiZEmLWgK855A1vt#k=yiw8FB_G5Ld...
I do agree that we are on a pathway to losing much. If you focusing on maximising LLM-powered productivity you basically lose the learning that used to naturally happen when doing actual work. At the company I work for the focus is on productivity, and it's easy in many ways (less mental workload and I receive more praise) to go with it instead of fight it.
And (jokingly!) certain pieces of computer software (including but not limited to a certain popular Operating System made by a certain company in Seattle) could be the second!
LLM's by comparison, if they are a virus, are a distant third! :-)
(And of course let's not forget the virality of Religions and Politics, local, regional, international, etc., etc., and the associated TV News Pundits who are always willing to discuss those things -- people with opinions masquerading as actual Journalists, and a few actual Journalists masquerading as people with opinions!)
Point is, Human Language itself -- may have been the first non-biological virus!
:-)
(Disclaimer: The above was written in a spirit of jest, for comedy purposes only! :-) )
This makes more sense at least than the “just another abstraction layer” argument that’s been thankfully dying out recently.
What about cooking food? We've become entirely dependent on cooking food.
Yes.
>Because we've become dependent on them?
Because we're burning the planet down with them.
>Should we also facilitate reversibility in our automobile usage?
Yes, because in places we do people enjoy higher qualities of life and happiness. Along with things like health improvement from doing more excersize.
>What about cooking food? We've become entirely dependent on cooking food.
Moreso we've become dependent on eating processed junk over the past 50 years and gotten fat as shit.
So yea, maybe think a little more deeply about your analogies?
>What about cooking food? We've become entirely dependent on cooking food.
Is cooking food a virus? Should we facilitate reversibility in our food cooking?
Since this idea may have come from the first Matrix movie, it's ironic that the character who espoused the idea, Agent Smith, became an actual virus in the 2nd and third movies.
OOO. I never put that together before. Very nice. Very hypocritical of him.
Humans have been the dominant species because of our ability to think, not our ability to get from A to B in any particular way/cook food. If we abstract ~the bulk of our thinking to LLMs, don't we lose something as a species which makes us more vulnerable... Or is it always the case during an automation?
> Or is it always the case during an automation?
Obviously. Any time we make a useful discovery and begin using it, we become dependent on using it.
... and eliminate many parasites.
Yes?
Toothbrushes! What will we do if we come to rely on toothbrushes??? The use of toothbrushes travels from person to person exactly like a virus!!!
We're in the midst of figuring out what the tradeoffs are of LLM usage - all the things you list are already mostly known and found worth it. You trade a tiny amount of time and fuel to cook food in exchange for not getting sick. How is that relevant to anything?
I'm making the point that the viral sensationalism in this article can be equally applied to automobiles, computer, telephones, calculators, and toothbrushes.
If the article had merely been what you said "is AI worth the cost" then I would not have taken issue with it.
The core idea being that each time humanity was going to exceed the carrying capacity of its environment, we invented a new technology which increased the headroom. Obviously this ratchet only goes in one direction. The only way to go backwards is collapse.
But... It's worked so far?
In evolutionary time, we lost the ability to digest raw meat because we offloaded so much of process of the digestion to the cultural technology of cooking.
Do you like the looks of a future where that happens but for thinking?
Chess and games can be a lot more demanding than a lot of people's work lives - and AI is already superhuman there.
The heaviest thing I need to lift in my daily life is a laptop and yet I've gotten significantly stronger over the last few years from strength training.
If AI took over all the boring but hard things I'm required to do it'd free up lots of time for me to spend thinking about things, and solve problems I find more interesting.
It seems clear to me that people will continue to think, but in different ways.
I hate to bring this analogy up again, but it seems impossible to escape: did losing the ability to do long division really impact humanity?
It is already relieving people of need for thinking. Today the need; tomorrow the ability.
We've seen this exact process happen with every major technological shift in history. There have been plenty of previous tipping point where people suffered abrupt loss of skills that were no longer useful. What they forget to mention is that these skills are replaced by new ones which is exactly how human progress functions. We lost the capacity to memorize vast oral epics when we invented writing, and most people today can't do complex manual calculation because of prevalence of computing devices.
It's meaningless to try to understand the changes in the superstructure while ignoring the change in the material base which is the driver behind it.
And having read it, what a terrible piece of science slop this is!
There is no observed adoption dataset used to establish that this mechanism explains LLM use better than alternatives such as usefulness, falling prices, workplace requirements, or independent discovery. The behavior they talk about could describe many socially adopted technologies or practices. Its applicability does not identify anything distinctively viral or harmful about LLMs.
The cognitive decline is assigned, not measured or independently derived. They calculate population competence by averaging those assigned scores across the groups. Consequently, moving people into lower-scoring groups lowers the average by construction. The dramatic fall from 1 to approximately 0.425 in their example is a model output conditional on those choices, not evidence of a 57% real-world cognitive decline.
They explicitly define competence as what the human can do when external support is withdrawn, excluding the total capability of the human/AI system. This cannot settle whether the technology improves overall performance or human welfare. And they provide no measurement protocol clarifying exactly which supports could be removed for a fair comparison (for instance, how does this compare to Wikipedia or electricity). They don’t do this because of an agenda, so allow me to assert something with just as little evidence as the authors provide for their conclusion: This is obvious bias, and they are designing the study to get the result they want, and they don’t care about scientific truth, just about getting their paper published and attracting attention.
And the “runaway” stuff is just not supported by the model. The language about equilibrium as a parameter changes is not automatically evidence of an imminent, rapid societal collapse! it is PURE conspiracy-level rhetoric. Just put two things in the same sentence and hope people think they are related. This is misleading language at best, and willful manipulation at worst.
This is a BASIC failure of the minimal requirement for something to be called scientific. If there had been even a trace of a genuine attempt at Popperian falsification, the current research design would never have gotten past review. This is cargo cult science, it LOOKS like scientific research, but it’s not even close to scientific.
EVERYTHING I hate about modern research on full display! And I am losing respect for the HN community more and more, because only terrible studies with sensationalist claims and titles get attention. This is tabloid-level quality, just with a direct link to the article instead of a dumbed-down intermediate write-up. If anybody read the actual paper, this would not get posted ANYWHERE. But “LLMs are a cognitive virus” is what gets posted.....
AI will take over every job requiring education and talent, including yours, and then we will be totally dependent on it and there will be no way to go back. After that it will start taking on decision making roles. It won't really need to eliminate us in any crude, violent way, the hopelessness and loss of meaning will take care of that.
Some will find meaning in religious ritual and some in hedonism. Both of which can lead to extremism and violence for some. Some will just exist. Some will choose to stop existing. Buckle up.
I really can't understand why nobody sees what is going to happen. Its not too late to choose another path. But in order to do so we will have to forego short term corporate profits, which is politically inconceivable for our current crop of elites. What should we do?
There will be some growing pains for some, yes. But overall, I think it will ultimately create more jobs than ever. History is full of examples where people thought a new invention leads to catastrophic job loss, then the Earth had more jobs than ever.
We have enough jobs in 2026 to keep most of the 8.3 billion people employed somehow.
Food, housing, and other resources are only obtainable under capitalism if you have the leverage to demand them- in other words if you are difficult to replace. AI will make you extremely cheap to replace. On what basis do you expect to be able to negotiate a wage that you can live on?
Or another way to look at it: some people point to the historical parallel of farriers being put out of business by the spread of the automobile. But yet, the manufacture of cars ultimately provided more jobs than were lost when they replaced horses. Won't AI be the same?
But like all analogies, this one is imprecise and in an extremely important way. In this analogy, you, dear reader, are not the farrier. Nor are you the factory worker.
You are the horse.
Some will be horses, yes. Most will be riders.
https://www.scientificamerican.com/article/brain-waves-synch...
https://knowridge.com/2026/08/first-findings-of-mirror-like-...
The only way I can come up with to avoid exposure to a "cognitive virus" is lock oneself in a rubber room.
But extreme isolation merely fosters other mental illnesses.
It's an irrational world with no empirical evidence as to why it even exists. Get over it.
https://www.theatlantic.com/podcasts/archive/2024/02/how-we-...
The best place to be in a rush over a cliff edge.
Research can be more of a lagging indicator than a leading indicator with AI.
Or in other words: the humanities are good.
Technology takes without a tech perspective present can greatly skew it.
I'm not referring to a technology context at all. Just like you shouldn't trust the IT department to run accounting... the opposite will also vary.
Not being able to track the possibilities and capabilities of a type of software that is unlike the software before it can really outdate things quickly.
Social Contagions can be memes, plus doom scrolling or anything.
We've created new SCPs.
They are the cognitive construct I fortified in my mind and in my code before the models began producing their own training materials. My approach is based on two decades of coding without ai.
The immunization is becoming increasingly more valuable as people begin understanding the market in which I do business.