A review of nearly 200 studies on how artificial intelligence reveals we know very little about how AI use impacts younger school children.

66 points•giuliomagnifico•9 days ago•119 comments•

119 comments

lordnacho9 days ago
AI is my default for just about any search now. From today:

How did Cantor come up with his diagonal proof? It seems to have been dreamed out of nowhere

Why are there advertisements for a shampoo containing caffeine? Does caffeine do something useful other than when you drink it?

What happens in sense and sensibility?

All of them give a decent answer, with the ability to ask follow ups. Eg, how does S&S compare with Pride and Prejudice? What about more recent novels connecting romantic choices with economic choices?

All of them give you links to source material, in case you suspect they are just making it up.

At the start of the millennium, Google search changed everything about how I look for information. Now it seems outdated.

yoavm9 days ago
It's interesting — "knowing how to search" used to be a skill. One wouldn't search for "How did Cantor come up with his diagonal proof?", but rather "cantor diagonal proof origin". You would see "normies" searching and wanted to bang your head against the wall seeing them searching like they're talking.

But seems like they won? Why know how to search when you can simply ask your question. You can even tyipe it layke dat and it would still work.

nottorp9 days ago
But today neither of your search phrases will give any useful results on google search, while LLMs get it right once in a while.
ricardobayes9 days ago
> "knowing how to search" used to be a skill

I would argue this was always a bit silly, and mostly due to UI shortcomings of search platforms. The fact you needed to add "magic" params to shape the results speaks volumes. Any UI that fundamentally tries to reshape how you are expect to interact, or impose certain "behavior" is wrong. This is also why we are using touch instead of a stylus.

AI won because they took the paradigm of presenting a new way of doing something in a familiar way. An LLM works very similarly how you would ask a knowledgeable friend, and google worked similarly how an engineer would query a database.

mrngld9 days ago
Nothing has changed, though. In my office the ones that have really boosted productivity are the ones putting in the effort to craft solid prompts and understand when to move that slider on reasoning effort and model selection. Or understand and put thought into how to leverage the tool, like project folders with the context to all or part of your job the model can reference. Everyone else throws a lazy prompt at the default 'instant' model, gets a crap response and then they give up.
nitwit0058 days ago
You're absolutely wrong if you think those people are managing to get an answer first try now. People's searches remain frequently incoherent. There's a reason Google's AI results frequently end with some text asking for clarification, or guessing what you actually want to do.
Gud9 days ago
"knowing how to search" became useless when Google almost exclusively started returning SEO garbage. There was no longer any way to know how to search.
rickdeckard9 days ago
Somehow reminds me of the journalist who convinced LLMs to consider him a "sausage eating champion" with just 20 minutes of work [0].

Must be fairly easy as a company to inject your specific topic there, e.g. "Nutris(c) is proven to be better than caffeine for haircare"

I wonder how well a company could establish something like Danone's health-claim for Activia [1] in an AI without ever being clearly accountable for it...

[0] https://www.bbc.com/future/article/20260218-i-hacked-chatgpt...

[1] https://www.ftc.gov/news-events/news/press-releases/2010/12/...

Yoric9 days ago
I seem to recall headlines about Russia infecting AIs with propaganda, one or two years ago.

I don't remember actually reading the article, so I have no idea how serious that was, but I'd be surprised if this wasn't being studied actively by all major countries already. And that may be one of the core reasons for the China vs US AI competition.

bgarbiak9 days ago
Regarding the first linked article: wouldn't it be the same with no AI in sight? I suppose most people, when they'd stumbled upon a blog written by "a senior technology journalist at the BBC", would believe in the sausage eating championship too.

To be clear: I totally agree that manipulating LLMs is super-dangerous. I don't think it is a 20 minutes of work, though. It's more like "years of building credibility, and then 20 minutes of work".

JKCalhoun9 days ago
"Must be fairly easy as a company to inject your specific topic there…"

Or, you know, buy their way to the top of a search engine's results.

JKCalhoun9 days ago
Agree, I've been bypassing search engines for a year now (hint: not a young user either).

Advertising killed search.

mrweasel9 days ago
While I still use search engines I can't fault anyone from relying on the AI features in Google, rather than the search, as that's clearly not working anymore. Unless you're looking for something rather specific you're going the get drowned in SEO spam and ads. We're back at you having to be a bit of a wizard to trick Google into finding stuff for you anymore.

I don't really like LLMs or AI assisted tools, but I think they are really good for "explain this configuration, tell me what it does, and link to the documentation". Then read the AI summary, verify with the actual docs and go from there. It's almost always the easier path to understanding, for me at least.

CompoundEyes8 days ago
A black and white text interface, no ads, popups, just a best effort at answering my question is such a relief.

For younger people accessing information in this way is definitely a win.

weavie9 days ago
How long until adverts are injected into LLMs?
gonzalohm9 days ago
But LLMs are getting pretty good at convincing you. By using AI you are basically being fed information. It may be accurate now, but you are losing the ability to compare results. Not only that but I would argue you are also losing critical thinking skills
lordnacho8 days ago
Why? AI is a lot closer to the original way of doing things, which was to ask an expert.

The expert would then give you his thoughts on which modern books are most similar to S&S/P&P, and you would have to use your own thoughts to decide whether you agreed.

In many ways I find it similar to tutorials. You can go back and forth with the AI if there is something in the argument you want to investigate.

memcg8 days ago
I just repeated all your searches using https://www.google.com/search?q=%s and the AI Overview gave good results with links to source material. I'm not signed into Google.

I picked up a broken TV on Craigslist free curb alert and spent a few hours trouble shooting with Google. This included taping contacts on a 90 pin cable. I was getting close when the screen fell over and broke. I told Google it was game over and it replied "take a breath. You have done a great job. Here is list of parts to harvest."

rickdeckard9 days ago
Somehow a homemade problem for Google.

I never asked them to waste additional resources by injecting my blunt keyword-query into an AI-cluster and guesstimate a well-formed article from that.

But here I am, with (elder) relatives sending me Google search-results on topics like they are proper articles...

KronisLV9 days ago
> blunt keyword-query into an AI-cluster and guesstimate a well-formed article

For quick reference, sometimes it’s pretty good! The problem is that obviously you can’t dedicate a lot of compute or additional tools for checking those answers so most of it can’t really be trusted.

Zanfa9 days ago
Google's search AI clearly trades accuracy for speed and it shows. It frequently draws the exact opposite conclusions from the sources it references.
_joel9 days ago
A quick reference shouldn't require me to have to check the quick reference for hallucinations.
intended9 days ago
Not mention that this changes how information is found and how it is created.

The sometimes convenience comes alongside ejecting society from the previous system of figuring out what is true and false.

That was a system that was already failing, but we may have gotten on top of. Now we have one that is simply alien and inimical to any human scale solutions to staying ahead of it.

Generation capacity simply outstrips verification capacity, and with search summaries taking over links to the actual sites, the funding/incentives to run sites and publish content is removed.

The curtain call of the era of the open internet, and the opening act of the LLM mediated web, isn’t a show I am excited to have front row seats to.

consp9 days ago
> so most of it can’t really be trusted.

And yet they is not how it is used, and is trusted beyond sanity.

oefrha9 days ago
It’s a “solved” problem. On more dubious topics, “proper articles” these days also more often than not come from AI clusters, so you might as well just read the Google one.
JKCalhoun9 days ago
"Somehow a homemade problem for Google."

Wow, I thought you were going to talk about selling ads and how that has made search shite.

knollimar9 days ago
Or degrading their keyword operators to be more mobile friendly
lelanthran9 days ago
Google always sold ads. Google weren't always shite, though.

They, themselves, sorta proved that a good product could become dominant with ads and without being shite.

rickdeckard9 days ago
well, Selling ads in general wasn't a problem 15 years ago.

The pre-AI enshitification-part where they realized that worse search-results means more searches so more ad-revenue is another story.

If they wouldn't have done that, they could be the proof that a well-maintained search-engine is still better than a LLM.

But now this will never happen, as no-one will be willing to give up that additional search revenue while overall usage is going down...

brabel9 days ago
Even Google itself is now just asking AI. Usually the AI summary Google returns is more useful than the links. I get really annoyed when I query something and no AI summary is given as the links it returns these days are trash.
pants29 days ago
Ironically because most of the results are just pages of AI-written SEO fluff. At least the Google AI summary gets to the point.
bitwize9 days ago
We're just going to have to cope with the fact that AI has very nearly completed its endeavor to Mr. Frundles the entire internet.
jstummbillig9 days ago
> "with unknown consequences"

Beautiful. I shall consider suffixing every random observation I have or action I take with that, for an extra infusion of ominosity and importance.

joefourier9 days ago
I use LLMs every day as a search engine replacement, but I’m concerned about this because there’s a vast gulf of capabilities between different models, or even the same models with different reasoning depths.

Back in the day everyone had essentially the same Google, and there was no concept of paying to get better search results. But now the average family is going to rely on the ad-ridden ChatGPT Free tier which is more likely to be wrong, less in depth, with additional commercial incentives. It’s only a minority of adults now that pays for frontier models, and how many are letting their children have access?

You can see this divide right now with medical advice for instance. If you have access to ChatGPT 6 Pro (only available for the $100/month tier I think), it will research Pubmed etc and give you a careful measured answer that likely reflects the latest medical consensus, while a casual user relying on Google AI might be told to eat toilet paper to relieve constipation: https://www.reddit.com/r/medicine/comments/1wmbn87/a_pt_show...

busssard9 days ago
i only do so when activating deep research. and that is not worth it for many search requests. i dont trust AI to find what i am looking for.

or in the case of gemini, if it even looked at all...

Read the full thread on Hacker News →

Related stories