44 points•xqcgrek2•about 4 hours ago•69 comments•

69 comments

phoghedabout 4 hours ago
A very high number of Redditors think they know more/better than a Harvard professor and dismiss him out of hand. May someone grant us all a measure of their confidence.
oefrhaabout 3 hours ago
As a former hep-th guy from a very reputable institution I was ready to at least skim and briefly evaluate 36 particle physics papers. Turns out most of them have nothing to do with physics. It takes a special kind of personality to have the hubris to publish in so many domains at once, and most Harvard/Princeton/etc. physicists I know would probably be critical of this. Not that the disapproval would mean much.

(I did learn much of my QFT from Schwartz’s QFT textbook though, so I hold him in higher regard than <insert random Harvard Physics prof here>.)

obastani28 minutes ago
At the very least, many of the papers in other domains are co-authored with experts in that domain.
famouswafflesabout 3 hours ago
The blog post should have been posted instead I think - https://www.anthropic.com/research/claude-shaped-science.

It's worth a read, and very interesting. All of the papers he posted have relevant experts of said fields on them as I understand it.

tavavexabout 2 hours ago
Seems like you're doing the same thing, dismissing the commenters out of hand (even though many of them make good or decent points - the quantity, the absurd number of unrelated fields, the weird meaningless LLMisms) while using the professor's title as a battering ram to destroy the notion that he could ever be wrong, even on things outside of his field of expertise.

LLMs making otherwise extremely intelligent people veer off in a strange direction isn't new. When reassured by LLMs, there have been many cases where someone starts posting papers on a plethora of fields they know nothing about, making unified theories that try to tie several fields together, or get convinced they made a real breakthrough when they haven't. I don't think there's been a single counterexample so far where someone used LLMs to push out so many papers on so many topics and have them be correct. So until someone who knows something in these fields pitches in, I'm remaining skeptical by default.

phoghed38 minutes ago
I know it's a HN rule that one must take people who don't RTFA seriously and not point it out, fortunately that doesn't extend to Reddit users.

I read the Anthropic post yesterday. I read the Reddit comments today. I observed that many of them are being overzealously anti AI and likely didn't even click the link they were commenting on, let alone look beyond it.

It's good to be skeptical. It's bad to jump to conclusions based on an emotional response to AI in general. It's bad to be a Redditor.

Should they pretend that the papers are great and the guy is infallible just because of his position? No, but his prior achievements are probably a signal that they should not jump straight into the usual circle jerk.

glitchcabout 3 hours ago
Appeal to authority is a logical fallacy. Each paper will need to be judged on its own merits, irrespective of the source.
smallmancontrovabout 3 hours ago
Reputations are the answer to spam.

Good judgement takes time, but if the time to judge exceeds the time to spam -- and it does, by many orders of magnitude -- then we should expect the approach "judge each work by its merits" to result in being overwhelmed by spam, which we already are. Reputations let you amortize the cost of acceptance and reduce the cost of rejection, giving you a fighting chance against spam that extreme open-mindedness does not.

sdcfgyabout 3 hours ago
From my own experience, I'm not sure that is necessarily the case. Retraction Watch is also an interesting read.

I suspect there will be citations galore shortly, faster than anyone can think.

_the_inflatorabout 3 hours ago
Remedial Math - I love it.

Wisdom of the crowd has finally proven to be more valuable than some obscure title in academia. Crowds are relentless and ruthless, kind of a red team instead of a cronyism.

PS: The infamous replication crisis deserves a honorable mention here.

eieje12about 4 hours ago
Brand names don’t mean much anymore.

Three words: Cambridge, Jason Arday.

sdcfgyabout 3 hours ago
As Cambridge alumni, that one hurt when it happened. You're not wrong.
f6vabout 3 hours ago
Stanford, Marc Tessier-Lavigne.
sickofparadoxabout 3 hours ago
At Harvard itself, Claudine Gay.
kpsabout 3 hours ago
Did he drop them because they were hallucinated, or did he millennial-drop them? I still can't tell.
guessmynameabout 3 hours ago
“Drops” as in “Releases”, not “Retracts”.

I was confused too. Whoever wrote the title(s) doesn’t know a second language, otherwise, they would have realized how confusing that was, even to native English speakers.

delichonabout 3 hours ago
Maybe he should be "sanctioned".
bananaflagabout 4 hours ago
If AI is so good at research then maybe instead of people researching comparatively easy problems which only get you a publication, they will research problems that matter. (I'm not dismissing here problems just because they are "easy" or "not practical", I am sure that there are a ton of worthwile ones among those, I am dismissing just those which are artificial and only researched out of publication incentives.)
bluGillabout 3 hours ago
AI is only good at a subset of problems. However in that subset it is often very good. There is a lot of "low hanging fruit" in that subset and we can learn a lot quickly by having AI work in that area.

We do of course need to watch for hallucinations, but I in general expect AI to be very good at theoretical physics. AI can take a lot of known equations and prove/propose (these are different things!) generalizations to that may or may not match reality. AI can suggest experiments to see if the predictions match the real world. Maybe string theory can finely make a non-trivial prediction that we can test in the real world...

However AI is terrible for other parts of physics (at least so far) and those are also important we shouldn't lose track of them despite the excitement that we can get from progress in things AI is good at.

bananaflagabout 3 hours ago
> AI is only good at a subset of problems.

I wouldn't count on that to last in any area.

frereubuabout 3 hours ago
Reminds me of this - https://statmodeling.stat.columbia.edu/2026/08/27/258/ - which I think was on HN at some point in the last week. The fact that (according to another comment here) these papers were in areas outside his specialism, and therefore things he doesn't have the domain knowledge to critique, makes me think we're going to see more of this special kind of madness that seems to have some kind of grandiosity at its heart. It really does feel like some people are falling hard for plausibility rather than rigour.

Edit: the papers do seem to have other names on them, and he says that all papers "were reviewed by humans for accuracy", but I still think there's a very serious risk of people being gulled into okaying something that's plausible rather than rigorously checking everything. There's enough human-generated slop in science already!

iricktabout 2 hours ago
Schwartz explains what he did in an Anthropic post: https://news.ycombinator.com/item?id=49933386

Read the full thread on Hacker News →

Related stories