69 comments
(I did learn much of my QFT from Schwartz’s QFT textbook though, so I hold him in higher regard than <insert random Harvard Physics prof here>.)
It's worth a read, and very interesting. All of the papers he posted have relevant experts of said fields on them as I understand it.
LLMs making otherwise extremely intelligent people veer off in a strange direction isn't new. When reassured by LLMs, there have been many cases where someone starts posting papers on a plethora of fields they know nothing about, making unified theories that try to tie several fields together, or get convinced they made a real breakthrough when they haven't. I don't think there's been a single counterexample so far where someone used LLMs to push out so many papers on so many topics and have them be correct. So until someone who knows something in these fields pitches in, I'm remaining skeptical by default.
I read the Anthropic post yesterday. I read the Reddit comments today. I observed that many of them are being overzealously anti AI and likely didn't even click the link they were commenting on, let alone look beyond it.
It's good to be skeptical. It's bad to jump to conclusions based on an emotional response to AI in general. It's bad to be a Redditor.
Should they pretend that the papers are great and the guy is infallible just because of his position? No, but his prior achievements are probably a signal that they should not jump straight into the usual circle jerk.
Good judgement takes time, but if the time to judge exceeds the time to spam -- and it does, by many orders of magnitude -- then we should expect the approach "judge each work by its merits" to result in being overwhelmed by spam, which we already are. Reputations let you amortize the cost of acceptance and reduce the cost of rejection, giving you a fighting chance against spam that extreme open-mindedness does not.
I suspect there will be citations galore shortly, faster than anyone can think.
Wisdom of the crowd has finally proven to be more valuable than some obscure title in academia. Crowds are relentless and ruthless, kind of a red team instead of a cronyism.
PS: The infamous replication crisis deserves a honorable mention here.
Three words: Cambridge, Jason Arday.
I was confused too. Whoever wrote the title(s) doesn’t know a second language, otherwise, they would have realized how confusing that was, even to native English speakers.
We do of course need to watch for hallucinations, but I in general expect AI to be very good at theoretical physics. AI can take a lot of known equations and prove/propose (these are different things!) generalizations to that may or may not match reality. AI can suggest experiments to see if the predictions match the real world. Maybe string theory can finely make a non-trivial prediction that we can test in the real world...
However AI is terrible for other parts of physics (at least so far) and those are also important we shouldn't lose track of them despite the excitement that we can get from progress in things AI is good at.
I wouldn't count on that to last in any area.
Edit: the papers do seem to have other names on them, and he says that all papers "were reviewed by humans for accuracy", but I still think there's a very serious risk of people being gulled into okaying something that's plausible rather than rigorously checking everything. There's enough human-generated slop in science already!
Read the full thread on Hacker News →
Related stories
- Hacker News · 4 points · 14 days ago
- Hacker News · 3 points · 1 day ago
- Hacker News · 2 points · 9 days ago
- Hacker News · 1 points · 9 days ago
- Hacker News · 1 points · 13 days ago
- Hacker News · 2 points · about 1 hour ago