89 comments
Anecdotally, current models seem to be decent at general personal finance principles - certainly better than the majority of personal finance education that people get exposed to unless they seek it out and read a variety of books and sources. But I wouldn't trust them with direct decision making with actual money due to the training lag time on current tax policy, etc.
Also, models are now good enough that you can give them chapters from "authoritative" books, and they'll integrate that and come up with better answers even if their "vanilla" answers were average. And they'll tailor stuff to your particular situation. It's funny that the "agentic" stuff is only used in coding mostly, while it can and does work in other fields as well.
As always, you kinda need to check it (at least spot check) but all in all I'd agree it's better than the average stuff you used to find with a quick google search.
Isn't that a bit circular - if you already know the authoritative source, why ask a model?
Of course a language-completion model with a training cutoff date won't have up-to-date information on tax rules or the ability to carry out correct numerical calculations, but when you combine that with (in Claude terminology) web search and code execution tools invoked by the chat agent, you immediately have much more reliable results.
I fed the first question to Grok (which they claimed they tested as well) and it answered it correctly in detail.
I repeated it with another one - again correct answer. I then selected the question they said Grok specifically answered incorrectly and it again answered it correctly.
I am sticking with my first intuition: people are terrible at testing tools and probably wanted them to answer incorrectly/not fully (the questions are constructed in a way to make it difficult as well). They also have vested interest in the conclusion (they are financial advisory firm) so there is that to consider.
People reading ft will now think chat boxes are bad at answering financial questions while they are pretty good at it. Zero consequences for spreading fake news for Financial Times there but good for financial advisors I guess.
Okay but why do you feel 3 trials say as much as 10,000?
I don't trust them so I've used 3 examples in incorrect questions/answers they have given and I got correct answers. I spend enough time with LLMs to know that if Grok answered it correctly and in detail then it wouldn't be a problem for GPT or Claude either.
The questions are also constructed in a way that it's easy to answer not fully (which they qualify as wrong). LLMs still answer them correctly and in detail though.
So finance advisors in the comments section of FT are falling for the classical pitfall. They assume there is something fundamentally wrong with “AI chatbots” that they can’t do finance ever. They mistake the current products in the market for the technology itself. In near future someone will release “Claude x=Finance” and their world will shatter.
I do find them useful when querying like "how todo xyz in abc"
Not sure what the "financial queries" here amounted to but I find it hard to believe LLMs will ever be to finance what they are to programming. Past a point, information related to the former is gatekeeped behind private institutions with special government granted privileges, while information related to the latter is freely available and open to anyone.
#!/bin/sh
while read question; do echo "Put it into VFIAX"; done
- Building an emergency fund
- Budgeting and tracking where your money goes
- Planning and saving for large purchases like cars, homes and life goals
- Optimizing use of tax-advantaged accounts like 401Ks, HSAs, and IRAs
- What to do with ESPPs, RSUs, and options
- How taxes work and how to optimize around them
- Estate planning
In my case, I am double-taxed (both Japan and US side) on capital gains. Tax treaties reduce, but not eliminate, the extent of double-taxation.
Many US-based brokers do not allow Americans abroad to purchase mutual funds, so VFIAX is not a choice for me.
Maybe I can go with eMAXIS Slim All Country... Oh, but that is a PFIC under IRS rules and I'd be taxed on unrealized capital gains. So I guess no Japan-equivalents of VT for me. That's fine, I guess I'll just buy VT in my US-based brokerage account; but now I'm in a suboptimal spot with respect to monthly contributions, calculating JPY-denominated income tax on dividends, etc.
I even made an implicit assumption when I said "calculating JPY-denominated income tax on dividends". That assumes your tax status is permanent resident. If your tax status is non-permanent resident, then a decent financial advisor will recognize that only the extent of income remitted to Japan gets taxed, so VT distributing at all isn't an issue (until 5 years later). What should you do before the 5 year threshold is hit? etc. etc.
But yes, if you're born in America and plan to stay within the same state for the rest of your life, then a 100% automated setup that simply deposits $1,000/mo into VFIAX is probably fine. (But keep in mind, to most non-Americans, VOO is not really diversified compared to funds like VT).
Otherwise, there is value in consulting someone (or something) that regularly handles taxes and financial planning.
For example in the UK (and maybe US?) you get tax relief for money you put into your pensions, but there's a limit of £60k/year. Unless you earn a lot (which I do, yeay) when that limit is tapered. Except that you can also use up to 3 years of previously unused allowance. But you have to use this year's first.
Also interest is taxed, but you can put up to £20k/year into an ISA which isn't. And if you still want to avoid some tax you have kids ISA's and even pensions!
Then there are also startup investment schemes that save you some tax. Those seem to be not worth it, but you get the idea - it can be complicated. Especially if you are near one of the many tax/benefit thresholds.
The marginal tax rate in the UK bounces all over the place - it's even technically possible for it to be over 100%!
-VFIAX is currently $707/share. Fidelity's FXAIX does not have to be purchased in increments of a share price, and this fund's expenses are lower.
-There are versions of the S&P 500 for taxable accounts that minimize capital gains.
-Vanguard has a total-market index, VTSAX, that is mentioned in the book.
-Vanguard also has a non-U.S. total market fund, VTIAX, that avoid the current CAPE problems of the U.S. market.
Claude is very familiar with Bogle's approach, likely because the pirated book was part of the training set.
In general, invest in low-cost index funds is pretty solid advice everywhere. In different countries you might use slightly different instruments due to tax advantages (like the ISA in the UK etc.)
Read the full thread on Hacker News →
Related stories
- The Verge · 0 points · 3 days ago
- Can you forget how you feel about Meta?theverge.comThe Verge · 0 points · 9 days ago
- The Verge · 0 points · 5 days ago
- Can John Ternus find Apple’s next big thing?theverge.comThe Verge · 0 points · 10 days ago
- Hacker News · 73 points · 9 days ago
- The Verge · 0 points · 12 days ago