Using GPT-6 and Opus 5.5 to trace alchemical knowledge and decode 17th century letters

174 points•benbreen•6 days ago•44 comments•

44 comments

loufe6 days ago
I've been using AI to help with my genealogical research, and it's been fantastic. I am loving pushing the family history back and catching mistakes that someone who many others share as a common ancestor have made.
thomasfromcdnjs6 days ago
Amen.

I've been doing family history on my aboriginal Australian side, there were a bunch of Lutheran missions, and ever so kindly they digitized 800 pages for me, but it was all written in German. I transcribed and translated all of it.

https://drive.google.com/file/d/1en9gDgZRP7EmSHU72k6g2Iz3RRf...

I sent it back and they didn't acknowledge it, probably for various reasons, and I doubt they would like me linking it above.

Beyond being fascinating in general, I also found that from a different state in Australia there was an aboriginal who became a man of letters came to my ancestral state and was the first to write the language of the tribe, I think (not something easy to prove) it's the first ever written version of the tribal language circa ~1870 of Kuku Yalanji.

52-6F-625 days ago
> I sent it back and they didn't acknowledge it, probably for various reasons, and I doubt they would like me linking it above.

Because if you study this stuff long enough, you'll find the LLMs hallucinate in this space far more than they do in a discourse or programming project.

It can be close enough to seem useful, but make critical errors that can cause rippling problems.

I've done a lot of the same sort of thing with Latin and chancery and while it can really help in understanding it on a personal level, it takes combing over what it has said and zooming in, comparing it with other information, and understanding the historical context. Otherwise it can completely mangle clauses, contexts, etc.

It is remarkable how well they can start to read things like chancery script, but again, many errors. Not reliable, especially in such large volumes. It would require extensive review. And they are probably getting flooded wth things like that now. And not all of them will be benevolent. History is laden with intentional corruptions and the flat, context-less reading that LLMs give can bury that even further.

Don't inundate researchers, churches, and records offices wth this stuff. But it is absolutely a space where it can help, with proper organization and engagement.

16594470916 days ago
I'd caution others with believing caught "mistakes". (But am also interested in how you use it)

There is a farm cited as an ancestor origin by multiple deceased genealogist. Its a common POI that people with this shared ancestor try to find. Finding it could solidify the established line theory and finally debunk a small ancestor fraction's alternate theory.

Different LLM searches keep returning the same colony with invalid/made up references that don't even cite a partial name match. Manual searches throughout that area returns nothing as well. But since the LLM said so, a century+ of various research and work by professional genealogist gets severed from a crowd sourced public tree because "AI" returned a colony name that ended up helping the alt line.

I did eventually find what I believe is the origin farm, and it strengthens the history written by previous genealogist -- I tried to send the information to the tree maintainers and was outright ignored. LLMs fabricating locations apparently beats a listing in the National Heritage List for England of the exact place name, buildings from that time, and in one of the areas the larger english family is known to have been present.

StableAlkyne5 days ago
> Finding it could solidify the established line theory and finally debunk a small ancestor fraction's alternate theory.

I think this post is missing a lot of context and background. I haven't the foggiest what an "established line theory" is

apaprocki6 days ago
Current models are amazing at one shot decoding hand written vital records. I thought there might be some friction, but if there is, I haven’t found any. I’ve unlocked lots of detail from records I already had just because I didn’t try to translate the handwriting due to the time required.
elevation5 days ago
> AI [...] catching mistakes

Make sure you document why/how you determined that a previous research conclusion was a mistake -- generations after you may discover additional information and should be able to weigh the same evidence rather than simply accept (or reject) your novel conclusions.

vintermann6 days ago
I'm very interested in this topic. I have been using AI for genealogy, but not in ways that have been able to push family history back or catch mistakes (yet).

So how do you use the models more specifically? I have so far used them to write a - in some ways - better genealogy program, with some features I've sorely missed especially with respect to DNA genealogy. I've also tried to use them to help with the tedium of transcribing horrible handwriting, but the results have been so poor and with such a high level of hallucinations that I've not tried that for a while.

thomasfromcdnjs6 days ago
A couple ideas (that I have used with success);

- ask it to generate Lean 4 proofs based off centimorgans

- extract subject, object, subjects from all source texts and create a graph database (maybe someone mentioned a red dog in their oral history, and someone else mentioned a sick dog in a eulogy, ask ai to explore weakly correlated connections, sometimes pays off)

grey-area6 days ago
Maybe they’re just more tolerant of hallucinations that you are.
dr_dshiv6 days ago
FWIW, I have tried my best to make the 10s of thousands of books on https://SourceLibrary.org ergonomic for both agents and people. All feedback welcome.

To date, it is the largest collection of agent-accessible translations on the web. The mcp pulls texts and illustrations — and the API provides access to the embeddings. It’s free.

We are based at the Embassy of the Free Mind in Amsterdam, a UNESCO-recognized library of alchemy, magic and mysticism (among other related topics)

And, it’s worth saying, I’m very much inspired by Res Obscura’s line of curiosity-driven humanist inquiry…

Dive into some historical mysteries, there are so many!

yannis6 days ago
Absolutely fascinated by it, both the contents, as well as getting the UI right. Getting the OCR right is also a major achievement. Is there a write-up somewhere on the technical aspects of the work? I have tried using llms for some 19th century books (in Greek) with limited success.
stillpointlab5 days ago
This is a brilliant idea and I've had the idea for gathering the worlds spiritual texts in a similar fashion.

One question I would have, why not put the extracted English txt contents onto github or some other repository? The API and MCP are definitely awesome features, but providing an LLM ready repository seems like it would be very useful as well. Your service then still serves the purpose for original scans/images/illustrations but the bulk of the content is then immediately searchable by an agent locally using the standard cli tools (grep/rg, etc).

mastry6 days ago
This is an amazing collection. Thank you.
whythismatters6 days ago
Great post, thank you! So, let's resolve ancient Near East chronology and determine an absolute date for the sack of Babylon?
z_rho_one6 days ago
Great use case of AI. Almost 4 years after the sensational release of GPT3.5, the best use case of AI is still being a powerful search engine that can gather information from all corners of the digital world.
riazrizvi6 days ago
This is a strong application of LLMs IMO. They are idea machines. Historical ways of thinking give us different paths to explore the world through.
ricksunny6 days ago
One of my favorite LLM use-cases is alternate history extrapolation. Since there’s no formal ‘right’ to a counterfactual, then it can’t be ‘wrong’, and it pretty much always clies me into other events of relevance that are hinge points on my history bead of interest.

Read the full thread on Hacker News →

Related stories