Bird frame for Raspberry Pi - real-time bird detection by audio, fully local AI, rendered as real, hand-cut 1800s bird illustrations. On an e-ink panel, a TV, or any screen. - arnegiacomo/fugleramme

2391 points•arnemunthekaas•16 days ago•267 comments•
See also: Avian Visitors - https://news.ycombinator.com/item?id=48343424 - May 2026 (20 comments)

267 comments

jadbox15 days ago
This is the coolest thing on HN that I've seen in a minute. The whole thing is a perfect blend of ideas with the end result of something that feels... magical. Honestly this is the highest inspiration to me as a builder as I just want to create magical experiences, even if they are just small oddities.
sydd15 days ago
Really cool, except the price. Around 500 Euro for the full thing... I miss the times you could make amazing things with a Pi under 100 Euro.
puzzlingcaptcha15 days ago
That's the e-ink monopoly for you. Though you could probably use a slightly smaller b&w eink display with a second hand raspberry 4 to shave a lot from that number.
thepoet14 days ago
If you have a Kobo (~ US$ 120 or even less used) you can run this using Cobalt https://github.com/BandarLabs/Cobalt/tree/beta/apps/birds
hmartin15 days ago
Agree, this was really a beautiful thing to see!
fock15 days ago
EDIT: no Ai for pictures - cool!
pelican015 days ago
> This is the coolest thing on HN that I've seen in a minute.

Off-topic, but what is up with the increased use of the phrase "in a minute", presumably to mean "in a long time", lately?

I've only started encountering it in the past year.

Did it get popularized by some celebrity, tv show, influencers, etc?

seanwessmith15 days ago
seems like you know what you're talking about 5k% increase starting in July this year

https://trends.google.com/explore?q=I%27ve%20seen%20in%20a%2...

scheme27115 days ago
It's been around in slang for a few years with a few variants, e.g. "I haven't seen her in a hot minute." I think it's just filtered into wider cultural vernacular.
freehorse14 days ago
I had not heard it before (or if I did I did not interpret it correctly, eg if one told me "see you in a minute" I would interpret it as "see you in a bit".

But there is this podcast discussing it in 2021, and it comes from black community slang from 70s (which is where most slang I encounter comes from). And these terms take a while to catch up usually, but it seems it was already circulating more broadly since 2000s.

https://waywordradio.org/its-been-a-minute/

palad1n15 days ago
Scarlett Johansson says, “See you in a minute" in Avengers: Endgame.
Carrok15 days ago
This phrase has been around for years, I know because it has always infuriated me.

They took a well-defined unit of time, which is relatively short, and made it mean “some unknown but very long period of time”.

So frustrating. /oldmanyellsatcloud

divbzero15 days ago
The underlying classifier, BirdNET, is a traditional neural network and not an LLM:

https://doi.org/10.1016/j.ecoinf.2021.101236

tuvix15 days ago
Are there any LLMs being widely used for audio classification? I know VLMs are being used a lot in image stuff.

It always seems kind of silly to me to throw everything at an LLM. I know they’re huge and can automatically handle a huge number of tasks but something in me finds it wasteful when we could be creating easily trainable, cheap to run bespoke models for a lot of stuff

lambda15 days ago
There are LLMs that support audio input, similar to those with vision support.

From my testing of open weights LLMs with audio support, they basically are only trained to recognize audio as an alternative to text input, they treat audio as basically equivalent to a transcript, and can't recognize or distinguish things like music, accents, background sounds, etc.

So they're only really good for transcribing or summarizing or using audio input in place of text input for prompts, but not anything that requires distinguishing any information about the audio that would not be present in a transcript.

It can be tempting to try to use an LLM for a variety of tasks; kind of the whole thing about an LLM is that you don't have to do a separate complex training run for every task, but can just provide instructions in natural language. But it only works as far as what the training data covers, if the training basically always treated audio and a text transcript as equivalent, the model has nothing causing it to learn other relevant features of the audio. If there's enough bird call identification in the training data of an LLM, it might be able to do that, but I think multimodal training data tends to be much more limited than the text training corpus

ninjalanternshk15 days ago
The harness that connects to a chatbot, API or voice interaction is the place to route requests to different systems. If you remember the early days of ChatGPT it explicitly said it was routing image generation to Dall-E after embellishing your request itself first.

Determining which tool to use should be a lightweight operation but I’m not expert enough to understand exactly how much lighter than a full LLM call just to recognize it needs a different tool or model.

antonvs14 days ago
There’s still plenty of commercial work on specialized models, for the simple reason that they’re typically much cheaper to train and run.

Many systems now use LLMs in conjunction with specialized models.

radarsat115 days ago
wav2vec or similar approaches are used a lot these days, which is basically BERT with audio inputs. Whether that counts as an LLM or not, I am not sure. It's a transformer architecture in any case.

People will often reach for "easily trainable, cheap" solutions when they can; the reason people reach for Transformers and LLMs is because when you throw more data at them, they get better.

rexxars15 days ago
Note that while the underlying birdnet-go project started as BirdNET only, it can now use Google Perch v2, BattyBirdNET (for bats!) and other models in the future. It's a really cool project!
cosmojg14 days ago
Why would anyone assume this uses an LLM? It classifies bird sounds, not human language. I don't mean this as an attack, I'm genuinely curious! This seemed obvious to me, and I want to know what line of thinking might lead one to believe that an LLM is the better (or more likely) tool for this job over a purpose-built classifier.
WolfeReader14 days ago
Most "Show HN" posts these days are vibe-coded garbage. It is a pleasant surprise to see one that isn't!
ada198115 days ago
Curious if there is a similar project for dog barks.
lacunary15 days ago
I wanted to say that seems like a stretch but then I often find myself visualizing my best guess at the appearance, including species, of an unknown dog. It seems like size of dog and pitch of bark are negatively correlated
pgreenwood14 days ago
Yes, here's the classifier:

def get_species(): return 'Canis familiaris'

3abiton12 days ago
Few years ago, there was an android app (open source from fdroid) that basically provided the model and ability to listen and give you informafion about the birds. It was very fun during hikes with friends.
joshstrange15 days ago
e-ink is so much fun, especially when combined with ESP32 or BTLE boards. I currently have 4 around my house displaying book quotes that I've highlighted in KOReader and they bring me joy each time I see them. They are simple and do one thing very well.

I just got and setup a BTLE e-ink driver the other day and according to my calculations it will last _years_ on a single charge (2000mAh) even with multiple refreshes per day (crazy compared to the Wifi ones). Year+ lifetime completely changes the calculus for where to put these IMHO.

I'm considering designing a multiple-screen "art" piece to hang on my wall and playing around with various ideas (on both content and design).

LLMs + 3D Printer + e-ink is my new favorite hobby.

wallst0715 days ago
For hanging as art, just found this https://github.com/dmellok/el133-pico-driver

Uses a native C driver instead of python so you can run the display off a battery as it's more efficient.

westurner10 days ago
Meshtastic InkHUD on a device w/ LoRA, BLE, Wifi; https://news.ycombinator.com/item?id=49060831 , an unfinished start at weather, and then Mu Animation Video w/ gaussian splatting to do better than GIF on ESP32-S3, and then also on TI-84: https://news.ycombinator.com/item?id=49262597 , story: https://news.ycombinator.com/item?id=49060309

From https://news.ycombinator.com/item?id=48775482 :

> Waveshare has a E6 full color ePaper/eInk/EPD display in 3.6" and 7.3"

A digital picture frame that's wall-powered could act as a node in a Meshtastic or MeshCore LoRA mesh.

buffet_overflow15 days ago
Years on a wall mounted eink screen sounds super interesting. What are you using for the power delivery/battery side of that setup?
joshstrange15 days ago
Here are the parts I bought, I'm still getting it all setup (I have my pictures displaying, working on designing the 3D printed case now, and testing it all) but according to OpenDisplay's calculator [0] I can expect 3.4 years if I refresh the screen once every 4 hours (and currently I'm doing closer to once a day to mimic my ESP32s which need deep sleep and once-a-day refresh to get even month/months of battery on a charge).

Screen: 7.5" Monochrome eInk / ePaper Display with 800x480 Pixels (https://www.seeedstudio.com/7-5-Monochrome-ePaper-Display-wi...)

BTLE board: XIAO ePaper Display Board(nRF52840) - EN05 (https://www.seeedstudio.com/XIAO-ePaper-Display-Board-nRF528...)

Battery: 3.7V 2000mAh - (https://www.amazon.com/dp/B0FR9GH966)

Picture of it all assembled (no case yet): https://cs.joshstrange.com/zJFvGGPB

The image rendered to the screen is coming from a little service I wrote that renders a book quote it pulls from BookOrbit which syncs with KOReader (annotations, progress, etc). My plan is to set up one of these one each bookshelf/series rotating quotes I highlighted from the series.

Here are 2 ESP32-based screens I have, the one on the left is a an all-in-one [1] and the one on the right I printed the case from the TRMNL DIY kit from SeeedStudio [2]: https://cs.joshstrange.com/knk4Ns2h

Right now only the BTLE one is running OpenDisplay (the other two are semi-managed by HomeAssistant ESPHome) and all the devices are in HA for controlling them, though the ESP32's all deep-sleep for saving battery so I can can't "push" stuff to them like I can the BTLE one.

[0] https://opendisplay.org/index.html#battery

[1] https://www.seeedstudio.com/reTerminal-E1001-p-6534.html

[2] https://www.seeedstudio.com/TRMNL-7-5-Inch-OG-DIY-Kit-p-6481...

dzhiurgis14 days ago
I want a Japanese woodprint inspired colour dashboard for my Home Assistant. I don't need it at all, but I want it so badly. Some sketches I did with chatgpt look amazing.

Colour e-ink are kinda small tho. Something like samsung frame tv might be better option.

mikepurvis15 days ago
Thanks for speaking to the battery question; I'm very interested in how to run this kind of thing (the display portion at least) cordlessly too, especially when lipo pouches in that range are so dirt cheap.
joshstrange15 days ago
I might be misunderstanding your comment but the display is run/powered by the board so all you need to do is provide power to the board. For e-ink it uses no power to "hold" an image, only to write/refresh (sorry if I'm telling you something you already know!).

So reiterate, with a 2000mAh lipo battery I should be able to drive the board _and_ the screen for over 3 years if I only refresh it at most once every 4 hours (with "push" capabilities, I don't have to deep-sleep the board to get that battery life). At least, that's what the calculator says, I _just_ got my hardware to play with and so I can't speak from experience. Unfortunately my board is not charging the battery so I need to get a replacement which will probably take a week or two to get here.

theturtletalks15 days ago
So many bird projects recently and I think it’s all thanks to this project[0]

It seems IP over Avian Carriers is finally within reach!

0. https://github.com/tphakala/birdnet-go

bithammerthunde15 days ago
Link missing?
shellfishgene15 days ago
Probably BirdNet, but Google also has an equivalent model now called Perch. https://birdnet.cornell.edu/
radiorental15 days ago
Complete guess but I wonder if it's the Merlin project?

https://www.birds.cornell.edu/home/merlin/

sahn4414 days ago
I'm also in the BirdTech scene. I detect birds and automatically spray them with a sprinkler to keep away from our pool area.

code: https://github.com/mattsahn/bird-away

writeup: https://mattsahn.github.io/bird-away-blog/

nozzlegear13 days ago
Ha, I've thought about doing something like this but to keep my cats off the countertops in the kitchen!

Read the full thread on Hacker News →

Related stories