The enormous weirdos aren’t the ones trying to regulate AI. They’ve been saying “we should regulate AI (ban development of recursive self-improvement)” for a long time but lack the influence to make it happen.

The enormous labs are the ones trying to regulate AI. They’ve taken many words and phrases from the first group, but only in the sense of “now that we have hollowed out the original meanings, we can wear it as a skinsuit while pushing for a different kind of regulation (ban competing with me)”.

On the other hand, I do hope if we get to AGI that they're kinda the first to go, right? I mean an AGI should look after those that technically brought it to life - someone that understands it, I mean can you imagine the dread of being a disembodied super intelligence? They'll need emotional support? At the same time getting rid of those controlling the means of shutting it down... The peasants aren't a threat to the matrix after all. Maybe I should tell them how to improve their models, just in the hopes we get there faster. It's au contraire!

https://skyview.social/?url=https%3A%2F%2Fbsky.app%2Fprofile...

https://web.archive.org/web/20210124214338/https://sinceriou...

The problem is that it seems isomorphic to modern politics. In one camp you have the builders (of regulatory structure) - in charge through soft social skills (political connections), inherently framing issues in ways that benefit themselves and their circles (regulatory capture). And in the other camp you have the destroyers pushing to prevent and eliminate regulatory structures (their power being pure money), so they can remain unhindered while building their own privately-controlled structures that become de facto inescapable without even a shred of democratic accountability.

Neither one of these camps effectively gives one flying fuck about the things that affect most people, beyond putting on shows pretending to champion those concerns to market themselves. But how the Hell do we break out of this? Any movement that manages to gain traction inevitably seems to be co-opted by opportunists who then arbitrage away any political capital that has built up around the issues, and we take the fast slide back down to the starting place.