17 comments
An analogy: most shooting deaths don't happen in gun manufacturers' facilities.
Why is that? These models without guardrails are only accessible from within, and seemingly they let any person regardless of experience/skill/knowledge to fire up their own security testing with these models that don't have guardrails.
Until they either get people who know how to isolate things (basically Linux people), or release models without guardrails, I think for-profit companies will continue being the ones that "accidentally" (not really) hacks other companies.
it may not land for you, but hopefully itll land for others. im just fucking tired and trying to do what i can out here.
i am interested in your suggestion to argue harder for what I feel we have lost. any ideas around that youd like to share?
There’s a more nuanced discussion to be had about AI when it comes to potential and existing benefits, open source, the geopolitical dynamics, self-hosting, the financial dynamics, the sanctity of human thought, a future of even more personalised advertising and so on. We do need to elevate the discourse around AI and shift the public narratives around what US frontier labs are pushing, understanding their biases but also acknowledging substantive claims, potential benefits and risks.
I won't get into how "fear of AI" is basically baloney and a manifestation of something else.
Let's just talk about "Stop AI companies". Let's take it literally and assume you were able to stop AI companies, what then? You think the government will stop developing AI? Heck if anything, all the core researchers will be instituted under government black projects.
Or let's take it to mean stop addiction to social media. Every single person makes choices in their lives, maybe it's time to actually start responsibility? Social media ban? It's crazy how people only seem to think about "living", every human has another jolly old state, called being dead as a rock, maybe it's time to let that do it's thing instead of forcing one onto everyone.
But its core assertion is that AI companies intend to lock down control of LLMs through market forces, legislation, and cronyism, to ensure humans can only use them through the AI company walled garden. They want to control the tech, not permit the people to use it freely.
The goal is to stop the walled garden from forming, not to stop LLMs. Yes governments and good humans and bad humans will all use LLMs and cause harm, but LLMs are out and can't be undone. That's another topic, people argue endlessly over that topic already. im not weighing in there with this essay.
This essay says "hey, these companies are literally refining a product that is rental replacement versions of your job, and greedy ass business owners are definitely going to pay rent instead of pay you."
that should be terrifying to ALL of us. Its just software engineers being hit first, but that is because software is easily verifiable (verifiability being a significant requirement for today's LLMs to succeed).
regarding addiction, the government steps in to create laws around addictive substances, but it takes a LONG time for that to happen. ever heard of "gas station drugs"? the government cant keep up. social media companies have fucked us all over by deliberately refining their products for addiction (they call it engagement), and they're just now being tried for some of the harm. 10 years later.
AI is coming so fucking fast that our already weak and barely competent policy makers have no hope of keeping up. AI slop applies to policy too.
There should be fucking alarm bells ringing everywhere. regulatory capture and cronyism at AI speed is a new fucking threat to humanity, and were all just like ok with it? were arguing about tractors and how people have the right to make their own choices?
if my essay was too soft that is my fault. im a new writer and i failed to communicate my thesis well.
but the message i meant to portray is that AI wont kill people, but fucking AI companies will destroy humanity so they can get paid, and they have a unique and new tool that we as a species barely understand, and cannot defend against, and theyre charging the giant fucking deathstar up right the fuck now and pointing it directly at each and every one of us, and no one seems to give a shit.
> and they have a unique and new tool that we as a species barely understand, and cannot defend against,
There's a causal link here, we cannot defend against something we don't understand, in this case more understanding and more open AI translate directly to better defenses.
> and no one seems to give a shit.
This is our problem and solving it involves a lot of politics, which, at this time, is an area where the good guys are in a seriously disadvantaged position, certainly a harsh test for those who engage in it.
Read the full thread on Hacker News →
Related stories
- The Verge · 0 points · 2 days ago
- Can you forget how you feel about Meta?theverge.comThe Verge · 0 points · 9 days ago
- The Verge · 0 points · 4 days ago
- Can John Ternus find Apple’s next big thing?theverge.comThe Verge · 0 points · 9 days ago
- Hacker News · 73 points · 9 days ago
- The Verge · 0 points · 11 days ago