236 points•rakel_rakel•11 days ago•278 comments•

278 comments

davidee11 days ago
Tech has always been breaking social contracts. It’s how we roll. We did the same thing with taxis and travel accommodations to name a few.

We hid our “we know better” hubris under the term “disruption” because the reality (breaking everything) was a little too unsettling for us.

We ignore laws and regulations where we know better of course. Don’t you love having a homey place to stay while travelling that has just a few weird rules, a small to-do list and stays spotless thanks to that cleaning fee?

And look at all the good we did! A whole new world of slaves (oops gig workers - sorry!)

And of course we’re doing it again with information and content. We should be in charge of monetizing all your work because you’re not responsible enough to do it right. It furthers our need for power and control. Oops we meant to help make the world a better place (We keep doing that, sorry.)

dofm11 days ago
> Tech has always been breaking social contracts. It’s how we roll. We did the same thing with taxis and travel accommodations to name a few.

It is not how I roll and it never has been. I don't and won't make things that are responsible for putting people out of work; I make things that make their jobs less shit. I won't make choices that make things more dangerous or less ethical.

This is a choice you can make. Beware of sitting back and saying "we" when you could be in a position to say "you".

It's possible to do no deliberate evil, to avoid using euphemisms for firing people, to avoid fire-at-will culture. It's also possible to fight against major ethics lapses and immorality.

At the best — highest-paying, most dynamic, most fun — job I ever did, I probably did more good in the relevant industry in one afternoon by writing down my concerns, printing a resignation letter, making both my employer and their client aware it existed and offering to sign it, than I've ever managed since. (You can maybe only do this once per working lifetime; use it wisely)

Even the project I worked on that I was sure would put dozens of identifiable people out of work didn't, because we found a way they could use the product to continue their original tasks until their existing contracts expired/they moved on/they retired and their team could be scaled down through gentle non-replacement.

One of the earliest things I was taught about system design is that sometimes even jobs that appear to an outsider to be noisy, exhausting or miserable give people purpose and meaning; you have to look people in the eye when you talk about things that could eliminate their job role. You don't replace a job that doesn't need replacing. And you have to look at the things they do with care and duty and make sure your systems do the same.

If you come from a corporate culture that treats this as anathema, you should work to change it or quit.

Forgeties7911 days ago
It’s possible yet many simply don’t do it. How many rounds of mass, unnecessary tech layoffs do we need to see? We literally just went through a phase of companies scrambling to bring people back because they were too eager to lay them off for AI promises.

Silicon Valley excels at two things: building moats and firing people.

bojan11 days ago
Somewhere at the very beginning of my career, the second year I think, I was part of the team that visited a location of the company we were selling our SaaS solution to, in a branch that was back then still dependent on Excel sheets.

The owner of the company lead us to a large open office with about 30 people working in there, mostly women, and whispered to us that he expects he'll only need three of them after subscribing to our product.

That's when I realised the brutality of what we are doing, and the sales guy I was with realised we should be charging significantly more.

StilesCrisis11 days ago
As much as it would suck to be one of the 27 unemployed, I don't think the answer is to throw away our calculators and start doing our bookkeeping by hand again. I don't think you need to feel too bad about this. The accountants didn't all disappear when Excel showed up; they just got to work on the more interesting parts of the job, instead of rectifying arithmetic.
_DeadFred_10 days ago
I once built a product that optimized waste. I was so proud of myself, it was going to save so much money. Did a site visit to a beta site and was talking to staff. One woman asked me if I knew what happened to that waste. I answered no. She told me it was bagged up and sent to third world countries where it saved lives. That is how I killed people to save money. Yes, if you are dependent on that waste it is very precarious. Doesn't change the reality for the people who it no longer went to save. I don't know the lesson to take from it. Still haunts me. Saving the money kept services in underserved communities in the US and touched tens of thousands of lives. But it also cost lives. The road to hell is paved with good intentions.
limagnolia10 days ago
And you didn't say "cool, after they are no longer needed for this task, what other exciting oppurtunities will you be able to employ them pursuing that will grow your company?"
matsemann11 days ago
Yeah, small city I grew up in there are no longer taxis. Used to be a semi full time position for 1-2 people, so any night you could get a taxi if you arrived by train or needed to get home from somewhere. Most nights operated of course on a loss, but made up for on the volume during some weekends or periods of the year (like winter holidays). But then when the taxi monopoly broke down, more people started to compete on the lucrative weekends. Good in the start, quicker to get a cab and price decreased. But then the original cab drivers couldn't sustain the new lower income, and got other jobs. No one wants to be up night to Wednesday for perhaps two trips, so now it's impossible to hail a cab most days.

And the relevance here is how this disruption played out. Will the same happen to open source? See it already for instance in how AI makes some maintainers burn out. Where will it lead?

mitxela10 days ago
Is that actually a bad thing if ty can still get a ride on an app on any Wednesday?
andsoitis11 days ago
> Tech has always been breaking social contracts. It’s how we roll. We did the same thing with taxis and travel accommodations to name a few.

"We"?

warkdarrior10 days ago
Yes, we in tech. Even going back decades, email technology was a huge disruptor. Professionals used to have secretaries to type up letters/memos for them. All those secretary roles are now gone.
Tadpole918110 days ago
I'm not going to deny the starting premise (tech breaks things, sometimes laws), but I don't think your follow-up is fair (we are responsible for all negatives).

Why is it our fault that governments have completely abdicated their responsibilities? Why is it our fault that everyday people literally refuse to become politically or economically literate and/or vote?

Tech has given the world, for essentially free, the entire wealth of human knowledge at their fingertips. We've given them ways to learn and communicate. We've overhauled transportation and logistics and payment. Fairly soon (decades), human labor may be obsoleted and who knows what good that may bring us.

And, yes, we also gave them mass surveillance and gig economies and hyper-addictive systems. Just like engineers gave us guns and chemists gave us poison and physists gave us nuclear bombs and doctors gave us lobotomies.

They had quite literally decades to recognize the threat. We screamed the dangers from the rooftops and in congressional hearings. We told people social media is poison. Betting sites are poison. You are the product. Watch out for market capture. You need to legislate us.

Normal folk called us crazy nerds and basically told us where to shove our concerns. But now it's our fault, naturally. We didn't do enough. We didn't perceive all possible outcomes, assume the world would be negligent, and refuse to make things we thought would be helpful - as if someone else wouldn't have thought of such Einstein breakthoughs as "socialize online" or "couch jumping online" or "taxis.. online".

And just to be clear, I'm speaking collectively just because you are. I make very boring stuff that is well within the confines of the law and only serves to help people.

grumbel11 days ago
I really don't get those takes. AI is the best thing that ever happened to the Free Software world, it is basically turning any software into Free Software. You can just throw file formats, protocols or even plain binaries at the AI and it'll reverse engineer everything in a pinch. Users can finally modify software themselves, which was always the goal of the Free Software world, but very rarely happened in actuality, since it was just so damn complicated. AI lowered the barrier of entry tremendously, not just in terms of required knowledge, but especially time. Same with Creative Commons, sharing art and stuff, was a nice gesture, but rarely useful, since the level of work to modify a work to fit your project was pretty close to just doing it from scratch anyway. With AI everybody can toy around with image generators and get what they want.

Is a social contract being broken? Yeah, kind of, but the problems that that contract existed to solve are no longer a thing. Creation is now easy and commodified. We finally have computer we can interact with in natural language, something people tried to do for at least 70 years and never made any significant progress on until LLM arrived.

If you want to gatekeep or only create stuff to boost your own ego or portfolio, then AI might be an issue, if you actually want to build stuff, AI is godsend. We are essentially living in the StarTrek future with Holodecks and replicators and people still find reason to complain.

geraneum11 days ago
The reality is that no one was gatekeeping you or anyone else from doing whatever you wanted with free software. The barriers were knowledge, understanding, expertise, and hard work, none of which AI fixes for you. The premise here is that you can accomplish what you couldn’t before without actually understanding the concepts or putting in the same effort. _There is undeniably utility in that_, but I don’t see any strong argument for why it is beneficial to free software in general. It's not even clear whether it has been a net positive or negative so far, though it is undeniably a win for the corpos.

Relieving yourself of thinking and effort, whether through a machine or another human, is not the liberating force you think it is, especially when that effort isn't just grunt work, but the very process that helps you develop and grow.

genghisjahn10 days ago
I’m not sure why the lights come on when I flip the switch. I can hand wave and say “electricity” but I suspect there’s more to it.
itsalwaysgood10 days ago
The reality is same for your angle: nothing is gatekeeping or stopping anyone from developing the craft the old way, and keeping 'thinking' so strong. Perhaps there are other ways to strengthen thinking, though?

The sole issue here is compensation. The answer is an uncomfortable one, or one with a lot more regulation that can't be enforced on a global level.

Oversimplifying to see if there's anything worth examining...but imagine: subscriptions to organizations whose sole purpose is to train AI. They're compensated as the AI service is consumed by the public. The public pays a tax to finance AI growth, and the tax is divided to the organizations, to pay out to members. Members are incentivized to 'keep the craft alive' and train incoming members.

Since that is a huge change and I'm talking out of my ass, I'll point out something more realistic: we'll probably just write up some more red tape and hope for the best on the global stage.

It's a complex topic for sure.

teaearlgraycold10 days ago
New layer of abstraction. Someone needs to understand how to build that old C library and reprogram that embedded controller, but it doesn't need to be me. Give someone infinite possibilities. Tell them they can have any software change they want. Everyone will have some good ideas. Some people will be head and shoulders above the rest. Being able to do anything (not that LLMs exactly deliver on that goal) doesn't mean you'll do something interesting. It doesn't mean you'll invent a product worth paying for, or impress many people, or make anyone particularly happy or inspired.
grumbel10 days ago
> The barriers were knowledge, understanding, expertise, and hard work, none of which AI fixes for you.

The biggest barrier was time, there are only 24 hours in the day and no amount of hard work or knowledge is going to change that. There are just some fundamental limits of what you can accomplish as a single person in that time. And good luck trying to find contributors who want to work for free, when they already are busy with their own projects.

AI just fundamentally turns that around and gives you a whole bunch of extremely capable co-workers that you can let deal with all the problems you do not want to waste your time on and they let you focus on the stuff that actually matters to you.

r053bud11 days ago
None of your arguments hold any water if big-corpo AI restricts open-weight models - which they very clearly want to do. AI is NOT “the best thing that ever happened to the Free Software world” if our only option is to pay a select few companies to use it.
roenxi11 days ago
Those arguments are independent of the state of OSS models. There appears to be no moat whatsoever on creating state of the art models commercially - the US threw the kitchen sink at China in terms of sanctions and barriers ... yet it has been unable to keep Chinese companies away from the frontier (arguably ahead in small local models with Qwen). Even if all the models were proprietary we'd expect the costs and capabilities to be widely available. The Europeans might even be able to field their own advanced models eventually.

OSS models are strategically important, but that is a different matter to getting value out of them for OSS software development.

TeMPOraL10 days ago
Big corporations can't do shit about open-weight models that already exist, because those are... just bags of floats. Once released, there is no unreleasing them. The Internet never forgets.

Download the files as they come out if you're worried, but there's no way to roll LLMs back beyond what we have in open-weight models right now. It's a ratchet.

LogicFailsMe10 days ago
Big entertainment has been trying to restrict the distribution of movies online since that became possible, how's that going for them?
SuperV123411 days ago
We have open-source models, and they're getting better and better.
leoc10 days ago
It also seems pretty reasonable to worry that Oracle isn't banning LLM code contributions to OpenJDK https://www.theregister.com/ai-and-ml/2026/08/03/as-larry-el... ( HN discussion at https://news.ycombinator.com/item?id=49213754 ) purely on quality grounds. If things carry on as at present, and it turns out that indeed it really was legally safe to copy and paste almost any code that came out of an LLM, then that's one thing; but if instead there's a rash of code copyright (and indeed patent) lawsuits a few years from now then the big and middling companies will simply pay each other settlements, while FOSS projects and their small-fry users will likely be in a much worse situation.
rpdillon11 days ago
> If you want to gatekeep or only create stuff to boost your own ego or portfolio, then AI might be an issue, if you actually want to build stuff, AI is godsend.

Exactly this. I've been very confused by the free software advocates that seemed to hate AI until I realized their reasons for releasing software under an open source license were very different than what I assumed they were.

wiz21c11 days ago
I release my code as free software for two reasons:

1. The credits for my code are protected (with the GPL you have to tell where your code originates from). That's the ego part. It's important to me because I'm not paid for my software. So credits are an important reward.

2. I want people to think twice about reusing my code. I use the GPL license because I think sharing software is the ultimate goal. So I force people to share my software by using the GPL. That may sound "extreme" (that's the whole open source vs free software debate) but, not being a full time politician, I can't change laws to push society in the direction I want. At my level, that "push" is the GPL choice. Maybe it's not noble enough, maybe it's cowardice, but it's my way (compare that with those who simply don't care).

AI severely weakens both of these. And for people like me, this forces us to reconsider our position. For my part, I accept the legal point of view that A.I. doesn't steal code, and just reproduces the ideas in the code. So, as far as ideas can flow in society, I'm OK with that (that's the principle behind copyright laws).

If AI has its way, one day one will not need to write software, we'll just ask the AI. In that case, software will be dead and free software will die with it too. By then I'll do my "local politics" another way and follow the next RMS.

intended10 days ago
Drive by code dumps from people who have "democratized Natural Language code" which pushes all the work of verifying whether it works on the few active maintainers is hell.

Any collective group with open contribution will end up hating it. Why is this a surprise?

za_creature11 days ago
While Stallman may have been originally upset about his printer, the primary motivation behind open source software is:

Nothing up my sleeve.

This of course requires audit and that requires that the code is written for human consumption, otherwise nobody will bother. Sure you can vibe a printer driver but how sure are you that your LLM didn't include a backdoor in the millions line of slop?

matsemann11 days ago
Exactly not this. Way to straw man all counter arguments before they even got any.
killerstorm11 days ago
I'd say this social contract which got "broken" never existed in the first place.

Even before AI we heard lots of complaints like "I made a popular open source library which is now used by corps with trillion-dollar market cap and I don't get anything out of it; halp". There was always some kind of a conflict, now the nature of the conflict just changed

Forgeties7911 days ago
If by “nature“ you mean the scale, which has expanded by orders of magnitude and functionally changes the problem.
mitxela10 days ago
If they made it MIT, they explicitly disavowed the GPL social contract.
mosura11 days ago
> If you want to gatekeep or only create stuff to boost your own ego or portfolio, then AI might be an issue

One of the major cultural problems in open source software is it got dominated by people doing it purely for self promotion. Then it becomes an interview question, then all the incentives are warped on the promise of “get PRs merged, get paid big money”.

But yes, you are right.

mmaunder11 days ago
I'm a cybersecurity 'expert' and my 40 person team and I make our money by providing GPL software to the world that I wrote.

You have the same incentive you had to share your work as before, and that is to get attention, and customers, assuming that's your game. Open code means no vendor lockin for a lot of customers, so they can pay you but also trust you to not extort them. And if you're hit by a bus your product lives on, and someone else can adopt it.

Supply chain risks and vulnerabilities existed before LLMs came along. They're easier to handle now that we have LLMs helping us. In our org the tsunami of updates we need to do weekly is far more easy to handle with LLMs.

Open code has always been easier to find vulns in vs closed. AI didn't change that.

Yeah the slopfest is real, but easier to deal with thanks to agents/LLMs so it kind of offsets itself.

Your licenses are still enforceable in court. Agreed that not being able to reverse the fact that AI trained on your code and is selling that capability kind of sucks. But humans were doing that before AI.

Yeah on the one hand opening your code got you credit which was nice for the ego and for getting paid, and AI trains on it and doesn't give credit where it's due. But on the flip side, we get AI! Which I frikkin love. I feel like a kid in a candy store. It's training on my code too and it's training on my content. And when people ask about what the best product is for our space, the AI tells them its our product. Woohoo!

Regarding the future: We have some really really big problems that need solving - stuff that creates a massive amount of misery in dark stuffy hospital rooms with crying relatives saying goodbye to their 9 year old child. I've been in those spaces and I'd give up the previous generation of open source ethics in a heartbeat to make just an ounce of that misery stop. The training that my code provides AI is a tiny little part of that solution, and I'm proud of that. Whatever I can do to push our capabilities to the point where we can make the major breakthroughs this species needs, I'm happy to provide.

VladVladikoff11 days ago
Hey thanks for WordFence! It made my early days as a programmer a bit less crazy. Having clients constantly installing plugins (backdoors) in their websites was a never ending battle. Don’t really touch Wordpress stuff anymore but it was definitely my favourite plugin back then.
mmaunder10 days ago
Thanks! Still going strong. Weirdly WP is growing. I suspect it's the structure and framework it gives agentic tools to build around.
Forgeties7911 days ago
“Before LLM’s there was_____” I see this whenever an LLM’s impact is assessed. We know. The issue is scale and the ability for smaller and smaller groups (down to individuals) to execute at scale.

LLM’s are pouring massive amount of gasoline on existing issues and people just keep shrugging. Fake news always existed. Now one dude in India can flood multiple sock puppet media accounts with right wing content/images (actual example from a few months back) at a scale previously unimaginable.

People could always die crossing a street. Still, cars changed the discussion about pedestrian safety pretty materially. People didn’t simply throw up their hands and go “people have always been able to die crossing the street.”

NegativeK11 days ago
> The issue is scale

A guest on a podcast said, in response to open source and community websites being flooded with AI scrapers, "the internet has always had people scanning websites; get over it".

I still respect the podcast, but that was such a shitty take. The difference between before and now was that those websites started closing their doors instead of paying the increased hosting feeds.

I'll get over it when we stop giving people a pass for the damage they're doing just because they're a corporation.

watwut11 days ago
> But on the flip side, we get AI

That is kind of net loss at this point. Hey, on the bright side we get onslaught of slop, ai psychosis, constant stream of doom trolling.

And ideology of pointlessness where any time you do or learn anything, you get told that why bother you should have used AI.

The kid forever locked in candy store is happy for a bit, but then they get hungry and feel bad. And no matter how much sugar you eat, it wont get better.

lisplist11 days ago
From an ego perspective, the artisan craft of programming basically being dead at this point makes me sad, having spent so much of my life getting good at it (or at least trying to).

From technological enthusiast perspective - if you can't find an endless stream of uses for this technology, I really don't know what to tell you anymore. I gave credence to AI naysayers for a while, but at this point I feel like its akin to denying gravity exists.

Who are we to gatekeep software development? So many people have gained the ability to interact with computers in ways they never dreamed of before! For me, I've never felt so engaged in software development, even if I'm no longer writing it line by line.

Like you say, there are a lot of negative externalities to this technology, but its something we're going to have to solve rather than dismissing it outright. The industrial revolution caused all sorts of problems! But you can't argue we're worse off because of it.

mmaunder10 days ago
Thing about being in cybersecurity is you get to see outcomes that aren't a matter of debate or taste. For example, if I lock an agent in a jail and tell it to attack something and that the only way to win is to show me a number stored on that target, and it succeeds, then assuming our jail was effective, it's an outcome that isn't debatable. I've lost count of the moments I've had this year where my jaw just drops because I'm holding undeniable proof of a level of expertise I've never seen in humans - and that is far above human capability, in a field where I'm an expert.

So I guess from my perspective, it's not a candy store or candy. It's something that can solve problems we've never before been able to solve. Problems that are too hard for a human.

Another example: Recently one of our agents found a vulnerability so complex, that our team, who are experts in their field, could not understand it and had to ask an agent to write a blog post to explain it to them. It had more steps in the exploit than we've ever seen, and would never have been discovered by a human.

Cybersecurity is a leading indicator of what's to come in other fields. Leading because programming is something models are inherently good at. Doing wetwork in a lab is harder to plug into a model or agent. But it's on the horizon. So we will be seeing these kinds of breakthroughs in other fields, and the leading indicator says they're going to blow our minds.

If you think this stuff is candy, and you're relating it to social media, you're simply not paying attention or getting your hands dirty. And honestly if I wasn't hands-on, every day that passed would make me progressively more scared and more angry as it pulled away from me.

post-it11 days ago
> And ideology of pointlessness where any time you do or learn anything, you get told that why bother you should have used AI.

Who cares? Anyone can tell you anything online.

TeMPOraL11 days ago
100% this.

And frankly, I think most of the source of outrage is this:

> Yeah on the one hand opening your code got you credit which was nice for the ego and for getting paid, and AI trains on it and doesn't give credit where it's due.

Turns out, a lot of people didn't really do things in the open to benefit the others, in pay-it-forward style. They just did it for selfish gains. Which is fine, just like keeping source closed and selling licenses is fine. The problem is with lying - doing something for personal gain, while claiming it's for greater good, thus getting more gains through dishonesty.

LLMs just shone a light onto it. People who had betterment of others on their minds, don't have a reason to consider LLMs training on their output as taking anything from them. On the contrary, their outputs now contribute to a general-purpose problem solving tool that will (and already does) help humanity with way more problems that anyone imagined.

I personally am more than happy to know LLMs may have trained on my content. I don't begrudge the companies the $0.000001/year they probably owe me for my relative contributions. I get orders of magnitude more value for myself from LLMs every day, in my personal life alone.

There are other reasons to dislike LLMs and fear or hate what AI is doing to the world. But people who feel something was "stolen" from them, who now close their blogs and turns repos private because LLMs - they're just showing they had ulterior motives for their work - which again, is fine if they were up-front about it. The OSS subset of those, just paint themselves as being grifters all along.

Marha0110 days ago
> There are other reasons to dislike LLMs and fear or hate what AI is doing to the world. But people who feel something was "stolen" from them, who now close their blogs and turns repos private because LLMs - they're just showing they had ulterior motives for their work - which again, is fine if they were up-front about it.

100% this. Why should I be bothered that some of my work that I released freely to the world is now potentially used by millions of people as a small part of the knowledge in a state of the art AI system? I am honored!

But I guess some people just have different motivations for releasing their code, and require explicit attribution to feel honored enough to make it all worth it for them. Not me, though.

jminnl11 days ago
You have no proof that the world will be a better place because of this stuff but there is plenty of proof already that it will be worse, possibly significantly worse but the jury is still out on that.
milkshakes10 days ago
> Turns out, a lot of people didn't really do things in the open to benefit the others, in pay-it-forward style. They just did it for selfish gains. Which is fine, just like keeping source closed and selling licenses is fine. The problem is with lying - doing something for personal gain, while claiming it's for greater good, thus getting more gains through dishonesty.

> There are other reasons to dislike LLMs and fear or hate what AI is doing to the world. But people who feel something was "stolen" from them, who now close their blogs and turns repos private because LLMs - they're just showing they had ulterior motives for their work - which again, is fine if they were up-front about it. The OSS subset of those, just paint themselves as being grifters all along.

thank you for putting such clear words to a feeling that's been troubling me about this outrage for a long time.

GeoAtreides10 days ago
it's not selfish to want attribution for your work and knowledge, it's an essential human trait
sigmar11 days ago
>If I make my code available, AI can be used to more easily discover vulnerabilities to abuse my coding errors,

Keeping your source code private doesn't save you. These LLMs are really good at decompilation efforts. I've seen an insane number of clean room ports of games the last few weeks (just saw a Zelda 2 PC port this morning). Even with that, I don't share the gloomy perspective of the author.

JoshTriplett11 days ago
Anything done with an LLM is not a "clean room".
TeMPOraL11 days ago
In this sense, anything done with human experts isn't really "clean room" either.
pitched11 days ago
We’re sharing a world with cultures that do not respect or enforce patents. The internet has helped us stay competitive by making information a lot cheaper to share. AI is the same thing but more potent. It will help us stay competitive even longer.

There were some hidden downsides to the internet and they are worse with AI. Upsides are better, and downsides are worse. Still largely the same deal we already accepted though. “Information wants to be free” never said information wasn’t harmful.

Read the full thread on Hacker News →

Related stories