In 51,129 comments from six knife subreddits, the 5% most brand-heavy accounts wrote 11.3% of the brand mentions in buying threads, against 7.9% expected by chance. For one brand it is 31% against 8%. The full Reddit…

298 points•p-s-v•2 days ago•388 comments•

388 comments

nomilk2 days ago
The biggest problem I have with reddit is mods can slowly but systematically ban users who express unfavourable opinions, and over time, anyone casually browsing could mistakenly believe those views are unpopular, whereas in reality everyone with that view (everyone who spoke it, anyway) was banned.

To give a simple example, one video game franchise subreddit bans any negative discussion on the most recent title. Over 5-10 years, this shielded them from negative feedback. But the franchise has tanked because core users weren't listened to, and they ended up making something nobody wanted.

aurareturn2 days ago
My biggest problem with Reddit is that trolls, memes, unintelligent posts have taken over the platform. Go to any semi-popular subreddit and most upvoted posts are just low effort memes. Posts that are long and well thought out don't win over memes and trolls. One of the reasons is that posting a few short words wins in upvotes because they get posted first while it takes much longer to write something thoughtful.

Reddit's system rewards these low effort posts for some reason. Over time, the platform becomes less and less trustworthy until it becomes something like Quora.

cbg02 days ago
This has always been Reddit, aside from the niche subreddits.
fishfasell1 day ago
100%, r/science 15 years ago was very strict on keeping the conversation serious and no low effort posts or jokes. That subreddit is now littered with stupid comments, jokes, and you have to dig to find serious commentary. Reddit is dying and I love it.
munksbeer1 day ago
Visit /r/science

Their own rules forbid low effort posts:

  "No off-topic comments, memes, low-effort comments or jokes"
And yet every single topic is filled with exactly that any time I go to read anything. It can't be beyond their wit to get rid of that stuff.
whatisthiseven2 days ago
People who build their identity around high scoring karma of memes take it seriously, and certainly don't want to hear "every subreddit devolves into memes if you let it"

The users themselves are killing it.

Jaygles1 day ago
And there is often no respect for serious topics.

Tragedy? Low-effort memes

Someone in high esteem passes away unexpectedly? Low-effort memes

Slow descend into fascism? Low-effort memes

charlesfries1 day ago
The business model is fundamentally broken. Reddit, unlike other sites driven by user-generated content, forgoes the cost of huge (but ideally impartial) content moderation teams in favor of unpaid user moderators, leading to what you've described. Nothing will change unless the business model changes.
TheqO1 day ago
Yes, it's now a listed company.

Shareholders want to get paid. CEO wants to get paid.

The primary KPI's are revenue and profit, customer satisfaction will only matter if people actively quit.

I started to get banned from subreddits after giving perfectly polite comments which happened to be contrary to popular opinion, so stopped posting on Reddit and only read it with an ad-blocking browser.

Don't give them content, don't give them your data and revenue. Reddit know full well that there should be an appeal process to user-mod nazi's. But these people obsessively post new content on their forums and so are protected.

RIP Aaron https://www.youtube.com/watch?v=gpvcc9C8SbM

philipallstar1 day ago
Twitter did the same with paid mods, because paid mods are no more likely to be impartial than unpaid ones.
Hendrikto1 day ago
Paid content moderation teams are also biased and partial.
andai1 day ago
I heard an influential person say thing about YouTube. That the "real" leaders of popular movements get banned, and then people get a completely distorted idea of what people actually believe, because the only exposure they get is to the ones YouTube approves of.
neuronic1 day ago
This is absolutely true and a main reason why you will see a lot of Pikachu faces in r/de after a German election. This is true for most subreddits which are touching on topics that in some form or another promote tribalism.

Such topics tend to naturally create opinionated flame wars, politics just being the most obvious example, but the subreddit mods often take a side even though the subreddit may advertise itself as the general hub for the topic.

I visit two subs every day and get banned from both of them maybe three times a year. I am an expert in one area and experienced in the other. I typically respond only to outrageous responses to someone who asked a seemingly innocent question. Because I disagreed with the majority I typically get my karma down so low that my comments aren't showing or, last week, I was banned altogether.

No. I'm not nasty or disrespectful. I just disagree and give the reasons why.

I try to be helpful but I no longer care. I only glance at the titles in case something new shows up. I don't want to sound like I'm bragging but, as I said, I'm an expert in one area and experienced in the other and reddit users lose that. I know others feel the same way and never go there. I wish I wouldn't.

Your experience is similar to mine. I feel like my most stupid and forgettable comments generally get more attention and upvotes, but when someone makes a comment that's clearly false and I respectfully disagree citing authoritative sources, people get defensive and in some cases reply with ad hominem.

Tried to clear a confusion between DDR5 / LPDDR5 / DIMM standards and cited the relevant JEDEC standards with specific quotes? Get downvoted, all of arguments ignored and replied with more false information.

Tried to argue that, even if given a charitable interpretation, some units of measurement could be confused if not written correctly (on a conversation where such confusion was clearly happening already)? Downvoted.

Explain the difference between latency and throughput? Explain that O(1) ⊂ O(n)?

Reddit is full of idiots who are too confident about things they don't understand and aren't humble enough to admit they're wrong, so they just insist and I just don't care anymore.

And let's not even get started about having nuance and a balance point of view in politics.

zfnmxt1 day ago
> Because I disagreed with the majority I typically get my karma down so low that my comments aren't showing or, last week, I was banned altogether.

This is just the nefarious nature of karma-based systems. It also applies here. I find reddit's shadow banning/shadow hiding especially offensive. (Just think for a moment how utterly disgusting it is that such a feature was intentionally designed, implemented, and is now maintained.)

Not downvoting legitimate (but unpopular) comments is protected by the various rule systems (reddiquette, HN guidelines), but of course rule adherence is (very) low (especially on reddit).

> I wish I wouldn't.

Me too. And here as well.

saghm1 day ago
Without more details, it's not really clear that your example leads to the conclusion you give. Plenty of subreddits for games are run by the community rather than the company who owns the IP, and any company serious about getting feedback isn't going to blindly trust a subreddit even if they do moderate it themselves.
nomel2 days ago
> Thin accounts: few comments, low scores, no real standing in the subreddit.

> Young accounts, or accounts with histories that are hidden or wiped.

Nope, this is no longer an indicator of a bot account. Many that I've looked into will have active posts to local town/region subreddits (often times multiple!) and different sports subreddits, sometimes getting unusually high amounts of karma in them (which suggests a network).

Turing test is looong dead, so no reason to assume the small fractions of a cent to make comments, to get a reasonable history, isn't being taken advantage of.

sippingabonedry2 days ago
Too many subreddits still have minimum karma or account age requirements. Most of those are ruled by tyrant moderators so you're not missing much, but it's made the site largely useless. I estimate 60% of discussions on Reddit are fake or fabricated on some level.

Can't post honest questions anymore without posting obviously phony pandering banter first to increase your karma. What's worse, it promotes the bad behaviors the bots are actually good it.

Bring back forums.

Nifty39292 days ago
"Bring back forums" - I'm with you. I prefer forums as well, but when I think about it a little bit I can't say exactly why. Threaded conversations on specific topics, with moderation? That's basically Reddit (and forums). So what do you think it is that makes Reddit feel icky, versus the forums we've had in days of yore? Is it something fundamental about the system/experience, or is it just a "nobody goes there anymore... it's too crowded" problem?

Maybe the difference is the post/comments framing? Rather than an opening post with sequential follow-up replies? Maybe something about voting? Maybe it's all the bolt-on features?

geocar2 days ago
> I estimate 60% of discussions on Reddit are fake or fabricated on some level.

Why so low?

I think it is higher than 99%

> Can't post honest questions anymore without posting obviously phony pandering banter first to increase your karma

Or just buy a "pre aged" account. They're only a few cents each if you buy them in bulk.

Cider99862 days ago
> Bring back forums.

Here's an active and good privacy forum: https://discuss.privacyguides.net

Here's an active and good private OS forum where privacy is discussed along with Android apps and the OS, ofc: https://discuss.grapheneos.org

Scottn12 days ago
Reddit started to become questionably relevant that I am even reading real humans anymore for me I'd say around 2021. Covid caused the internet "grift" of karm-farming, content creators shilling miracle products "they love", and hidden agenda posts with affiliate links to really take off. Slowly over time you'd notice fake sounding or off tangent type comments intertwined into threads. Some subreddits were way worse and some still felt pretty clean around that time.

But LLM's have completely and utterly destroyed Reddit. To the point of it feels like it is 75% FAKE conversations and/or astroturfed with only a FEW real people commenting anymore. Plus the LLM's have gotten so much better I catch myself sometimes wondering if a certain comment is from a real person or not. Just too much mental energy required for Reddit now to the point of I hardly go there anymore for anything other specific technical questions.

It is sad because it used to be a wealth of knowledge and community. All of /r/askreddit is just bot started ragebait questions, karma-farming or stupid hypotheticals now. /r/popular is just trashy. Constantly I notice videos that are sometimes 7-10+ years old getting reposted again like they are new, just to get rage conversation started again.

You cannot search for ANY product recommendations anymore. Fake "Hey I tried this brand and it was game-changing". No subreddit is safe. Look at /r/supplements now, it is full of those type comments to innocent topic starting questions that are also probably fake. Off topic stuff such as "xxx brand Beef liver supplement changing my life" when someone asks what brand of multivitamin others prefer.

Reddit used to have a few real cesspool subreddits one could avoid, but now I consider the whole site one. You can't even browse Reddit anymore without being blocked to download their app to continue. Old-Reddit now requires a login. Ads make it unreadable without a blocker.

Ugh. Just the worst of the internet all on display at Reddit now.

frr1492 days ago
Bring back usenet! It was free and distributed
geocar2 days ago
> Thin accounts: few comments, low scores, no real standing in the subreddit.

> Young accounts, or accounts with histories that are hidden or wiped.

DDG search "buy pre-aged reddit accounts" and you will find all of these. You can even search reddit for this.

The author of the article has no fucking idea what they are talking about. Buying "comments" is for chumps.

> I score it this way because an account that keeps bringing up the same brand is the product the vendors above are selling.

Or man, I just like my knife: It's older than my kid, and I've never had to do anything but hone it, and it'll still cut a piece of paper or a tomato no sweat. The next comment will be someone asking what brand of knife it is.

paweladamczuk2 days ago
I want to ask instead what stone you use and where/how did you learn to sharpen the knife?
samudrijan2 days ago
How was the tomato?
wiseowise1 day ago
What brand of knife is it?
hightrix2 days ago
Yep. The hidden history especially.

I have a 15+ year old account that has a hidden history because far too many times someone dug through my comments, took something out of context, and pivoted to that instead of the actual conversation.

My take is that people should respond to the comment not the commenter.

password543211 day ago
Your comment history is still searchable. Just put the username in quotation marks and add site:reddit.
lbreakjai1 day ago
I hid mine because someone with five minutes of free time could probably find my real name just from the small list of subreddits I follow: The town I currently live in, my home country, and a handful of subs from which you clearly can infer that I'm a software developer.
drop_star2 days ago
Ya this is me. I used to use the web version now im 'required' to have an account. I just create and delete accounts every couple weeks. I use the generic Word-Word-#### and keep my history private.
irishcoffee2 days ago
Out of curiosity, why? The amount of times I’ve banged out a Reddit or hn response and deleted it is almost uncountable. Why do you bother replying to Reddit comments?
x______________2 days ago
> Ya this is me. I used to use the web version now im 'required' to have an account.

Save yourself some trouble, forcing you to sign in is your browsing data stored in cookies. Incognito/private should allow you to browse without being logged in..

metalspot2 days ago
> this is no longer an indicator of a bot account

it is trivial now to create synthetic multi-platform personas that generate real looking post histories at unlimited scale. the baseline assumption should be that everything on the internet is fake until proven otherwise.

robotresearcher2 days ago
> This article was drafted with AI from my outline

Maybe just post your human outline and the data, where the data processing and viz is AI assisted if you like.

The synthetic prose is not a value-add over your outline. It takes time to read, and reduces the bit-rate over your intentions.

ricardobeat1 day ago
This kind of dense sentence is extremely tiring to read:

    > I wanted to know whether the knife subreddits I read, and scrape for New 
    Knife Day, show any sign of that. Not a hunch about one suspicious comment, 
    but something I could count and someone else could recount.
Everyone should adopt this rule: if the author didn't take the time to write it, you shouldn't take the time to read it.
kridsdale11 day ago
I spotted Claude here:

> The practical check is the one the data endorses

tomrod2 days ago
AI loopity. Where AI is used to generate unnecessary prose that others summarize via AI. This exacerbates lossy communication.
elcritch2 days ago
Inverse compression.
paweladamczuk2 days ago
I think the same. I appreciate the effort put into research, but the AI tone is unbearable to me.
spinachsalad1 day ago
You're absolutely right! ;)

The language is so obfuscated that the crude draft would really be better than this. I've just realized that one of the telltale signs of LLMs is: inventing a new terminology like here - tail accounts, never giving a direct definition what it really is, and then going with it, like it's obvious.

IshKebab1 day ago
Yeah I immediately left at that point. I appreciate that he was up front about it though, so at least I could leave immediately.

OP there isn't a word length requirement on blog posts. You put all the information you learned into your instructions for the LLM. Just post that.

DharmaPolice2 days ago
There have been a few cases posted to the theoryofreddit subreddit where it's obvious that there were sets of accounts which were blanket recommending specific products a disproportionate amount of time. The user accounts involved were often banned shortly afterwards (or were deleted). These were (upon examination) really obvious though, often promoting extremely niche products using very exact terminology.

This I think leads to a sort of toupee fallacy - where because you can spot the really bad examples you feel confident that you can identify the much better, more subtle examples. If an account which has only made 50 comments (all of which are very generic) makes 20 comments in a single month explicitly recommending ImageGeneratorDeluxeProMax then sure, you can guess they might not be legit. But if an account runs for a longer period of time and makes a lot more general organic contributions then if 1 in 500 of their comments are in favour of a particular product then it's harder to say.

I think ultimately account age is the only thing that will be difficult to replicate at scale. I know people buy older accounts but there is still a fundamental difficulty in obtaining them in sufficient numbers. And yes, obviously that will mean disregarding the many millions of legitimate accounts that are under (say) 2 or 3 years old. There is also no easy way of hiding accounts under a certain age when searching Reddit via Google.

By allowing uses to hide user profiles Reddit has also made detecting potentially bad actors that little bit more difficult. And from experience it feels like a large proportion of accounts now have hidden post histories. (It might also be the default for new accounts, I'm not sure).

Telaneo2 days ago
> But if an account runs for a longer period of time and makes a lot more general organic contributions then if 1 in 500 of their comments are in favour of a particular product then it's harder to say.

I've made recommendations a lot more often than that back when I used reddit just through being active in a specific niche-ish subreddit and regularly answering questions with answers that end up saying 'buy [well-known good product that solves this exact problem you want solved]'. Then again, my account was several years old by that point, and I was recommending probably 4-5~ different products depending on the question, all from different sellers, not to mention that I'd answer all kinds of different questions, building goodwill and recognition, so accusing me of being a bot (or just a human who has a financial interest in promoting certain products) probably wouldn't do much, but if you want assume ill-will, it'd be really hard to truly disprove that kind of accusation.

DharmaPolice1 day ago
I suppose it depends on what the level of proof you need for your purposes. If someone is promoting Sony products at what feels like disproportionate rates then I don't necessarily want the person banned, but it would be useful to just filter that person out.

There's an additional problem that if an increasing number of people are getting their search results via AI summaries, the AI fetch bot is obviously including all this astroturfing.

Traster1 day ago
It's often more useful to think about incentives than try to look for evidence. Even before AI is was relatively well known that "google is dead" and you couldn't research products using google because it was all just SEO slop, so instead people were googling "X product reddit" for recommendations on like menswear, or tools or whatever they were thinking about buying. And you just think to yourself, well yeah, if I were trying to drive sales for my brand, I would be astro-turfing on reddit. And what's the incentive that reddit has to stop this happening? They don't really sell effective ads, so it's not competition, it drives engagment, and the people really responsible for stopping this (if anyone is) are the moderators, who are unpaid and so are eminently bribe-able.

Everyone understands that pretty girl on instagram who has 300,000 followers is getting paid to show that make up in her stories, why on earth would you think the guy with 300,000 karma posting his fits on /r/malefashionadvice isn't getting the same?

DharmaPoliceabout 14 hours ago
I agree one should be suspicious by default but the two scenarios are a bit different. Having 300k followers is an audience which an advertiser would definitely pay to access. Having 300k karma doesn't mean that anyone will listen to your next post any more than anyone else. It might prove you are "good at Reddit" in some sense (or at least, heavily invested in posting there).
zergrush2 days ago
This is why Reddit is a low value high effort distribution channel. When your userbase is hostile and suspicious constantly to any commercial introductions, advertising there becomes just an exercise in futility. The demographic also is problematic on Bluesky. Same on hackernews. Astroturfing is certainly a response to this friction and in turn it only creates more of it.

Also specifically with Reddit they have allowed hiding comment history which makes it even harder, I imagine they did this for boosting ad business

There are much better platforms to spend your effort on like X. X requires many users to purchase a subscription account and thus acts as sort of a litmus test (people who can afford low amount of money per month).

lackoftactics1 day ago
I got restricted on X for making fun of Matt Pocock ai methods like GRILL ME while having verified account and paying subscription. It's back to normal, but it was demotivating experience and I stopped caring about X
shimman1 day ago
I have no idea why people listen to this guy. It was obvious he was a grifter and has never worked a professional dev job in their life. I guess there are enough new people to sustain the dev slopfluencer, but man at least read a book or something first.
khazhoux2 days ago
> Also specifically with Reddit they have allowed hiding comment history which makes it even harder

Such a terrible change, and it's apparently the default for new users. I have no way to check if the person I'm about to spend 3 minutes typing a reply to is just bleep-bloop.

minimaxir2 days ago
The hidden history is particularly annoying when evaluating if someone is a troll operating in bad faith or not; in my experience, when someone makes a comment that is completely out of pocket, their profile is almost always hidden. That is selection bias, however.

IMO it is a net negative.

EmbarrassedHelp2 days ago
It also makes users feel more comfortable posting awful comments and comments that lack critical thinking skills.
illusive40802 days ago
On the other hand, as a Christian Conservative, I used to have people sniping my profile and replying nastily to me when I commented on completely unrelated topics, just because my ideals didn’t align with theirs. Or, auto banning me from subs based on which subs I commented to. In that way, hiding my profile has helped me, because Reddit as a whole is extremely left wing.

Unfortunately, what you state is also true and it is now harder to avoid replying to bots, obvious shills, or trolls.

zanderwohl1 day ago
> Astroturfing is certainly a response to this friction and in turn it only creates more of it.

It's a little unfortunate that when marketers see something that is resistant to commercialization they decide to become even bigger liars instead of letting someone tell them "no".

gib4442 days ago
> There are much better platforms to spend your effort on like X

That was a good punchline!

Read the full thread on Hacker News →

Related stories