61 points•embedding-shape•about 2 months ago•61 comments•

61 comments

shaky-carrouselabout 2 months ago
"that's on me"

Nice touch by the mechanical parrot, to worthlessly owning it.

embedding-shapeabout 2 months ago
Especially considering the user was mad about the agent doing stuff by itself, so it tried to "fix" this by sending an apology to the buyer without explicit approval of the person "running" the agent, seemingly understanding nothing from the conversation.

Wonder what quantization Meta runs these models on, Q4?

refurbabout 2 months ago
That jumped out at me too. It’s hilarious to see that response so often when AI makes a mistake
ChrisRRabout 2 months ago
AI has seen how much humans lap up content that is #relatable and started acting like that
thih9about 2 months ago
> I should probably stop the auto-replies from claiming you're home when I can't verify that.

I wonder how much of this unreasonably risky and illogical behavior is a genuine property of LLMs and how much is there because LLMs come from "move fast and break things" startups.

Rhaskinsabout 2 months ago
Classic case of 'AI gonna AI.' Always review your automated systems' outputs, especially before they hit public channels.
bluegattyabout 2 months ago
The AI is not remotely ready for this - this is an absolute delusion they are selling.

"By the way don't do this again" <- as if the AI has the ability to ingest and systemically diffuse this.

I think Zuckerberg himself is deeply into the Koolaid, and is likely himself unaware of the limits of this tech.

He's probably surrounded by enablers.

sdcfgyabout 2 months ago
Had that problem here. Our product lead thinks it’s infallible and is surrounded by yes men.

Day one our agentic platform goes live it causes a reportable compliance issue. Massive clean up. Reputational impact. Turned off.

No one held accountable still. Assuming that adding more guardrails will fix everything.

bluegattyabout 2 months ago
You should write about that, because it's the primary systems failure of AI right now.

'Managers Delusion' - which includes techies as well, to be fair, at least they have the excuse they are one step removed.

petesergeantabout 2 months ago
The AI is not ready for this _yet_, but it will be, and FB wanting getting ahead of the game here is potentially good business. It’s all in the public perception of utility vs fuck-up, and it’s far too early to say Zuck got that wrong, and indicators are he got that right.
eloisiusabout 2 months ago
> The AI is not ready for this _yet_

It should be ready in about two more weeks! How many models have a Ph.D level intelligence now? I feel like I’ve been hearing that for about a year at this point.

user43928about 2 months ago
If it uses "memory" files like Claude Code there's a good chance it works.

If it was Claude I'd expect it to now put some form of this into every output even when not really related to the task: "No offers were accepted without consulting you and I haven't shared your address or availability."

Is it guaranteed to work? No.

And obviously it's a terrible idea to set up a chatbot to communicate, negotiate deals, and handle logistics on your behalf.

bluegattyabout 2 months ago
"If it uses "memory" files like Claude Code there's a good chance it works."

You have explained literally why it would not work.

The AI can absolutely not depend on 'arbitrary statements in some file' as operational policy.

For a very, very narrow scope of work, when it's well defined, when the information is rigorously applied, sure ...

But they don't have that.

The are throwing agents out there like they can handle this degree of complexity and nuance, when they cannot.

100% failure rate over any period of time.

alansaberabout 2 months ago
They're building for future capabilities. It's a logical approach to leveraging the data they have.
TrackerFFabout 2 months ago
I can see some use for it, in the future.

Say that you want to make a garage sale, but to get a better reach, you want to list item by item on marketplace. If you've never done it before, making 100 listings is such a pain in the ass you never want to do it again (I used to flip stuff for a living back in college, and it is a hassle)

At least with this, you can now just take pictures of everything, and tell the agent to research everything, list the stuff, and arrange for pickups.

Obviously not something I'd like to do for any serious deals or higher $ items. But for random stuff? I mean, it sort of beats hosting a garage sale or taking them to the flea market.

I'm not all pessimistic about this.

Read the full thread on Hacker News →

Related stories