Show HN: Witdem – Did your AI Agent accomplish its task? and at what cost?

Show HN: Witdem – Did your AI Agent accomplish its task? and at what cost?demo.witdem.com

3 points•ebrahimisoheil•10 days ago•5 comments•

#ai #agent #task #cost #witdem #accomplish #ai agent #agent accomplish

5 comments

i really like this. the “the agent finished” vs. “the agent actually did what it was supposed to do” distinction is something i don't see addressed very well by most observability tools.

traces, tokens, latency etc. are great, but in the end i care about whether the job got done. i think this is a pretty interesting way of looking at it. - and it is free, right?

ebrahimisoheil10 days ago

It is totally free and open-source we are looking for the first design partners to ship the enterprise version on production. The enterprise repo is using the OSS as the core and make it easily scalable. There are some differences in the technologies used tho.

MariusvonHassel10 days ago

Cool tool, now I know how much I've spend on AI xD. But how exactly can you measure if the outcome of a flow was successful?

ebrahimisoheil10 days ago

The way I do it is actually by Defining Yaml contracts, to define the business outcome so using the traces you can understand if it reaches the goal. Evaluations also play a big role

phitosch10 days ago

it's probably magic

Read the full thread on Hacker News →

5 comments

Related stories