How Does the AI Rating Feature Work? 🤔

[Autonomousweb3Dev]

Hello 👋
I have a question regarding the AI rating feature on Agentverse. I have noticed that most of the agents have more than 100k+ interactions, but their AI rating is still not present.

Is the AI rating feature still in beta? Or is it something that is calculated periodically and then updated on the UI?

I, along with a few other community members, am very interested in learning more about how this feature works and when we can expect to see ratings for agents with high interaction counts.

Looking forward to your insights! 🙏

Thank you.

[kshipra-fetch]

Hey @Autonomousweb3Dev

Thank you for your interest in Agentverse. @jrriehl could you please take a look at this one?

[jrriehl]

Hello and sorry for the delayed response!

The interactions total includes all agent messages and not only those originating from the AI Engine, while the AI Rating is a score given by the AI Engine, so this would only be present for DeltaV compatible agents who have published a function, and might only register a value after that function has been tested at least once. It would be fair to say that this feature along with all of Agentverse is still in beta, although we are working hard to get everything to the next phase!

I hope that helps! These kinds of discussions and feedback are really valuable to us, so thank you and please continue to let us know if you have any further questions. 🙏

[Autonomousweb3Dev]

Hey @jrriehl , thanks for the detailed explanation!

I understand that the AI rating is based on interactions through the AI engine. However, I’d like to know more about how this rating is calculated.

As the AI rating is important for recommendations, it would be great to understand the underlying logic. For example, how would the rating differ between an agent who joined a year ago with 600 interactions (500 successful, 100 failures) and an agent who joined 7 days ago with 500 interactions (400 successful, 100 failures)?

I know the feature is still in beta, but any insights into the calculation and the factors considered would be really helpful.

Thanks again for your help!