Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to estimate the cost of a prediction? #243

Open
haranrk opened this issue Feb 8, 2024 · 1 comment
Open

How to estimate the cost of a prediction? #243

haranrk opened this issue Feb 8, 2024 · 1 comment

Comments

@haranrk
Copy link

haranrk commented Feb 8, 2024

To calculate the cost of a prediction 3 values are needed

  • Prediction time (returned as part of GET prediction)
  • Hardware on which the model was run
  • Price/sec of running that hardware (values present here)

Given this we can approximately calculate price as time*pricing. However, the GET prediction api does not return what hardware the prediction ran on even though the website shows this information. Would it be possible to return the hardware as part of response to GET prediction? If not, is there any other way to calculate the inference cost

image

@Jipok
Copy link

Jipok commented Dec 4, 2024

It's very strange that there is no API to find out the cost. Maybe they are fighting against API resale?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants