Inference Cost per Prediction — Cost per prediction derived from Compute cost, requests. Budgeting inference..
Compute cost is required
requests is required
Inference Cost per Prediction — Cost per prediction derived from Compute cost, requests. Budgeting inference..
Formula
costPerPrediction = computeCost ÷ requests