Skip to main content
The Python SDK and docs are currently in beta. Report issues on GitHub.
Breakdown of upstream inference costs

Fields

FieldTypeRequiredDescription
upstream_inference_completions_costfloat:heavy_check_mark:N/A
upstream_inference_costOptionalNullable[float]:heavy_minus_sign:N/A
upstream_inference_prompt_costfloat:heavy_check_mark:N/A