Skip to main content
The Go SDK and docs are currently in beta. Report issues on GitHub.
Percentile-based throughput cutoffs. All specified cutoffs must be met for an endpoint to be preferred.

Fields

FieldTypeRequiredDescription
P50optionalnullable.OptionalNullable[float64]:heavy_minus_sign:Minimum p50 throughput (tokens/sec)
P75optionalnullable.OptionalNullable[float64]:heavy_minus_sign:Minimum p75 throughput (tokens/sec)
P90optionalnullable.OptionalNullable[float64]:heavy_minus_sign:Minimum p90 throughput (tokens/sec)
P99optionalnullable.OptionalNullable[float64]:heavy_minus_sign:Minimum p99 throughput (tokens/sec)