Skip to main content
The Go SDK and docs are currently in beta. Report issues on GitHub.
Information about a specific model endpoint

Fields

FieldTypeRequiredDescriptionExample
ContextLengthint64:heavy_check_mark:N/A
LatencyLast30m*components.PercentileStats:heavy_check_mark:Latency percentiles in milliseconds over the last 30 minutes. Latency measures time to first token. Only visible when authenticated with an API key or cookie; returns null for unauthenticated requests.{"p50": 25.5,"p75": 35.2,"p90": 48.7,"p99": 85.3}
MaxCompletionTokens*int64:heavy_check_mark:N/A
MaxPromptTokens*int64:heavy_check_mark:N/A
ModelIDstring:heavy_check_mark:The unique identifier for the model (permaslug)openai/gpt-4
ModelNamestring:heavy_check_mark:N/A
Namestring:heavy_check_mark:N/A
Pricingcomponents.Pricing:heavy_check_mark:N/A
ProviderNamecomponents.ProviderName:heavy_check_mark:N/AOpenAI
Quantization*components.PublicEndpointQuantization:heavy_check_mark:N/Afp16
Status*components.EndpointStatus:heavy_minus_sign:N/A0
SupportedParameters[]components.Parameter:heavy_check_mark:N/A
SupportsImplicitCachingbool:heavy_check_mark:N/A
Tagstring:heavy_check_mark:N/A
ThroughputLast30m*components.PercentileStats:heavy_check_mark:N/A{"p50": 25.5,"p75": 35.2,"p90": 48.7,"p99": 85.3}
UptimeLast1d*float64:heavy_check_mark:Uptime percentage over the last 1 day, calculated as successful requests / (successful + error requests) * 100. Rate-limited requests are excluded. Returns null if insufficient data.
UptimeLast30m*float64:heavy_check_mark:N/A
UptimeLast5m*float64:heavy_check_mark:Uptime percentage over the last 5 minutes, calculated as successful requests / (successful + error requests) * 100. Rate-limited requests are excluded. Returns null if insufficient data.