Usage - Python SDK

Usage method reference

The Python SDK and docs are currently in beta. Report issues on GitHub.

Token usage information for the response

Fields

Field	Type	Required	Description
input_tokens	int	:heavy_check_mark:	N/A
input_tokens_details	components.InputTokensDetails	:heavy_check_mark:	N/A
output_tokens	int	:heavy_check_mark:	N/A
output_tokens_details	components.OutputTokensDetails	:heavy_check_mark:	N/A
total_tokens	int	:heavy_check_mark:	N/A
cost	OptionalNullable[float]	:heavy_minus_sign:	Cost of the completion
cost_details	Optional[components.UsageCostDetails]	:heavy_minus_sign:	N/A
is_byok	Optional[bool]	:heavy_minus_sign:	Whether a request was made using a Bring Your Own Key configuration