RetryBudgetConfig

data class RetryBudgetConfig(val maxTokens: Double = 10.0, val tokenRatio: Double = 0.1)(source)

Configuration for a RetryBudget.

Constructors

Link copied to clipboard
constructor(maxTokens: Double = 10.0, tokenRatio: Double = 0.1)

Properties

Link copied to clipboard

The budget's ceiling -- also its starting balance.

Link copied to clipboard

Tokens deposited per successful, non-retry call. 0.1 means roughly one retry may be in flight per ten successful calls once the budget reaches steady state.