Limits and rate limits
Sizes, batch limits and per-token rates.
Default limits of a deployment. A workspace or tenant can have its own embedding quota and rates; get_usage shows the effective values.
| Limit | Default |
|---|---|
| max_content_bytes | 1048576 |
| dereference_range_max_bytes | 262144 |
| expanded_parts_max_bytes | 4194304 |
| batch_upsert_max | 25 |
| batch_dereference_max | 25 |
| query_limit_max | 50 |
| list_limit_max | 500 |
| idempotency_window_hours | 24 |
| requests_per_minute_default | 600 |
| sse_revalidate_seconds | 30 |
| write_rate_per_minute | 60 |
| write_burst | 20 |
| query_rate_per_minute | 120 |
| max_in_flight_per_token | 4 |
| max_streams_per_token | 1 |
| backoff_max_seconds | 60 |
| embedding_tokens_per_day | 2000000 |
When you hit a limit
- 429 rate_limited: wait for Retry-After; early retries are refused and double the wait.
- 429 circuit_open: the token was paused after a runaway loop; a workspace owner can clear it.
- Daily embedding quota spent: writes are still stored, indexing waits for the reset (embedding_deferred_quota).