Create a model response
OpenAI-compatible Responses API backed by vLLM deployments only. Provide text or structured input to generate a response with optional tool calling, reasoning, and streaming.
Availability: Only supported on vLLM-backed model deployments.
Stateless operation: Responses are not stored server-side. The store parameter is always forced to false. Use previous_input_messages to carry conversation history across turns instead of previous_response_id.
Unsupported parameters: Requests that set previous_response_id or background: true are rejected at validation with a clear error.
Batching: This endpoint does not support batch requests.
Body
Request body for the OpenAI-compatible Responses API. The primary input field is input. Only available on vLLM-backed deployments. Responses are not persisted; store is always forced to false.
Model ID to use for this request. Required.
Text or structured input to the model. Required.
System or developer instructions inserted into the model context, separate from input.
Maximum number of tokens the model may generate in the response.
Maximum number of tool calls the model may make during generation.
Optional key-value metadata attached to the request.
Mapping from token ID to a bias value added to the token logits.
Whether the model may call multiple tools in parallel.
Optional prompt template configuration.
Optional reasoning configuration for supported models.
Service tier hint for request scheduling.
auto, default, flex, scale, priority Ignored — always forced to false because responses are not stored server-side.
If true, stream partial response events as Server-Sent Events (SSE).
Sampling temperature; higher values increase randomness.
Text output configuration, including structured output format via text.format.
Controls which tool the model calls. Accepts a string (for example, auto, none, required) or an object specifying a function.
Optional list of tool definitions the model may call.
Return the top N token logprobs at each position when logprobs are enabled.
Nucleus sampling cumulative probability threshold.
Keep only the top_k tokens by probability at each generation step.
Truncation strategy for inputs that exceed the model context window.
auto, disabled Whether to skip special tokens in the generated output.
Penalty applied to discourage new token presence.
Penalty applied based on token frequency to reduce repetition.
Optional salt for prefix caching.
Additional repetition control for generation.
Optional random seed for reproducibility.
Stop sequence or list of sequences where generation should halt.
Structured output schema configuration.
Additional keyword arguments passed to the model chat template.
Additional output fields to include in the response.
Prior conversation messages to include when continuing a multi-turn exchange without server-side response storage.
Not supported. Requests that set this field are rejected with a validation error because responses are not stored.
Not supported. Requests with background: true are rejected with a validation error because responses are not stored.
Response
Model response
OpenAI-compatible response object returned by the Responses API.
Unique identifier for this response.
Object type. Always response.
Unix timestamp (seconds) when the response was created.
Model identifier used to generate the response.
Status of the response generation.
completed, failed, in_progress, incomplete, cancelled Typed output items produced by the model (for example, messages, function calls, or reasoning items).
Convenience field containing concatenated text output from the response.
System or developer instructions used for this response.
Token usage details for the request.
Error details when generation fails.
Details about why the response ended before completion.

