Skip to main content
The SynapsAI Cloud API lets you run inference against your deployed models over HTTPS. Most LLM and embeddings endpoints follow the OpenAI API format, so you can often switch providers by changing the base URL and API key.

Base URL

All API requests use:
Versioned endpoints are prefixed with /v1 (for example, /v1/chat/completions).

Authentication

The API uses Bearer token authentication with your API key.
Include the key on every request:
Keep API keys secret. Never embed them in client-side code, public repositories, or browser bundles. Load keys from environment variables or a secret manager on the server.

List models

Verify authentication and list deployed models:

Python SDK

Install the official Python client:
See the Inference quickstart for a full walkthrough.

OpenAI compatibility

SynapsAI Cloud implements OpenAI-compatible endpoints for common workflows: To use OpenAI-compatible libraries, set:
For a full migration walkthrough, see Migrate from OpenAI.

Request and response format

  • Send JSON bodies with Content-Type: application/json unless the endpoint accepts multipart uploads (for example, audio transcription).
  • Replace model in each request with your model ID from the dashboard. This is not the Hugging Face repository name.
  • Successful responses return JSON. Streaming endpoints return Server-Sent Events (SSE). See Streaming.

Errors

Errors return a JSON object with an error field:
For a catalog of error types and fixes, see Troubleshooting.

Rate limits

Default limits apply per account and per deployed model. See Rate limits for current defaults and how to request higher throughput.

Debugging requests

  1. Confirm the model is not Building or FailedSleeping and Ready deployments both accept inference requests.
  2. Check the model Logs tab for deployment and runtime errors.
  3. Verify your API key is scoped to the target model.
  4. Compare your request against the supported tasks table and the endpoint reference below.