Before you start
- Credits on Billing
- A Hugging Face repo with a
pipeline_tagthat matches a supported task, or a model artifact in ready status
Wizard steps (managed)
- Type — Managed model inference.
- Model — Hugging Face repo + revision, or pick an artifact.
- Configure — workers, timeout, scaling, precision, quantization, pricing, store requests.
- Review — confirm the live estimate, then launch.
Settings
The wizard shows estimated storage and compute before you confirm. After launch, status moves Building → Sleeping or Ready. See Manage models.
Next steps
Playground
Try the deployment in the dashboard.
Call the API
SDK, cURL, and OpenAI-compatible clients.
Integrations
Drop the deployment into LangChain, LlamaIndex, or FastAPI.
Autoscaling
Tune workers after launch.