Endpoints

Choose between serverless and dedicated endpoints.

Draft

Outline only. Confirm the billing and scaling details before publishing.

ServerlessDedicated
BillingPer tokenPer GPU hour
CapacitySharedReserved for you
Best forPrototyping and variable trafficSteady, high-volume traffic and custom models

Serverless endpoints

Dedicated endpoints