Skip to content

Four run modes, and which two you can use today

Serverless and Batch are available now. Dedicated and Private are conversations, and saying so is more useful than a signup form that goes nowhere.

Published

Grid runs inference in four modes. Two are available now and two are not, and it is worth being direct about which.

ModeWhat it is forAvailability
Grid ServerlessElastic traffic. Capacity follows demand and scales to zero when idle.Available
Grid BatchAsynchronous inference at a discount, in controlled windows.Available
Grid DedicatedCommitted capacity for steady production traffic.Talk to us
Grid PrivateAn isolated environment for regulated workloads.Talk to us

Why "talk to us" rather than a waitlist#

Dedicated and Private both involve a commitment on our side: dedicated capacity, or an isolated environment with its own boundaries. Neither is something you can pick from a dropdown and have provisioned, and a form that implied otherwise would just move the conversation later, after you had already planned around it.

Serverless and Batch you can start on today. Run modes covers each in full, and access to Grid is invite only while we scale.

Read next

Your first call is one base_url away.

Request access

Grid is invite only while we scale.

Drafts stay in this browser visit. Refreshing the page clears them.

Talk to us

Tell us who you are and what you need to review.

Drafts stay in this browser visit. Refreshing the page clears them.

Each topic keeps its own requirements during this visit. Changing topic keeps your contact details.