Reducing LLM Costs 50% Using Best-Execution for Intelligence

Ship is an endpoint that provides output indistinguishable from the model you're already using, at half the price.

Just replace model="" with model="ship-like/", and all requests will be 50% less expensive. We take the risk that any individual request costs us more to execute. This allows you to either (A) reduce costs on existing workflows or (B) increase quality by using more intelligence with the same budget.

We achieve this by doing inference-time optimization with two guarantees: capability equivalence and behavioral equivalence. Capability equivalence means that any problem solved by your original model will also be solved by Ship. Behavioral equivalence means that you don't need to change the prompt when you start using Ship; you'll get the same behavior (everything outside the capabilities, e.g. the shape of the output, average number of tool calls, instruction following, etc. remains the same).

By defining and measuring reference-relative quality, we can turn model quality into a contractual service level. Ship is the first endpoint to offer a quality SLA alongside its price and availability commitments.

This blog post lays out:

Evidence that Ship maintains capability equivalence and behavioral equivalence

The tech powering Ship: scaling Inference-Time Optimization

What people have built with Ship

Our quality SLA