Under construction
One API. Many models. Under control.
We are building an API compatible with the OpenAI ecosystem to use third-party and open-weight models from a single point. It is not open yet: today you can only join the list.
import os
from openai import OpenAI
client = OpenAI(
base_url="https://criterium.pro/v1",
api_key=os.environ["CRITERIUM_API_KEY"],
)
r = client.chat.completions.create(
model="criterium/router",
messages=[
{"role": "user", "content": "Summarise this invoice."},
],
)
print(r.choices[0].message.content)
Only the marked lines would change.
What it will be
Four things, and none of them works for the public yet.
- Compatible API
- OpenAI ecosystem clients will work by changing the address and the key.
- Routing
- Pick a model, or let a transparent policy choose among several.
- Keys
- Per-organisation keys, shown only once and revocable whenever you want.
- Usage and cost
- Every call metered, with quotas and a budget per organisation.
What it is not
- Our own models
- We have none. It will route over third-party and open-weight models, and each entry will say which one is behind it.
- An open service
- Not yet. That is why there is no sign-up, no keys and no promised date.
- A price list
- None has been published.
We'll tell you when it opens.
No promised date. We will only write to you about this.