Skip to main content

Model Provider Specifications

A model provider is who serves a model: the vendor's own API (Anthropic, OpenAI), a cloud that hosts it (Amazon Bedrock, Azure OpenAI, Alibaba Cloud Model Studio, Cloudflare), or the user's machine (Ollama). One YAML per provider under agentspecs/model-providers/ says where it lives, where its documentation is, the terms of service a call is made under, its privacy policy and what it says about the data a request carries โ€” what a person choosing a model, or a team signing off on one, has to be able to read without leaving the catalogue.

A model spec's provider names one of these, and the catalogue refuses a model whose provider has no spec. A model's own page on the provider's site is its provider_url.

Fieldsโ€‹

FieldMeaning
idWhat a model spec's provider names: anthropic, bedrock, openai, azure-openai, alibaba, cloudflare, ollama. The file is named for it.
nameDisplay name.
descriptionWhat the provider is, and what is worth knowing before choosing it.
websiteThe provider's product page.
docs_urlIts documentation.
terms_urlThe terms of service a call is made under.
privacy_urlIts privacy policy.
data_usage_urlWhat it says about the data a request carries (retention, training), when it has a page for it.
hostingcloud (the provider runs the model) or local (the user's machine).

Exampleโ€‹

id: "cloudflare"
version: 0.0.1
name: Cloudflare
description: >-
Cloudflare Workers AI, the models Cloudflare hosts at its edge, and AI Gateway, which
sits in front of them and of the third-party models it fronts (Typesafe's Jev) with
logs, caching, rate limits and prepaid credits. A model's route (`wrk`, `gtw`) says
which of the two it is reached through.
website: "https://www.cloudflare.com/developer-platform/products/workers-ai/"
docs_url: "https://developers.cloudflare.com/workers-ai/"
terms_url: "https://www.cloudflare.com/terms/"
privacy_url: "https://www.cloudflare.com/privacypolicy/"
data_usage_url: "https://developers.cloudflare.com/workers-ai/platform/data-usage/"
hosting: cloud

The providersโ€‹

ProviderIDHostingNotes
AnthropicanthropiccloudThe vendor's API for Claude.
Amazon BedrockbedrockcloudClaude through AWS, with AWS credentials, in an AWS region.
OpenAIopenaicloudThe vendor's platform API; API data not used for training by default.
Azure OpenAIazure-openaicloudOpenAI's models sold by Azure, under the Microsoft Product Terms.
Alibaba Cloud Model StudioalibabacloudThe Qwen family, OpenAI-compatible.
CloudflarecloudflarecloudWorkers AI and AI Gateway; see the models page for the two routes.
OllamaollamalocalOpen models on the user's machine; nothing leaves it.

Code Generationโ€‹

The specs generate agent_runtimes/specs/model_providers.py and src/specs/modelProviders.ts in agent-runtimes (MODEL_PROVIDER_CATALOGUE, getModelProvider), beside the models.

In Pythonโ€‹

from agentspecs.model_providers import MODEL_PROVIDER_CATALOGUE, get_model_provider

cloudflare = get_model_provider("cloudflare")
print(cloudflare.terms_url)