OpenAI-compatible LLM inference, routed across a fleet of community and self-hosted GPU nodes. Point any OpenAI SDK at one base URL, pick a model, and requests route to a node that can serve it — loading the model on demand if needed. EU-sovereign by design.
Every page here is also available as raw Markdown (append .md to any URL) and indexed for machines in llms.txt · llms-full.txt.
Get started
- OverviewWhat Porten is — one OpenAI-compatible API in front of a fleet of community and self-hosted GPU nodes, with models that load on demand.
- QuickstartMake your first Porten API call in a few minutes — get a key, list models, and stream a chat completion with curl or any OpenAI SDK.
- Use it from your toolsPoint Aider, Cline, Continue, Cursor, OpenCode, OpenWebUI, LiteLLM, the Vercel AI SDK, LangChain, and the OpenAI SDKs at Porten by overriding the base URL and API key.
Using the API
- API referenceThe OpenAI-compatible surface — chat completions, embeddings, models — with parameters, streaming, headers, and error codes.
- Models & on-demand loadingHow the curated model catalog works, what "loads on demand" means, how warming and idle eviction behave, and how to pick a model.
- Regions & data sovereigntyPorten is EU-sovereign by design — pin an API key to a region so requests only route to nodes there.
- Sovereign inference — your hardware, your regionGuarantee that inference runs only on machines you own and only in the region you choose — enforced (fail-closed), not just promised. For regulated and public-sector workloads.
Run a node
- Run a node & earnRun a GPU machine as a Porten node — one-line install, browser login, engines (built-in, Ollama, OpenAI-compatible), and how serving turns into payouts.
- Hardware guide — what to buildHow much VRAM each model needs, which GPUs and Macs to buy, how quantization and context affect memory, and what runs a flagship-competitive coding agent locally.
- Build a combined machine (Thunderbolt 5)Pool 2–6 Apple-Silicon Macs over Thunderbolt 5 with exo into one logical node, so Porten can serve frontier-size models no single box can hold.