OpenAI-compatible LLM inference, routed across a fleet of community and self-hosted GPU nodes. Point any OpenAI SDK at one base URL, pick a model, and requests route to a node that can serve it — loading the model on demand if needed. EU-sovereign by design.
Every page here is also available as raw Markdown (append .md to any URL) and indexed for machines in llms.txt · llms-full.txt.
Get started
- OverviewWhat Porten is — one OpenAI-compatible API in front of a fleet of community and self-hosted GPU nodes, with models that load on demand.
- QuickstartMake your first Porten API call in a few minutes — get a key, list models, and stream a chat completion with curl or any OpenAI SDK.
- Use it from your toolsPoint OpenCode, Cursor, Continue, the OpenAI SDKs, and LangChain at Porten by overriding the base URL and API key.
Using the API
- API referenceThe OpenAI-compatible surface — chat completions, embeddings, models — with parameters, streaming, headers, and error codes.
- Models & on-demand loadingHow the curated model catalog works, what "loads on demand" means, how warming and idle eviction behave, and how to pick a model.
- Regions & data sovereigntyPorten is EU-sovereign by design — pin an API key to a region so requests only route to nodes there.
- Sovereign inference — your hardware, your regionGuarantee that inference runs only on machines you own and only in the region you choose — enforced (fail-closed), not just promised. For regulated and public-sector workloads.
Run a node
- Run a node & earnRun a GPU machine as a Porten node — one-line install, browser login, engines (built-in, Ollama, OpenAI-compatible), and how serving turns into payouts.
- Hardware guide — what to buildHow much VRAM each model needs, which GPUs and Macs to buy, how quantization and context affect memory, and what runs a flagship-competitive coding agent locally.
- Build a combined machine (Thunderbolt 5)Pool 2–6 Apple-Silicon Macs over Thunderbolt 5 with exo into one logical node, so Porten can serve frontier-size models no single box can hold.