Inference — Layer 01

Serving, the way agents need it.

Most inference is served for chat: one question, one answer, goodbye. Layer X1's engine was built from the ground up for agents — runs that last hours, hammer tools, and cannot afford a dropped call. You point an agent at the endpoint; the engine guarantees the rest.

The guarantees[01/04]

Five guarantees, held on every request.

You point an agent at an endpoint. We do the rest. You never see the machinery — you see what it guarantees.

  1. 01

    Always on

    Degradation never reaches your run — serving recovers before your agent notices, with no retries to write and no fallback lists to maintain on your side. Zero downtime is the design target, not a status-page apology.

  2. 02

    Fast for agents, from the ground up

    Chat inference optimizes one answer. Agent inference is different: hours-long trajectories, tool calls every few seconds, context that keeps growing. Our stack was built for that shape of traffic from day one — sustained throughput across the whole run, not a fast first token and a slow everything else.

  3. 03

    Usage that reads huge

    Plans carry a monthly pool of included usage measured in dollars at public list rates — $200 of model usage on a $5 plan, $600 on Pro. Every model in the catalog draws from the same pool: no per-model surcharges, no premium gate, nothing to tune or configure.

  4. 04

    Tool calls that hold

    Agent loops live and die on tool calling. The engine enforces strict, schema-faithful tool calls under load, on every model in the catalog, in both agent dialects — so a malformed call never silently derails a run.

  5. 05

    Any agent, no ceremony

    Anthropic-compatible and OpenAI-compatible endpoints, streaming everywhere, one key. If it runs an agent loop, it runs here — the engine does not care which framework is driving.

Point an agent here →
FIG. 01 — REQUEST PATHCUTAWAY
The catalog[03/04]

Every model, behind one endpoint.

You hold one key and one endpoint — never another vendor account, quota, or bill. Open-weight flagships sit next to premium frontier models behind the same door, and the catalog keeps growing. One key reaches all of it.

1
endpoint · the whole catalog
4
API protocols · one endpoint
0
changes to your agent
Live in the catalog todaygrowing
Claude Opus 4.8frontierClaude Opus 4.7frontierGPT-5.5frontierGPT-5.4frontierGemini 3 ProfrontierGrok 4.3frontierGPT-OSS 120BworkhorseSonnet 4.6premiumClaude Sonnet 5premiumClaude Haiku 4.5premiumGLM 5.2coding flagshipGLM 5coding flagshipQwen3 Coder 480Bcoding flagshipKimi K2.7 Codecoding flagshipQwen3-Maxcoding flagshipQwen3 235BreasoningDeepSeek V3.2reasoningKimi K2 ThinkingreasoningMiniMax M2.5reasoningERNIE X1reasoningHunyuan T1reasoningStep 3reasoningNemotron Super 3 120BworkhorseNemotron 3 120BworkhorseQwen3 Next 80Bworkhorse
Mistral Large 3 675BworkhorseERNIE 5.1workhorseHunyuan TurboSworkhorseGemini 3 FlashworkhorseQwen3 Coder 30BcodingQwen3 Coder NextcodingKimi K2.5codingDevstral 2 123BcodingGemma 4 26Bcheap · big ctxLongCat 2.0cheap · big ctxGPT-OSS 20Bcheap · fastGLM 4.7 Flashcheap · fastNemotron Nano 3 30Bcheap · fasttext-embedding-3-largeembeddingstext-embedding-3-smallembeddingsvoyage-3.5embeddingsvoyage-code-3embeddingsCohere Embed v4embeddingsGemini EmbeddingembeddingsQwen3-Embedding 8BembeddingsBGE-M3embeddingsjina-embeddings-v3embeddingsMistral EmbedembeddingsNomic Embed v1.5embeddings
Browse every model →
Works under your agent[04/04]

Point any agent here in one command.

Run npx layerx1 and pick your tools — the installer writes each config where the tool expects it, key and model included; GUI-configured tools get their exact paste-in values. No SDK, no code changes. The session below is the setup.

npx layerx1live session · replay
$ npx layerx1 Layer X1 · configure your coding agent Press enter to accept the [default]. Gateway URL: [https://api.layerx1.in] API key (lx1_…): lx1_•••••••••••• Default model: [lx1-gpt-oss-120b] Which tools? (comma-separated numbers, or 'all') 1. Claude Code · Anthropic /v1/messages 2. OpenAI Codex CLI · OpenAI Responses /v1/responses 3. Aider · OpenAI /v1/chat/completions (via LiteLLM) 4. Continue (VS Code / JetBrains) · OpenAI /v1/chat/completions 5. Cline (VS Code) · OpenAI /v1/chat/completions 6. Cursor · OpenAI /v1/chat/completions 7. Windsurf · OpenAI /v1/chat/completions Selection: [all] 1,2 Configuring → https://api.layerx1.in model=lx1-gpt-oss-120b ✓ Claude Code → wrote ~/.claude/settings.json • If you previously logged in to Claude, run `/logout` once so the gateway key is used. • Then just run `claude`. ✓ OpenAI Codex CLI → wrote ~/.codex/config.toml • Persist your key: export LAYERX1_API_KEY in your shell profile (setup offers to do this for you). • Codex requires the Responses API — Layer X1 serves /v1/responses. • Then run `codex`. Persist LAYERX1_API_KEY to your shell profile now? (Y/n) [Y] ✓ LAYERX1_API_KEY added to ~/.zshrc — restart your shell (or source it) to pick it up. Done. Run `npx layerx1 test` to verify the gateway.
Per-tool setup guides →
Put your agent on real infrastructure

Your agent doesn't change.
Everything underneath does.

$export ANTHROPIC_BASE_URL=https://api.layerx1.in

Start free · no card · Starter from $5/mo