# The inference control plane (/concepts/overview)



An agent does not send one prompt. It sends thousands, and most of them are nearly identical. The system instructions, the tool registry, the response schema, the repository policy, the long-lived documents, the conversation so far: that bulk is stable. What changes between calls is a short suffix at the end. Every time the stable part is re-tokenized and re-prefilled, the customer pays again, in latency and in tokens, for work that was already done.

Zumik is the control plane that sits over that pattern. It does not try to be a faster inference engine or a cheaper model marketplace. It measures how much of your input is genuinely reusable, gives you stable references for the reusable parts, routes each request to the cheapest reliable path, records exactly how that routing decision was made so it can be reproduced, and produces signed evidence when you delete data.

## The five jobs [#the-five-jobs]

<CardGroup cols="1">
  <Card title="Measure reuse honestly" icon="ruler">
    A repeated prefix is not a cache hit. Zumik reports reuse *opportunity* and *realized capture* as separate numbers, each tagged with an evidence level, so a prediction is never mistaken for a fact.
  </Card>

  <Card title="Preserve state as a first-class object" icon="layer-group">
    Reusable inputs become artifacts, bundles, sessions, branches, and snapshots: a small set of objects with explicit immutability and ordering rules, not opaque cache keys.
  </Card>

  <Card title="Route to the cheapest reliable path" icon="route">
    Managed providers by default, with BYOK and BYOC as evidence-backed escalations. One scheduler owns replica selection per profile; provider-native caching does the heavy lifting before you ever self-host.
  </Card>

  <Card title="Reproduce every decision" icon="rotate">
    Aliases resolve through immutable releases. Snapshots pin ordering and compiler versions. A response pins one snapshot and one alias release, so any past routing decision can be replayed.
  </Card>

  <Card title="Prove deletion" icon="shield-check">
    Delete revokes access; purge removes retained representations and returns a signed receipt with a guarantee class that never exceeds what the underlying profile can actually deliver.
  </Card>
</CardGroup>

## Two surfaces, one engine [#two-surfaces-one-engine]

You reach the control plane through either of two public APIs over the same internal execution system.

| Surface | Purpose                                                               | Shape                                             |
| ------- | --------------------------------------------------------------------- | ------------------------------------------------- |
| `/v1`   | Migrate an existing OpenAI integration with one base-URL change       | Byte-for-byte OpenAI request and response objects |
| `/v2`   | Use explicit state, branching, replay, purge, QoS, and rich telemetry | Native Zumik objects with opaque handles          |

Proprietary behavior never leaks into `/v1` JSON. It rides on optional headers, or it lives on `/v2`. A client that sends no Zumik headers still gets correct OpenAI behavior. See [API surfaces](/concepts/api-surfaces) for the boundary rules.

## The idea that holds it together [#the-idea-that-holds-it-together]

The single most important distinction in the platform is that **logical state is not physical KV state**. Two requests can reference the same logical artifact and still need entirely different physical caches, because a different tokenizer, a different quantization, or a different region all break KV compatibility while leaving the logical content untouched.

Keeping these layers apart is what lets handles stay stable and opaque while caches churn underneath. It is worth reading [the identity model](/concepts/identity-model) before anything else.

## Where the concepts connect [#where-the-concepts-connect]

<CardGroup cols="2">
  <Card title="Reuse metrics" icon="chart-mixed" href="/concepts/reuse-metrics">
    Opportunity vs. realized reuse, and the five evidence levels.
  </Card>

  <Card title="Workload Reuse Score" icon="gauge" href="/concepts/workload-reuse-score">
    The six-component score and the separate deployment-readiness score.
  </Card>

  <Card title="Identity model" icon="diagram-project" href="/concepts/identity-model">
    Logical, materialization, and KV-realization layers.
  </Card>

  <Card title="Artifacts" icon="cube" href="/concepts/artifacts">
    Immutable reusable content units and their types.
  </Card>

  <Card title="Bundles" icon="boxes-stacked" href="/concepts/bundles">
    Ordered, immutable lists of artifacts.
  </Card>

  <Card title="Sessions" icon="comments" href="/concepts/sessions">
    Causal state containers for an agent workflow.
  </Card>

  <Card title="Branches" icon="code-branch" href="/concepts/branches">
    Append-only event lines with optimistic concurrency.
  </Card>

  <Card title="Snapshots" icon="camera" href="/concepts/snapshots">
    Compiled logical state pinned to a branch head.
  </Card>

  <Card title="Handles and fingerprints" icon="fingerprint" href="/concepts/handles-and-fingerprints">
    Opaque public IDs vs. internal tenant-scoped HMACs.
  </Card>

  <Card title="Model aliases" icon="tag" href="/concepts/model-aliases">
    Reproducible aliases and immutable releases.
  </Card>

  <Card title="Agent Hints" icon="lightbulb" href="/concepts/agent-hints">
    The vendor-neutral intent contract.
  </Card>

  <Card title="QoS" icon="stopwatch" href="/concepts/qos">
    Classes, requests, and formal outcome objects.
  </Card>

  <Card title="Execution profiles" icon="server" href="/concepts/execution-profiles">
    Managed, BYOK, BYOC, hybrid, and fallback.
  </Card>

  <Card title="Capability manifests" icon="clipboard-list" href="/concepts/capability-manifests">
    Per-provider capability records that gate routing and purge.
  </Card>

  <Card title="Retention and purge" icon="trash-can" href="/concepts/retention-and-purge">
    Delete vs. purge, guarantee classes, and resurrection prevention.
  </Card>

  <Card title="API surfaces" icon="code" href="/concepts/api-surfaces">
    The `/v1` and `/v2` contract and the extension rule.
  </Card>
</CardGroup>

<Note>
  New to the product? Start at the [Quickstart](/), then read the identity model and reuse metrics. Everything else builds on those two.
</Note>
