Technology

    How Trussed works

    LiteLLM-level proxy capabilities, OpenRouter-grade routing, and a governance layer neither was designed to provide.

    Everything you'd expect from a production AI proxy

    Trussed is on par with LiteLLM's proxy feature set, with the governance and compliance layer enterprises need in production.

    Unified API across 100+ models

    One interface across OpenAI, Anthropic, Google, Bedrock, Azure, Mistral, Llama, and more

    Drop-in proxy

    Swap your base URL, zero code changes

    Load balancing and failover

    Automatic failover when a provider degrades

    Cost-based routing

    Route to the most cost-effective model that meets quality requirements

    Rate limiting

    Per-key, per-team, and per-workflow enforcement

    Real-time spend tracking

    Per-request token and dollar metering across all providers

    Semantic caching

    Reduce redundant API calls on repetitive workloads

    Streaming support

    Full streaming across all connected providers

    SDK support

    Python, TypeScript, Go, and REST API

    What open-source proxies weren't built to do

    LiteLLM and OpenRouter solve routing. Trussed adds the governance layer regulated enterprises need before they can run AI in production.

    Runtime policy enforcement

    Policies evaluated before execution, not logged after

    Agentic and MCP governance

    Pre-execution authorization of every tool call and workflow trigger

    Automated audit evidence

    Tamper-resistant records per interaction with full lineage

    Regulatory compliance

    HIPAA, NIST AI RMF, EU AI Act, SR 11-7, NAIC enforced at runtime

    Data protection

    PII detection, masking, and redaction before data reaches models

    Shadow AI visibility

    Discover and govern unsanctioned AI across your organization

    Integrate in minutes

    For Developers

    Built for developers

    Integrate in minutes with our SDKs. Just swap your API endpoint, Trussed works as a drop-in proxy with zero changes to your application code.

    PythonTypeScriptGoREST API
    index.ts
    import trussed from "@trussed/sdk";
    const client = trussed.init({
    apiKey: process.env.TRUSSED_API_KEY,
    });
    // Route through Trussed with built-in policies
    const response = await client.chat.completions.create({
    model: "gpt-4",
    messages: [{ role: "user", content: prompt }],
    policies: ["pii-redaction", "cost-limit"],
    });

    Compatible with any app already calling OpenAI, Anthropic, or any major provider. Change your base URL. Keep everything else.

    SOC 2 Type II
    HIPAA
    GDPR
    NIST AI RMF
    EU AI Act
    ISO 27001

    See it running in your environment

    Bring your current model setup. We'll show you what Trussed adds in 20 minutes.