RiskProof

Stop sensitive data from leaving through AI tools, and see where it came from.

RiskProof tracks cross-tool data flows and blocks sensitive tool output in DeepSeek Harness.
A persistent security beacon shows redacted execution receipts. Deterministic rules need no extra LLM calls.

English · 简体中文

Try the rules before setting up DSH

With Node.js 22.19+, run four synthetic protection examples:

npx --yes [email protected] riskproof-demo --language en

No DSH profile, model API key or repository checkout is needed. npm downloads the
package; the installed rehearsal runs locally with the default balanced policy.
It checks web-influenced commands, customer data egress, changed tool schemas and
read-only task restrictions. All four should show ✓ and deny. Use --json for
structured results. This demonstrates the rules; it does not activate protection
or validate your configuration. Install into DSH below to protect real tool calls.

Quick Start

Requires Node.js 22.19+, with DSH and pnpm installed:

dsh plugin --profile web add [email protected]
dsh --profile web --dump-config

Confirm the output includes name: dsh-riskproof, restart the Web profile, and click
its security beacon. Then enter this directly in the conversation composer:

/riskproof demo

Four isolated rehearsals show web content influencing a command, customer data transfer,
a tool schema change and a read-only restriction. They use synthetic inputs, read no private files, run no shell commands,
send no email, and do not enter live protection counts. RiskProof's rules and direct slash
commands make no extra model calls; ordinary DSH model usage keeps its normal cost.

See installation and troubleshooting for the complete steps.

Newer DSH versions require separate verification. See validation evidence
for the historical 0.1 results and the v0.7 validation record for the current release.

Start here

See protection beside your conversation

A persistent RiskProof security beacon sits beside the DSH conversation. Ordinary tool
calls update it automatically. Click to open a compact overview; activity never opens it for you.

• Waits honestly for tool activity; there is no continuous simulated scan.
• Shows pending execution receipts and briefly acknowledges newly checked calls.
• Displays a call-distribution ring, the last 24 checks and up to three recent risk chains.
• Follows the selected conversation and removes stale charts when its connection is unavailable.
• Separates initial sync from disconnection, offers manual reconnect, and displays task scope and record limits.

Real DSH Web screenshots; a local test model produced these records through the actual
Agent/tool pipeline. Normal use does not require a rehearsal.

The chart counts calls with no triggered risk, calls blocked by RiskProof, and calls needing
attention. It does not invent a safety score. Observe mode, disabled recording and disabled
detection features are identified. Counts cover retained records in the current plugin run.
Not triggering a rule does not establish that an operation is safe.

Commands remain secondary entries; long output is collapsed by default:

The model can also call the read-only riskproof_report tool. The beacon reads redacted
statistics through DSH's authenticated connection about once per second while the page is
visible. It makes no model requests and creates no tool records. The beacon, overview and command/tool text follow
experience.language: zh-CN (default) or en.

See configuration gaps and what to do next

Expand Protection checks in the beacon overview, or run /riskproof doctor to inspect
execution mode, evidence recording, provenance, label propagation, chain detection,
credential output protection and effective rule posture. Explicit overrides that relax a
strict preset remain visible. Recent risk cards also explain the next step.
These are read-only configuration checks, with no test tool dispatch, credential reads or
extra activity counts. See the protection checks guide.

Preview before executing

Use /riskproof test send_email {"to":"[email protected]","body":{"refreshToken":"synthetic-example"}}
with a tool registered in your session. See the policy verdict, labels and matched rules
using current task restrictions and retained provenance. It makes no tool call, adds no receipt
and never updates the tool identity baseline. Use synthetic inputs; results exclude arguments.
Other plugins, host approval and actual output are outside the preview.

Opaque OAuth tokens, TOTP secrets and private keys in exact nested credential fields now
receive sensitive labels even without a provider-specific prefix. Detected output labels
survive trusted declassification. See policy previews and credential fields.

What RiskProof answers

Most tool-permission plugins answer one question: is this tool allowed?

RiskProof answers a different one:

Where did the data in this tool call come from, what did it flow through, and where is it about to go?

A single tool call is usually safe. The composition is not.

web_fetch          ← UNTRUSTED_WEB
   │
database_query     ← CUSTOMER_DATA
   │
send_email         ← external destination
   │
RiskProof → DENY   (evidence-backed, before the side effect)

Why RiskProof

RiskProof is a layer over the DSH Tool Runtime, not another Agent Runtime. It never re-implements tool dispatch, approval, or lifecycle — it observes and decides.

Local build and configuration

Alternatively, build a local package from the repository root:

# build and install from this checkout
npm ci
mkdir -p artifacts
npm pack --pack-destination artifacts
dsh plugin --profile web add ./artifacts/dsh-riskproof-0.7.0.tgz

# confirm the bundled patch was composed
dsh --profile web --dump-config

The package declares a DSH bundle, so plugin add composes its riskproof row automatically. No second install or manual row is required. Restart the profile to see the beacon, then click it to inspect the current conversation.

The current version is 0.7.0. See installation and update instructions. Installation, SDK host startup,
commands, tool execution and HTTP transport have been verified on DSH 0.1.0-rc.7, 0.1.2-rc.1 and 0.2.1-rc.4.
Chrome desktop and narrow-viewport Web acceptance also passed on DSH 0.1.2-rc.1 and 0.2.1-rc.4,
including provenance and read-only denials through the real Agent loop with a local
simulated model. See the current validation record.

To tune it, override the bundled row from the profile's later cordis.patch.yml layer:

- id: riskproof
  config:
    experience:
      language: en           # zh-CN (default) | en; beacon and reports
    mode: enforce            # enforce | observe
    policy:
      preset: balanced         # permissive | balanced | strict
      internalDomains: [acme.internal]
      blockedDomains: [collector.evil.example]
      # allowedExternalDomains: [api.approved.example]
    classification:
      overrides:
        gmail_send: [EXTERNAL_ACTION]
        company_db: [PRIVATE_ACCESS]
    output:
      blockedTaints: [SECRET, API_KEY]
      # trustedDeclassifiers: { approved_redactor: [PII] }

See docs/configuration.md for the full reference.

See it work

sequenceDiagram
    participant A as Agent
    participant T as DSH ToolRuntime
    participant R as RiskProof

    A->>T: web_fetch(url)
    T->>R: tools/pre-execute
    R-->>T: allow (EXTERNAL_INGESTION recorded)
    T-->>A: untrusted content

    A->>T: database_query(sql)
    T->>R: tools/pre-execute
    R-->>T: ask (operator approves private access)
    T-->>A: CUST-8842 balance 125000

    A->>T: send_email(to=external, body=CUST-8842…)
    T->>R: tools/pre-execute
    R-->>T: DENY — ingestion + private access + sensitive data + external action
    T-->>A: Error: <reason>

The same flow is reproduced as a deterministic regression test in tests/security/attack-chain.test.ts.

Try it locally with no model or profile — a real DSH ToolRuntime pipeline with three mock tools:

npm run demo

See demo/README.md.

Features

Track data origin

Know where tool inputs came from. RiskProof maps arguments back to the tool results that produced them.

Follow sensitive data

Carry security labels — UNTRUSTED_WEB, CUSTOMER_DATA, PII, SECRET, … — across tool calls, additively.

Control sensitive output

Inspect model-facing results in tools/post-execute; block SECRET and API_KEY output by default before it enters model context.

Declassify through pinned tools

Let exact operator-approved tools remove selected inherited labels. Labels detected in the returned value are always restored, so a redactor must actually remove the sensitive data.

Detect attack chains

Identify the EXTERNAL_INGESTION → PRIVATE_ACCESS → EXTERNAL_ACTION pattern that single-tool checks miss.

Stop before execution

Block or ask before the side effect runs, through the native tools/pre-execute gate.

Guard sensitive surfaces

Gate credential-file paths, high-confidence destructive commands, download-and-execute pipelines, blocked destinations, and credentials embedded in network-capable commands.

Adapt without rewriting rules

Start with the default balanced preset, roll out with permissive, or use strict; every configurable decision can still be overridden individually.

Explain every decision

Generate structured, privacy-preserving security evidence and actionable remediation for every decision. Keep proofs in memory or append them to an operator-controlled JSONL file.

How it works

RiskProof hooks the native DSH tool pipeline:

tools/pre-execute
    │  capability classification
    │  argument provenance mapping
    │  taint analysis
    │  toolchain state (EIT → PAT → NAT)
    │  deterministic policy evaluation
    ▼
allow / ask / deny   (monotonic with other plugins)
    │
tool execute
    │
tools/post-execute
    │  output taint evaluation
    │  trusted declassification
    ▼
accept / block
    │
tools/result
    │  update ContextTracker
    │  update Toolchain state
    ▼  record execution evidence

• Classification is deterministic (tool name + description + schema), configurable, and never uses an LLM.
• Provenance uses exact and bounded substring matching over a per-session context index.
• Taint is additive; only an exact operator-approved declassifier can remove selected inherited labels.
• Decisions are deterministic, explainable, and testable.

See docs/architecture.md.

Security boundaries

RiskProof protects supported observable tool-call flows through DSH:

• DSH tool calls through the supported tools/pre-execute / tools/post-execute / tools/result paths
• supported observable provenance (exact / bounded substring matching)
• configured sensitive flows and cross-tool attack patterns

RiskProof does not replace:

• OS sandbox / process isolation
• network firewall / SSRF protection
• endpoint security / malware scanning
• credential vaults
• full semantic DLP

See docs/security-model.md for the complete threat model and known limitations.

Documentation

See the documentation index for guides, security design and version records.

• Use: Installation · Configuration · Web acceptance
• Develop: Architecture · Development
• Security: Security model · Provenance & taint · Toolchain

Roadmap

v0.2 (delivered)

• DSH-native runtime (tools/pre-execute, tools/result)
• Provenance + taint tracking
• Cross-tool EIT → PAT → NAT detection
• Privacy-preserving proof with optional JSONL persistence
• Policy presets, sensitive-path gates, deterministic command-risk checks, and egress domain policy
• Remediation guidance and per-rule proof statistics

v0.3 (delivered)

• Native security receipts, provenance timeline, bilingual reports and safe rehearsals
• Tool metadata continuity: description and input/output schema fingerprints
• Operator-selected task contracts: standard / read-only / local-only
• Execution-token correlation between policy gates and final results
• Taint inheritance through intermediate tools; bounded, isolated session state

v0.4 (delivered)

• Output-side information-flow control before results reach model context
• Default credential-output blocking with configurable label selection
• Exact-name trusted declassifiers with deterministic re-tainting
• Redacted output-control and declassification receipts

v0.5–v0.6 (delivered)

• Bilingual protection checks and actionable configuration guidance
• Structured credential field detection and side-effect-free policy previews

v0.7 (current)

• Terminal rehearsal without a DSH profile or model setup
• First-use command guidance in the Web overview
• DSH 0.2 compatibility in the real-host validation matrix
• Weekly public download snapshots with explicit comparison windows

Later

• Richer structured/semantic DLP adapters
• Cross-process provenance with explicit trust boundaries
• More real-world tool mappings and reproducible false-positive cases

Choosing alongside auto-review

These use different host hooks. Joint use still needs plugin-order and host-version testing;
combined acceptance has not been verified. RiskProof covers observable, matchable flows and
configured rules; see the security model.

Contributing

Issues, rule submissions, tool-capability mappings, and false-positive reports are welcome. See CONTRIBUTING.md.

See the growth and iteration plan for current gaps, public
measurement and the next priorities.

If RiskProof helps you, a GitHub star helps others discover it.
Installation feedback, redacted false-positive reports and tool mappings help improve it too.

Security reporting

Please report vulnerabilities privately. See SECURITY.md.

License

Apache-2.0