Skip to content
Observability and audit

A record of what every agent did, and why it was allowed.

Follow any agent request by request: prompts, answers, models, tools, cost and every policy decision. Hand auditors signed evidence packs, and stream the same records to the tools your security and data teams already use.

The problem

Uptime dashboards don’t answer an auditor’s questions.

Logs without decisions

Request logs show that a call happened, not which policy allowed it or why.

Evidence by screenshot

Audit preparation means weeks of exports, screenshots and spreadsheets.

Records in silos

Security, data and compliance teams each want the records in their own system.

Clovie records the decision with the request, keeps an immutable trail and makes every record exportable, so evidence comes from what happened rather than from what someone remembered.

How it works

One trail from request to audit, exported wherever your teams already look.

SourcesClovie gatewayevery requestYour gatewayscallout or OTLPDirect codeclovie-observe SDKRecordsAgent runstraces with stepsAudit logevery decisionChange logbefore and afterSecurity eventssign-ins, rolesEvidenceEvidence packssigned, by frameworkSIEM streamSplunk, Datadog, OCSFData lakeimmutable filesSourcesClovie gatewayevery requestYour gatewayscallout or OTLPDirect codeclovie-observe SDKRecordsAgent runstraces with stepsAudit logevery decisionChange logbefore and afterSecurity eventssign-ins, rolesEvidenceEvidence packssigned, by frameworkSIEM streamSplunk, Datadog, OCSFData lakeimmutable files

See it at work

Product tour · demo data
Clovie · Activity · Audit log
Audit log
TimeAgentModelDecision
14:02:11Card Dispute Triagegpt-4oDeny
14:01:58Fraud Alert Triageclaude-sonnet-4.5Allow
Decision403 policy_denied
Policy
Card numbers stay out of prompts
Mode
Enforcing
Reason
Card number found in the prompt
Provider call
Not made
Request
UserCustomer disputes a charge on card [CARD-1]. Draft a reply.
Clovie · Compliance · Evidence packs
Evidence pack
Export
Audit record
Agent
Card Dispute Triage
Decision
Deny
Policy version
v3, enforcing
Recorded
14:02:11 UTC
OSFI E-23 · last 30 days
PDF
summary.pdfOverview of the period
JS
decisions.jsonEvery decision, each signed (Ed25519)
JS
osfi_e23_control_crosswalk.jsonDecisions mapped to OSFI E-23 controls
#
manifest.jsonSHA-256 of every file, and the public key
Checksums and signatures verified
Key capabilities

What you get

Agent runs and traces

Every request with its prompt and answer, the model requested and the model used, tool calls, child calls from sub-agents, duration, usage, cost and policy steps.

Audit log

Every policy decision with the agent, the policy version, the decision and the reason.

Change log

Who changed which governance setting, with the values before and after.

Security events

Sign-ins, role and membership changes and administrative changes, in a separate log.

Signed evidence packs

Choose a period of up to 90 days and a framework; packs carry checksums and signatures an auditor can verify.

Stream to your SIEM

OTLP over HTTP or gRPC, Splunk HEC, Datadog, webhooks, syslog and AWS Security Lake in OCSF.

Also in this layer

CapabilityWhat it does
Data lake exportCompressed JSON lines to S3, Cloud Storage or Blob Storage, written once with checksums for object-lock buckets.
Incidents and feedbackTrack AI incidents with root cause, collect ratings on runs and turn bad answers into eval cases.
Retention you controlChoose whether prompts and responses are stored and for how long; sensitive data is masked first.
Frameworks

Controls mapped to the frameworks you answer to

  • SOC 2: SOC 2 Type II trust services criteria
  • NIST AI RMF: NIST AI Risk Management Framework
  • EU AI Act: EU Artificial Intelligence Act
  • ISO/IEC 42001: ISO/IEC 42001 AI management system
  • OSFI E-23: OSFI Guideline E-23, model risk management (Canada)
Deployment

Runs wherever Clovie runs

  • SaaS
  • Customer VPC
  • On-premises
  • Air-gapped

Every record stays in your database in self-hosted modes. Datadog export isn’t available in air-gapped installs; syslog is self-hosted only.

Questions

Questions

Can audit records be changed?

Not from the product. Audit records can’t be edited or deleted, and evidence packs can be verified independently.

Do you store prompts and answers?

Only if your administrators choose to, for as long as they choose. Sensitive data is masked before storage.

Which frameworks can an evidence pack cover?

SOC 2 Type II, NIST AI RMF, the EU AI Act, OSFI E-23 and ISO/IEC 42001.

Can we see traffic from gateways that aren’t Clovie’s?

Yes. Calls reported by connected gateways appear in agent runs, labelled with the gateway that observed them.

Don’t wait for the incident report to find out what happened.

See observability and audit on your own agents, in the deployment you need.