Apppublic

MonikaDvorackova/agent-reliability-lab

sourceHugging Faceupdated 1mo agoView on Hugging Face

0likes

App README

Agent Reliability Lab

Interactive static laboratory for analyzing observable reliability and failure-mode signals in AI agent execution traces.

What it analyzes

The current prototype detects signals including:

—repeated tool calls and possible loops
—explicit execution failures
—missing observations
—unsupported final answers
—missing verification behaviour
—explicit planning
—potentially overconfident conclusions

Implementation

The application runs entirely in the browser using HTML, CSS and JavaScript.

No server-side compute, external API or LLM is required.

Scope

The application analyzes only observable execution traces supplied by the user.

It does not inspect private reasoning or hidden chain-of-thought.

The reliability score is a deterministic heuristic engineering signal and should not be interpreted as a calibrated measure of correctness, safety or production reliability.

License

Apache-2.0

Associated dataset

This Space is accompanied by the public Hugging Face dataset:

MonikaDvorackova/agent-reliability-traces

The dataset contains synthetic observable agent execution traces annotated with reliability-risk labels and failure-mode signals.

It can be used to test and extend the deterministic heuristics implemented in this Space.