ZeeshanSaud/CodeTruthAgent-V3-Module1-Evaluation

Source Code

https://github.com/Zeeshan78699/CodeTruthAgent — tag v3.0.0-module1

CodeTruth Agent V3 — Module 1 Evaluation

Validation results for Module 1: Repository Cognition Engine — a deterministic, rule-based engine that scans a software repository and determines its application type, primary framework, technology stack, and file inventory.

What's in this dataset

• —FULL_DOMAIN_SUMMARY.md — summary table of all 69 validated repositories
• —FULL_DOMAIN_SUMMARY.json / .csv — same data in structured form
• —69 individual per-repository scan reports (.md)

Validation Results

69 repositories scanned
69/69 = 100% discovery score
69/69 = correct application type
69/69 = correct primary framework (or correctly "No Framework Detected")
69/69 = governance gate APPROVED
 0/69 = crashes
 0/69 = skipped
57/69 = 100% classification score
12/69 = 75% classification score ("No Framework Detected" — correct
        by design for non-Python system software)
39 distinct application types covered
441,660 total files scanned
35/35 unit tests pass

Repository sizes ranged from 35 files (python-sgp4) to 61,850 files (Zephyr RTOS), including non-Python repositories (Redis, Nginx, Go, Rust, U-Boot).

Notes

"No Framework Detected" is a genuine, correct result for repositories with no Python package framework dependency — it is not an error or a gap.

Source Code

github.com/Zeeshan78699/CodeTruthAgent — tag v3.0.0-module1

Author

Zeeshan Saud — Independent AI Researcher, UAE