This is the technical reference for Visdom Testing. It covers the full layered testing architecture, each testing layer in detail, configuration options, metrics framework, and evaluation methodology.
✅ Looking for the guide?
If you're evaluating Visdom Testing, start with the role-specific guides: For Leaders, For Platform Engineers, or For Developers.
Architecture
Layers
ArchUnit rules as executable architecture constraints. Deterministic. Immune to AI regression. 10/10 violations prevented.
jqwik properties with 1000+ inputs per property. Breaks the circular test problem. Finds computation bugs that 90% coverage misses.
PIT mutation testing + AI-augmented mutant generation. The true measure of test effectiveness. Mutation score over coverage.
Pact consumer-driven contracts. Cross-service verification without full integration environments. API compatibility guaranteed.
Output & Intelligence
Quality Dashboard
Mutation score trends, flake rate tracking, defect escape rate, per-layer health indicators.
CI Integration
GitHub Actions workflow, test selection, parallelization, feedback time optimization.
Configuration & Metrics
Configuration
visdom-testing.yaml reference, layer toggles, thresholds, CI pipeline setup.
Metrics Framework
Mutation score, TORS, defect escape rate, flake rate, per-layer metrics with benchmarks.
Evaluation Methodology
How to measure testing effectiveness. Ground truth framework, A/B methodology, industry benchmarks.