Latest default-branch attempts, last successes, retained evidence, freshness
policy and repository activity for five reference frameworks. Test execution
and publication remain separate, with provenance and limitations visible without JavaScript.
Refresh completed; inspect evidence and publication states per repository·2026-10-21 11:53:58.931 UTC·Scheduled refresh: healthy
Latest trusted attempt, its execution result, durable publication state,
last success, and each required evidence scope's freshness and limitations.
Evidence class describes the test execution environment; it does not imply
that the application under test is owned or controlled. See each repository's
verification and limitations links for the target's operator and scope.
2/3 required scopes fresh · 5 latest scope records
verity.semantic-evaluation — failed; credentialed; quarterly_experiment_v1; completed 2026-10-21 07:19:46 UTC
6 pytest testcase(s) failed
Limitations: Counts are final pytest testcase outcomes; retries are not separately reported by pytest JUnit XML. JUnit testcase names and failure messages are omitted from the portfolio record.
verity.deterministic-py3.12.15 — fresh; hermetic; daily_gate_v1; completed 2026-10-21 05:43:44 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: Counts are final pytest testcase outcomes; retries are not separately reported by pytest JUnit XML. JUnit testcase names and failure messages are omitted from the portfolio record.
verity.failure-control-py3.12.15 — failed; hermetic; daily_gate_v1; completed 2026-10-21 05:44:04 UTC
1 pytest testcase(s) failed
Limitations: Counts are final pytest testcase outcomes; retries are not separately reported by pytest JUnit XML. JUnit testcase names and failure messages are omitted from the portfolio record.
verity.deterministic-py3.13.16 — fresh; hermetic; daily_gate_v1; completed 2026-10-21 05:43:41 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: Counts are final pytest testcase outcomes; retries are not separately reported by pytest JUnit XML. JUnit testcase names and failure messages are omitted from the portfolio record.
verity.semantic-smoke — fresh; credentialed; quarterly_experiment_v1; completed 2026-10-21 07:11:21 UTC
Optional quarterly bounded experiment; historical after a quarter plus scheduling margin, never substitutes for a daily required gate.
Optional quarterly bounded experiment; historical after a quarter plus scheduling margin, never substitutes for a daily required gate.
Limitations: Counts are final pytest testcase outcomes; retries are not separately reported by pytest JUnit XML. JUnit testcase names and failure messages are omitted from the portfolio record.
8/8 required scopes fresh · 12 latest scope records
api — fresh; controlled; daily_gate_v1; completed 2026-10-21 11:05:01.370 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: Native duration rounded to millisecond manifest precision. Target digest covers owned target files, seed implementation and dependency lock; target is co-versioned with the framework, not independently deployed.
e2e — fresh; controlled; daily_gate_v1; completed 2026-10-21 11:05:01.997 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: Native duration rounded to millisecond manifest precision. Target digest covers owned target files, seed implementation and dependency lock; target is co-versioned with the framework, not independently deployed.
visual — fresh; controlled; daily_gate_v1; completed 2026-10-21 11:05:39.060 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: Native duration rounded to millisecond manifest precision. Target digest covers owned target files, seed implementation and dependency lock; target is co-versioned with the framework, not independently deployed.
accessibility — fresh; controlled; daily_gate_v1; completed 2026-10-21 11:05:09.754 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: Native duration rounded to millisecond manifest precision. Target digest covers owned target files, seed implementation and dependency lock; target is co-versioned with the framework, not independently deployed.
selector-contract — fresh; controlled; daily_gate_v1; completed 2026-10-21 11:05:07.577 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: Native duration rounded to millisecond manifest precision. Target digest covers owned target files, seed implementation and dependency lock; target is co-versioned with the framework, not independently deployed.
cross-browser — fresh; controlled; daily_gate_v1; completed 2026-10-21 11:05:16.129 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: Native duration rounded to millisecond manifest precision. Target digest covers owned target files, seed implementation and dependency lock; target is co-versioned with the framework, not independently deployed.
evidence-negative-control — failed; hermetic; daily_gate_v1; completed 2026-10-21 11:03:05.656 UTC
Runner step outcome failure; 1 unexpected final native cases
Limitations: Native duration rounded to millisecond manifest precision. Hermetic fakes/probe are versioned in the tested source; no target service or browser is contacted.
framework-unit — fresh; hermetic; daily_gate_v1; completed 2026-10-21 11:03:57.400 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: Native duration rounded to millisecond manifest precision. Hermetic fakes/probe are versioned in the tested source; no target service or browser is contacted.
shared-app-ui — fresh; controlled; daily_gate_v1; completed 2026-10-21 11:05:09.338 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: Native duration rounded to millisecond manifest precision. Target digest covers owned target files, seed implementation and dependency lock; target is co-versioned with the framework, not independently deployed. Shared reference target is an independently pinned OCI image; the workflow checks readiness source and fixture before browser tests.
firefox-regression — fresh; controlled; daily_gate_v1; completed 2026-10-21 11:05:17.730 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: Native duration rounded to millisecond manifest precision. Target digest covers owned target files, seed implementation and dependency lock; target is co-versioned with the framework, not independently deployed.
webkit-regression — fresh; controlled; daily_gate_v1; completed 2026-10-21 11:05:12.704 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: Native duration rounded to millisecond manifest precision. Target digest covers owned target files, seed implementation and dependency lock; target is co-versioned with the framework, not independently deployed.
mobile-chrome-regression — fresh; controlled; daily_gate_v1; completed 2026-10-21 11:05:10.938 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: Native duration rounded to millisecond manifest precision. Target digest covers owned target files, seed implementation and dependency lock; target is co-versioned with the framework, not independently deployed.
5/5 required scopes fresh · 7 latest scope records
aria.container — fresh; controlled; daily_gate_v1; completed 2026-10-20 03:30:58 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: JUnit testcase names, parameters, failure text and environment values are omitted. Retries are counted only when native flakyFailure/flakyError elements are present. Native JUnit report bundle SHA-256: 7c768fb1e432cbf8c025ab25ced10bf0ad7963821db029314fed94bfb1006b15.
aria.contract — fresh; controlled; daily_gate_v1; completed 2026-10-20 03:33:30 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: JUnit testcase names, parameters, failure text and environment values are omitted. Retries are counted only when native flakyFailure/flakyError elements are present. Native JUnit report bundle SHA-256: 065f77d970e19ed109d4c7a57308041b924917a82f0024cfd9157cdee0d42455.
aria.pact-provider — fresh; controlled; daily_gate_v1; completed 2026-10-20 03:33:30 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: JUnit testcase names, parameters, failure text and environment values are omitted. Retries are counted only when native flakyFailure/flakyError elements are present. Native JUnit report bundle SHA-256: 23d98e96782af9dfe8b9935637fd42e37591d0f261fc796375453ee3444380b6.
aria.deterministic — fresh; controlled; daily_gate_v1; completed 2026-10-20 03:33:28 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: JUnit testcase names, parameters, failure text and environment values are omitted. Retries are counted only when native flakyFailure/flakyError elements are present. Native JUnit report bundle SHA-256: d938680bf976836d796143500394502b6333b5f211061566881f885f05515b67.
aria.evidence-failure-control — failed; controlled; daily_gate_v1; completed 2026-10-20 03:30:39 UTC
Native tests reported failing outcomes
Limitations: JUnit testcase names, parameters, failure text and environment values are omitted. Retries are counted only when native flakyFailure/flakyError elements are present. Native JUnit report bundle SHA-256: 6f0e63c0101df495eba5302fa369efc36ccccae2601821601ca1088f0dc81b21.
aria.live-smoke — skipped; credentialed; quarterly_experiment_v1; completed Not recorded
Live smoke was not requested for this workflow event.
Limitations: JUnit testcase names, parameters, failure text and environment values are omitted. Retries are counted only when native flakyFailure/flakyError elements are present.
aria.shared-app — fresh; controlled; daily_gate_v1; completed 2026-10-20 03:31:33 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: JUnit testcase names, parameters, failure text and environment values are omitted. Retries are counted only when native flakyFailure/flakyError elements are present. Native JUnit report bundle SHA-256: 6cbe7dd9546baf43b3a070077b469602b165e034f5e9269803a89652e6abfef6.
4/4 required scopes fresh · 6 latest scope records
framework-quality — fresh; hermetic; quarterly_experiment_v1; completed 2026-10-21 09:02:12 UTC
Optional quarterly bounded experiment; historical after a quarter plus scheduling margin, never substitutes for a daily required gate.
Optional quarterly bounded experiment; historical after a quarter plus scheduling margin, never substitutes for a daily required gate.
Limitations: Surefire XML contains aggregate outcomes only; testcase names, parameters, traces and environment values are intentionally omitted. Native Surefire XML SHA-256: aed784ddd8f33dd4a99f0c791e40b663cdc22821f5d9ffd2820b424021d4c347
evidence-negative-control — failed; hermetic; quarterly_experiment_v1; completed 2026-10-21 09:02:45 UTC
The native runner failed, reported failing cases, or selected no substantive cases.
Limitations: Surefire XML contains aggregate outcomes only; testcase names, parameters, traces and environment values are intentionally omitted. Native Surefire XML SHA-256: 268f3f3fc4ea8b4c627db280e6bd4196f7da3392d0e9652aa635c96f7a7752a4
ui.CHROME — fresh; controlled; quarterly_experiment_v1; completed 2026-10-21 09:04:24 UTC
Optional quarterly bounded experiment; historical after a quarter plus scheduling margin, never substitutes for a daily required gate.
Optional quarterly bounded experiment; historical after a quarter plus scheduling margin, never substitutes for a daily required gate.
Limitations: Surefire XML contains aggregate outcomes only; testcase names, parameters, traces and environment values are intentionally omitted. SauceDemo is vendor-managed; this run did not discover an application release or fixture revision. Native Surefire XML SHA-256: 734f613c1b41dde166f9d84cac7e12c2660de3bf395f8a7bec001d5b7350f4b9
ui.EDGE — fresh; controlled; quarterly_experiment_v1; completed 2026-10-21 09:04:29 UTC
Optional quarterly bounded experiment; historical after a quarter plus scheduling margin, never substitutes for a daily required gate.
Optional quarterly bounded experiment; historical after a quarter plus scheduling margin, never substitutes for a daily required gate.
Limitations: Surefire XML contains aggregate outcomes only; testcase names, parameters, traces and environment values are intentionally omitted. SauceDemo is vendor-managed; this run did not discover an application release or fixture revision. Native Surefire XML SHA-256: c8b29014ba9b7b784fe3c4d03d9333f3e240873dcadbfab7d966cb7396297ed7
ui.FIREFOX — fresh; controlled; quarterly_experiment_v1; completed 2026-10-21 09:05:07 UTC
Optional quarterly bounded experiment; historical after a quarter plus scheduling margin, never substitutes for a daily required gate.
Optional quarterly bounded experiment; historical after a quarter plus scheduling margin, never substitutes for a daily required gate.
Limitations: Surefire XML contains aggregate outcomes only; testcase names, parameters, traces and environment values are intentionally omitted. SauceDemo is vendor-managed; this run did not discover an application release or fixture revision. Native Surefire XML SHA-256: 9a64cc1464f57322dfb73eeb479b8288eb50865bc295064441020bc0103b5e70
cloud.browserstack.CHROME — skipped; credentialed; quarterly_experiment_v1; completed Not recorded
Cloud-grid credentials are not configured; no browser session was attempted.
Limitations: Surefire XML contains aggregate outcomes only; testcase names, parameters, traces and environment values are intentionally omitted. SauceDemo is vendor-managed; this run did not discover an application release or fixture revision.
2/2 required scopes fresh · 2 latest scope records
k6.articles-load — fresh; scheduled_load; daily_gate_v1; completed 2026-10-21 09:31:00.902 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: Performance metrics are workload measurements, not test-case outcomes. Threshold outcomes are derived from the framework summary; raw k6 output must be retained separately for full reanalysis.
k6.authenticated-journey — fresh; scheduled_load; daily_gate_v1; completed 2026-10-21 09:31:11.446 UTC
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Daily deterministic workflow; one missed daily slot plus twelve hours of delay remains visible.
Limitations: Performance metrics are workload measurements, not test-case outcomes. Threshold outcomes are derived from the framework summary; raw k6 output must be retained separately for full reanalysis.
