ovirt-api-simulator/docs/testing.md

Language / Язык: English | Русский

Testing

How to run the laboratory test matrix and what the last full run reported.

Commands

Target	What it runs
make test	Offline unit + contract (no live Engine)
make test-unit	Unit tests under tests/
make test-contract	Contract-pack checks
make test-integration	PostgreSQL-backed Engine integration
make test-versions	Seeded assertions across series packs
make smoke	Auth + list VMs against the running stack
make test-pulumi-smoke	Pulumi smoke (3.6 + 4.5 sample)
make pulumi-tests	Full Pulumi contract matrix (all series × ops + HEAD)
make lint / CI critical lint	Ruff (CI uses E9,F63,F7,F82 only)
make helm-template	Render Helm chart

Full local gate used before release:

make up-local   # or make up
make seed
make smoke
make test
make test-unit
make test-contract
make test-integration
make test-versions
make pulumi-tests

Pulumi HTML report: pulumi-tests/reports/pulumi-contract-coverage.html
(gitignored — regenerated each run). Details: pulumi-tests/README.md.

Last verified full run

Date: 2026-07-18

Suite	Result	Notes
helm lint / helm-template	PASS
make test (offline)	PASS
make test-unit	PASS
make test-contract	PASS
make up-local / seed / smoke	PASS
make test-integration	PASS
make test-versions	PASS
CI critical lint	PASS
make pulumi-tests	PASS	9150 / 9150

Pulumi contract matrix

Metric	Value
total	9150
passed	9150
failed	0
skipped	0

Methods: DELETE 1146 · GET 2314 · HEAD 2314 · POST 2230 · PUT 1146

HTTP status histogram: 200: 6739 · 404: 1514 · 201: 864 · 400: 22 · 409: 11
(no 401, no 5xx)

Series covered: 3.0–3.6, 4.3–4.5, master (all green).

Pass means every contract route is reachable with a handled Engine status and required body checks — not bit-identical behaviour to production RHV hardware.