inecs
9c94df119b
Add EN/RU testing guides, link them from README and docs indexes, and drop stale native Python/Ansible/Terraform suite references.
73 lines
2.1 KiB
Markdown
73 lines
2.1 KiB
Markdown
**Language / Язык:** [English](testing.md) | [Русский](ru/testing.md)
|
||
|
||
# Testing
|
||
|
||
How to run the laboratory test matrix and what the last full run reported.
|
||
|
||
## Commands
|
||
|
||
| Target | What it runs |
|
||
|---|---|
|
||
| `make test` | Offline unit + contract (no live Engine) |
|
||
| `make test-unit` | Unit tests under `tests/` |
|
||
| `make test-contract` | Contract-pack checks |
|
||
| `make test-integration` | PostgreSQL-backed Engine integration |
|
||
| `make test-versions` | Seeded assertions across series packs |
|
||
| `make smoke` | Auth + list VMs against the running stack |
|
||
| `make test-pulumi-smoke` | Pulumi smoke (3.6 + 4.5 sample) |
|
||
| `make pulumi-tests` | Full Pulumi contract matrix (all series × ops + HEAD) |
|
||
| `make lint` / CI critical lint | Ruff (CI uses `E9,F63,F7,F82` only) |
|
||
| `make helm-template` | Render Helm chart |
|
||
|
||
Full local gate used before release:
|
||
|
||
```bash
|
||
make up-local # or make up
|
||
make seed
|
||
make smoke
|
||
make test
|
||
make test-unit
|
||
make test-contract
|
||
make test-integration
|
||
make test-versions
|
||
make pulumi-tests
|
||
```
|
||
|
||
Pulumi HTML report: `pulumi-tests/reports/pulumi-contract-coverage.html`
|
||
(gitignored — regenerated each run). Details: [`pulumi-tests/README.md`](../pulumi-tests/README.md).
|
||
|
||
## Last verified full run
|
||
|
||
**Date:** 2026-07-18
|
||
|
||
| Suite | Result | Notes |
|
||
|---|---|---|
|
||
| `helm lint` / `helm-template` | PASS | |
|
||
| `make test` (offline) | PASS | |
|
||
| `make test-unit` | PASS | |
|
||
| `make test-contract` | PASS | |
|
||
| `make up-local` / `seed` / `smoke` | PASS | |
|
||
| `make test-integration` | PASS | |
|
||
| `make test-versions` | PASS | |
|
||
| CI critical lint | PASS | |
|
||
| `make pulumi-tests` | PASS | **9150 / 9150** |
|
||
|
||
### Pulumi contract matrix
|
||
|
||
| Metric | Value |
|
||
|---|---:|
|
||
| total | 9150 |
|
||
| passed | 9150 |
|
||
| failed | 0 |
|
||
| skipped | 0 |
|
||
|
||
**Methods:** DELETE 1146 · GET 2314 · HEAD 2314 · POST 2230 · PUT 1146
|
||
|
||
**HTTP status histogram:** 200: 6739 · 404: 1514 · 201: 864 · 400: 22 · 409: 11
|
||
(no `401`, no `5xx`)
|
||
|
||
Series covered: `3.0`–`3.6`, `4.3`–`4.5`, `master` (all green).
|
||
|
||
> Pass means every contract route is reachable with a handled Engine status and
|
||
> required body checks — not bit-identical behaviour to production RHV hardware.
|