Performance

Configuration

Each minor Open Zaak version should be deployed on the dedicated server for the performance testing. The performance testing should be run both for at least GET /zaken/api/v1/zaken endpoint with following configurations:

Locust users
- 1 user
- 16 users
Role
- super user
- regular user

For runs with 16 users Open Zaak should be deployed with enough amount of threads, for example 4 processes and 4 threads.

Each run should last at least 5 minutes.

Hardware

The dedicated service where all the tests are run has the following configuration:

Processor: 4 CPUs at 3.2 GHz
RAM: 16 GB
Storage: 4 TB SATA

Open Zaak data

There should be enough data in the database for the performance testing:

1.000.000 Zaken in the Zaken API
1.000.000 Documenten in the Documenten API
1.000.000 Besluiten in the Besluiten API
1 Catalogus with 100 Zaaktypen in the Catalogi API

Performance test results

1 user

OZ version	Role	Median time (in ms)
1.9.0	Superuser	740
1.9.0	Regular	2500
1.10.2	Superuser	790
1.10.2	Regular	1600
1.13.0	Superuser	860
1.13.0	Regular	1700
1.14.0 (fuzzy on)	Superuser	640
1.14.0 (fuzzy on)	Regular	690
1.17.0 (fuzzy on)	Superuser	480
1.17.0 (fuzzy on)	Regular	610
1.18.0 (fuzzy on)	Superuser	510
1.18.0 (fuzzy on)	Regular	550
1.19.0 (fuzzy on)	Superuser	540
1.19.0 (fuzzy on)	Regular	610
1.20.0 (fuzzy on)	Superuser	570
1.20.0 (fuzzy on)	Regular	580

16 users

OZ version	Role	Median time (in ms)
1.9.0	Superuser	2300
1.9.0	Regular	13000
1.10.2	Superuser	3200
1.10.2	Regular	11000
1.13.0	Superuser	3400
1.13.0	Regular	11000
1.14.0 (fuzzy on)	Superuser	2600
1.14.0 (fuzzy on)	Regular	3400
1.17.0 (fuzzy on)	Superuser	3300
1.17.0 (fuzzy on)	Regular	4000
1.18.0 (fuzzy on)	Superuser	1900
1.18.0 (fuzzy on)	Regular	2300
1.19.0 (fuzzy on)	Superuser	2100
1.19.0 (fuzzy on)	Regular	2200
1.20.0 (fuzzy on)	Superuser	2200
1.20.0 (fuzzy on)	Regular	2100