Performance Tuning

Last modified 19 Feb 2025 11:43 +01:00

Since 4.9

This functionality is available since version 4.9.

MidPoint 4.9 introduced new functionality, intended for ease of use, which is enabled by default and may impact performance of existing deployments. This new functionality is not necessary for some deployments (depending on their configuration) and can be fine-tuned or turned off to gain performance.

Default provenance metadata for multivalues

MidPoint 4.9 has provenance metadata enabled by default for multivalue properties, which are created / edited by mappings. This functionality simplifies writing of mappings and makes default behaviour more predictable, where mappings can only remove values, they emmited.

Impact

The provenance metadata for multivalue properties results in larger data structures (instead of storing just value, identifiers of resource and mapping, which emitted this value). This increases memory consumption, storage consumption at database level and processing time necessary for creation, serialization and deserialization of these metadata.

The performance impact increases with number of multivalue properties in use and mappings.

Mitigation

If deployment does use mappings for multivalue metadata, but all such mappings has custom range defined, default provenance metadata can be turned off in system configuration. The option for disabling provenance metadata by default is internals/valueMetadata/disableDefaultMultivalueProvenance

<systemConfiguration>
    ...
    <internals>
        <valueMetadata>
            <disableDefaultMultivalueProvenance>true</disableDefaultMultivalueProvenance>
        </valueMetadata>
    </internals>
    ...
</systemConfiguration>

Shadow Caching

Since 4.9, the shadow caching is enabled by default. It means that shadow attributes and other items (like activation or credentials) are stored in midPoint repository. This improves the performance and reliability for slow and/or unreliable resources, especially when dealing with ones in cloud. It also broadens possibilities related to reporting, as the required data are stored right in midPoint.

Impact

However, storing additional information in midPoint repository has a performance impact.

First, there is more data to be stored, so the database tables are larger. When processing this data, more RAM and processing power (CPU) is needed. Finally, if the caching is enabled, the maintenance of caching metadata (in particular the retrievalTimestamp) costs additional midPoint repository update on each read operation executed against the resource - even if there is no real change of the data on the resource.

This impact is more profound if the cache is used in the default mode (useFresh), where it is updated, but not used for regular operation - only for reporting.

Mitigation

For slow resources, we suggest turning on useCachedOrFresh mode. It will reduce the number of resource read operations, as well as the number of corresponding updates of retrievalTimestamp in midPoint repository.

For fast resources with the need of instant reporting, we suggest using the (experimental) feature that turns off the maintenance of the retrievalTimestamp property:

<resource>
    ...
    <caching>
        ...
        <retrievalTimestampMaintenance>false</retrievalTimestampMaintenance>
    </caching>
</resource>

(It can be done at any level: system configuration, resource, or object type.)

Finally, if the shadow caching is not needed, it is recommended to turn it off.

Was this page helpful?

YES NO

Thanks for your feedback