Repository Objects Inspection

Last modified 20 Nov 2021 17:43 +01:00

MidPoint performance can be sometimes lower than expected from quite unusual reason: objects in repository could grow too large. This can be the case e.g. because of big operation results (stored e.g. in tasks or shadows), because of model operation contexts stored in approval tasks, or because of evaluated triggers stored as part of assignments.

In order to diagnose such situations we have created the "object integrity check" task. (As for the name: we expect many more uses of such task to come later. Displaying objects size is quite a minor functionality in this respect.)

So, if you want to see how large are objects in your repository, import the following task:

Task for displaying repository objects size
<task xmlns="http://midpoint.evolveum.com/xml/ns/public/common/common-3">
    <name>Object size check</name>
    <extension xmlns:mext="http://midpoint.evolveum.com/xml/ns/public/model/extension-3">
        <mext:objectQuery>
            <!-- put object query here, if needed -->
        </mext:objectQuery>
    </extension>
    <ownerRef oid="00000000-0000-0000-0000-000000000002" type="UserType"/>
    <executionStatus>runnable</executionStatus>
    <handlerUri>http://midpoint.evolveum.com/xml/ns/public/model/object-integrity-check/handler-3</handlerUri>
    <recurrence>single</recurrence>
</task>

You can restrict the objects to be included in the scope by using objectQuery extension item.

The result will be shown in the log, like this (note that my midPoint is almost empty now, so there are not many objects there):

2017-07-06 19:32:00,205 [] [midPointScheduler_Worker-1] INFO (com.evolveum.midpoint.model.impl.integrity.ObjectIntegrityCheckResultHandler):

**************************************** Statistics for com.evolveum.midpoint.xml.ns._public.common.common_3.SystemConfigurationType ****************************************

Count: 1
Min: 6581 (SystemConfiguration(00000000-0000-0000-0000-000000000001))
Max: 6581 (SystemConfiguration(00000000-0000-0000-0000-000000000001))
Avg: 6581

Histogram:

     Interval :  Items :                                                                                  : Representative
-------------------------------------------------------------------------------------------------------------------------------------
     [0-6581] :      1 : ################################################################################ : SystemConfiguration(00000000-0000-0000-0000-000000000001) (6581)



**************************************** Statistics for com.evolveum.midpoint.xml.ns._public.common.common_3.LookupTableType ****************************************

Count: 4
Min: 1672 (Locales(00000000-0000-0000-0000-000000000210))
Max: 2054 (Languages(00000000-0000-0000-0000-000000000200))
Avg: 1773

Histogram:

     Interval :  Items :                                                                                  : Representative
-------------------------------------------------------------------------------------------------------------------------------------
     [0-2054] :      4 : ################################################################################ : Languages(00000000-0000-0000-0000-000000000200) (2054)



**************************************** Statistics for com.evolveum.midpoint.xml.ns._public.common.common_3.OrgType ****************************************

Count: 1
Min: 85387 (Employee(00000000-0000-0000-0000-0000EMPLOYEE))
Max: 85387 (Employee(00000000-0000-0000-0000-0000EMPLOYEE))
Avg: 85387

Histogram:

     Interval :  Items :                                                                                  : Representative
-------------------------------------------------------------------------------------------------------------------------------------
     [0-9999] :      0 :                                                                                  :
[10000-19999] :      0 :                                                                                  :
[20000-29999] :      0 :                                                                                  :
[30000-39999] :      0 :                                                                                  :
[40000-49999] :      0 :                                                                                  :
[50000-59999] :      0 :                                                                                  :
[60000-69999] :      0 :                                                                                  :
[70000-79999] :      0 :                                                                                  :
[80000-85387] :      1 : ################################################################################ : Employee(00000000-0000-0000-0000-0000EMPLOYEE) (85387)



**************************************** Statistics for com.evolveum.midpoint.xml.ns._public.common.common_3.SecurityPolicyType ****************************************

Count: 1
Min: 2264 (Default Security Policy(00000000-0000-0000-0000-000000000120))
Max: 2264 (Default Security Policy(00000000-0000-0000-0000-000000000120))
Avg: 2264

Histogram:

     Interval :  Items :                                                                                  : Representative
-------------------------------------------------------------------------------------------------------------------------------------
     [0-2264] :      1 : ################################################################################ : Default Security Policy(00000000-0000-0000-0000-000000000120) (2264)



**************************************** Statistics for com.evolveum.midpoint.xml.ns._public.common.common_3.ReportType ****************************************

Count: 7
Min: 20992 (Certification definitions report(00000000-0000-0000-0000-000000000130))
Max: 37838 (Audit logs report(00000000-0000-0000-0000-000000000009))
Avg: 29866

Histogram:

     Interval :  Items :                                                                                  : Representative
-------------------------------------------------------------------------------------------------------------------------------------
     [0-9999] :      0 :                                                                                  :
[10000-19999] :      0 :                                                                                  :
[20000-29999] :      4 : ################################################################################ : Certification cases report(00000000-0000-0000-0000-000000000150) (28090)
[30000-37838] :      3 : ############################################################                     : Audit logs report(00000000-0000-0000-0000-000000000009) (37838)



**************************************** Statistics for com.evolveum.midpoint.xml.ns._public.common.common_3.UserType ****************************************

Count: 2
Min: 3913 (administrator(00000000-0000-0000-0000-000000000002))
Max: 2673710 (helpdesk(00000000-0000-0000-0000-999999999999))
Avg: 1338811

Histogram:

         Interval :  Items :                                                                                  : Representative
-----------------------------------------------------------------------------------------------------------------------------------------
         [0-9999] :      1 : ################################################################################ : administrator(00000000-0000-0000-0000-000000000002) (3913)
    [10000-19999] :      0 :                                                                                  :
    [20000-29999] :      0 :                                                                                  :
    [30000-39999] :      0 :                                                                                  :
    [40000-49999] :      0 :                                                                                  :
    [50000-59999] :      0 :                                                                                  :
 ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~ 256 lines skipped ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~
[2620000-2629999] :      0 :                                                                                  :
[2630000-2639999] :      0 :                                                                                  :
[2640000-2649999] :      0 :                                                                                  :
[2650000-2659999] :      0 :                                                                                  :
[2660000-2669999] :      0 :                                                                                  :
[2670000-2673710] :      1 : ################################################################################ : helpdesk(00000000-0000-0000-0000-999999999999) (2673710)



**************************************** Statistics for com.evolveum.midpoint.xml.ns._public.common.common_3.ConnectorType ****************************************

Count: 11
Min: 2338 (Built-in ManualConnector v1.0.0(7dbe9f19-79da-44bf-90b8-cfb1c5051e50))
Max: 36759 (ConnId com.evolveum.polygon.connector.ldap.ad.AdLdapConnector v1.4.5-SNAPSHOT(c4a10f36-2495-4452-9eb3-3eea1096e3c1))
Avg: 22898

Histogram:

     Interval :  Items :                                                                                  : Representative
-------------------------------------------------------------------------------------------------------------------------------------
     [0-9999] :      1 : ####################                                                             : Built-in ManualConnector v1.0.0(7dbe9f19-79da-44bf-90b8-cfb1c5051e50) (2338)
[10000-19999] :      4 : ################################################################################ : ConnId org.identityconnectors.databasetable.DatabaseTableConnector v1.4.2.0(7406c4a9-a03a-4981-92aa-7d6238247249) (16754)
[20000-29999] :      4 : ################################################################################ : ConnId com.evolveum.polygon.connector.ldap.edirectory.EDirectoryLdapConnector v1.4.5-SNAPSHOT(06a66772-d3d9-4a6d-a9b5-4378571c7c5c) (29894)
[30000-36759] :      2 : ########################################                                         : ConnId com.evolveum.polygon.connector.ldap.ad.AdLdapConnector v1.4.5-SNAPSHOT(c4a10f36-2495-4452-9eb3-3eea1096e3c1) (36759)



**************************************** Statistics for com.evolveum.midpoint.xml.ns._public.common.common_3.ValuePolicyType ****************************************

Count: 1
Min: 2349 (Default Password Policy(00000000-0000-0000-0000-000000000003))
Max: 2349 (Default Password Policy(00000000-0000-0000-0000-000000000003))
Avg: 2349

Histogram:

     Interval :  Items :                                                                                  : Representative
-------------------------------------------------------------------------------------------------------------------------------------
     [0-2349] :      1 : ################################################################################ : Default Password Policy(00000000-0000-0000-0000-000000000003) (2349)



**************************************** Statistics for com.evolveum.midpoint.xml.ns._public.common.common_3.RoleType ****************************************

Count: 8220
Min: 2271 (Role 2373(00000000-0000-0000-0000-000000002373))
Max: 190679 (Business role 13(00000000-0000-0000-0000-00000000BU13))
Avg: 3304

Histogram:

       Interval :  Items :                                                                                  : Representative
---------------------------------------------------------------------------------------------------------------------------------------
       [0-9999] :   8174 : ################################################################################ : Approver(00000000-0000-0000-0000-00000000000a) (6771)
  [10000-19999] :      1 : #                                                                                : End user(00000000-0000-0000-0000-000000000008) (10472)
  [20000-29999] :      0 :                                                                                  :
  [30000-39999] :      0 :                                                                                  :
  [40000-49999] :      0 :                                                                                  :
  [50000-59999] :      0 :                                                                                  :
  [60000-69999] :      0 :                                                                                  :
 ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~ 7 lines skipped ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~  ~
[140000-149999] :      0 :                                                                                  :
[150000-159999] :      0 :                                                                                  :
[160000-169999] :      0 :                                                                                  :
[170000-179999] :      0 :                                                                                  :
[180000-189999] :      0 :                                                                                  :
[190000-190679] :     45 : #                                                                                : Business role 13(00000000-0000-0000-0000-00000000BU13) (190679)



**************************************** Statistics for com.evolveum.midpoint.xml.ns._public.common.common_3.NodeType ****************************************

Count: 1
Min: 1534 (DefaultNode(5bde2e9f-19a7-4a73-bf21-6a201818c817))
Max: 1534 (DefaultNode(5bde2e9f-19a7-4a73-bf21-6a201818c817))
Avg: 1534

Histogram:

     Interval :  Items :                                                                                  : Representative
-------------------------------------------------------------------------------------------------------------------------------------
     [0-1534] :      1 : ################################################################################ : DefaultNode(5bde2e9f-19a7-4a73-bf21-6a201818c817) (1534)



**************************************** Statistics for com.evolveum.midpoint.xml.ns._public.common.common_3.TaskType ****************************************

Count: 5
Min: 3242 (Object size check(5f8ea6d1-ba00-4367-9fc9-90282d3e11bd))
Max: 15067 (recompute roles(a693e829-b76a-403c-8f5c-4d540c96728f))
Avg: 6947

Histogram:

     Interval :  Items :                                                                                  : Representative
-------------------------------------------------------------------------------------------------------------------------------------
     [0-9999] :      4 : ################################################################################ : Validity Scanner(00000000-0000-0000-0000-000000000006) (6164)
[10000-15067] :      1 : ####################                                                             : recompute roles(a693e829-b76a-403c-8f5c-4d540c96728f) (15067)


2017-07-06 19:32:00,205 [] [midPointScheduler_Worker-1] INFO (com.evolveum.midpoint.model.impl.integrity.ObjectIntegrityCheckResultHandler): Objects processed with errors: 0
Was this page helpful?
YES NO
Thanks for your feedback