Retention of monitoring data stored in MySQL DB

[arrabito]

Dear all,

I would have some questions about the retention policy of monitoring data.

As they are intended to be primarly stored on OpenSearch I guess that it's sufficient to define a retention policy for the different indexes in OpenSearch.

Now, as our OpenSearch infrastructure is not ready yet, we are currently storing them in the MySQL AccountingDB, but some tables, especially ac_type_<setup>_WMSHistory , are growing quite fast, so that I would like to implement some retention policy for the monitoring data in the AccountingDB (for info we are running DIRAC v8 for this instance).

However, I'm not totally sure in which tables monitoring data are stored and how safe it is to simply delete entries based on the date.

Note that we don't want to remove Accounting data, but only Monitoring ones.

Could you please tell among the list of tables in the attached file CTA_AccountingTables.txt which are the ones hosting the monitoring data?

As far as I understand for WMSHistory monitoring data, these are the following ones:

ac_bucket_<setup>_WMSHistory                           
ac_in_<setup>_WMSHistory                                   
ac_type_<setup>_WMSHistory  

but I'm not totally sure and also I'm not sure about which are the tables for the other categories of monitoring data.

Would it be safe to remove entries from the concerned tables, for instance older than 1 month, based on startTime or endTime column values?

Thank you,

Luisa