sqlite3 database checks

[deajan]

Currently writing a gromox repair script at https://github.com/netinvent/gromox/blob/repair-script/tools/gromox-mbox-repair-tool.sh

While reading the gromox doc here, I noticed that gromox-http should be disabled while doing a pragma integrity_check;.

Isn't the integrity check RO and should not affect gromox-http ?
Is it perhaps blocking the DB and gromox-http will fail somehow ?:

As side questions:

• Should the check / repair actions described in the doc also apply to midb.sqlite3 and perhaps tables.sqlite3 ?
• The pramga integrity check does not perform foreign key checks. Should this be added ?

Thanks for your insight.

[jengelh]

Hm. The sentence was added after gromox-2.30 / parallel read support. One hypothesis coming to mind worth testing is that integrity_check copes (or not) with a concurrent writer which is actively modifying rows and whether it would find e.g. supposedly broken table indices.
I'd probably take a 100000-message mailbox (clone it), and run integrity_check at the same time as e.g. mbop emptyfld -r / and seeing if it barfs.

[deajan]

Thanks, I'll try that.
What about midb.sqlite, is it worth doing the same checks/repairs ?

[deajan]

@jengelh Sorry to ask, but how do I clone a mailbox ? Couldn't find any proper docs for this. Export / import or is there a real clone method ?

[jengelh]

Cloning in the sense of this ticket refers to just copying the mailbox directory (its contents; but at the very least exmdb/exchange.sqlite3).

[deajan]

I've tried to run an SQLite integrity check today concurrently with a emptyfld command to see whether integrity checks would complain when gromox is running.

Interestingly enough, running gromox-mbop -u clone@domain.tld emptyfld -R /on a cloned folder doesn't find any messages to delete:

Folder 0x2: deleted 0 message(s)
Folder 0x3: deleted 0 message(s)
Folder 0x4: deleted 0 message(s)
Folder 0x5: deleted 0 message(s)
Folder 0x6: deleted 0 message(s)
Folder 0x7: deleted 0 message(s)
Folder 0x8: deleted 0 message(s)
Folder 0xa: deleted 0 message(s)
Folder 0x1f49f1: deleted 0 message(s)
Folder 0x1f7101: deleted 0 message(s)
Folder 0xb: deleted 0 message(s)
Folder 0xc: deleted 0 message(s)
Folder 0x1d0001: deleted 0 message(s)
Folder 0x1d2711: deleted 0 message(s)
Folder 0x1d4e21: deleted 0 message(s)
Folder 0x1d7531: deleted 0 message(s)
Folder 0x1d9c41: deleted 0 message(s)
Folder 0x1dc351: deleted 0 message(s)
Folder 0x1dea61: deleted 0 message(s)
Folder 0x1e1171: deleted 0 message(s)
Folder 0x1e3881: deleted 0 message(s)
Folder 0x1e5f91: deleted 0 message(s)
Folder 0x1e86a1: deleted 0 message(s)
Folder 0x1eadb1: deleted 0 message(s)
Folder 0x1ed4c1: deleted 0 message(s)
Folder 0x1efbd1: deleted 0 message(s)
Folder 0x1f22e1: deleted 0 message(s)
Folder 0x20aa1b: deleted 0 message(s)
Folder 0x2431f0: deleted 0 message(s)
Folder 0xd: deleted 0 message(s)
Folder 0xe: deleted 0 message(s)
Folder 0xf: deleted 0 message(s)
Folder 0x10: deleted 0 message(s)
Folder 0x11: deleted 0 message(s)
Folder 0x12: deleted 0 message(s)
Folder 0x14: deleted 0 message(s)
Folder 0x15: deleted 0 message(s)
Folder 0x16: deleted 0 message(s)
Folder 0x13: deleted 0 message(s)
Folder 0x17: deleted 0 message(s)
Folder 0x1a: deleted 0 message(s)
Folder 0x1b: deleted 0 message(s)
Folder 0x1c: deleted 0 message(s)
Folder 0x19: deleted 0 message(s)
Folder 0x1d: deleted 0 message(s)
Folder 0x1f9811: deleted 0 message(s)
Folder 0x1fbf21: deleted 0 message(s)
Folder 0x20a981: deleted 0 message(s)
Folder 0x24288c: deleted 0 message(s)
Folder 0x9: deleted 0 message(s)
Folder 0x18: deleted 0 message(s)
Folder 0x5d4: deleted 0 message(s)
Folder 0x5d5: deleted 0 message(s)
Folder 0x1fe631: deleted 0 message(s)
Folder 0x200d41: deleted 0 message(s)
Folder 0x203451: deleted 0 message(s)
Folder 0x208271: deleted 0 message(s)
Folder 0x21d092: deleted 0 message(s)
Folder 0x205b61: deleted 0 message(s)
Folder 0x25f7a6: deleted 0 message(s)
Folder 0x1: deleted 0 message(s)

Cloning has been done like this:

grommunio-admin user create clone@domain.tld
systemctl stop gromox-http
systemctl stop gromox-zcore
cp -R --preserve /var/lib/gromox/domain.tld/original_user /var/lib/gromox/domain.tld/clone
systemctl start gromox-zcore
systemctl start gromox-http

Btw, the mailbox is not usable. I've added a password, opened the webmail, and got a lot of "missing junk folder" and "Could not load the contents of this folder. (null) (An invalid parameter was passed to a function or remote procedure call)" errors.

Did I miss something in the clone ?
Running gromox-3.0.101.g18cd0c8-lp156.24.1.x86_64 and grommunio-web-3.15.21.g82c7e6458-lp156.333.1.noarch