[V2] Content indexing

[perki]

When filtering data queries cannot be performed on the “content” of events, only on the meta information.

Why:

• Search for a chat textual content, a specific condition ....
• Mapping with external Ids for synchronization purposes

Context:

• Content filtering should be evaluated, considering optional end-to-end encryption. => If data is encrypted, no search is possible.
• Search relies on the DB technology chosen (projected: SQLite / Postgresql)

Proposal:

1. Searching for content is only possible on non-encrypted data.
2. Searching is handled by a new event property e.g. named “indexed.”
3. Investigate “homomorphic encryption” to allow specific queries on encrypted data set

[perki]

Reference SQLite, indexing JSON content; https://antonz.org/json-virtual-columns/