perf(sql): Add COLLATE NOCASE to some indexes on ahb_hierarchy_materialized for faster search
#193
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…terialized` for faster search because ```sql ... WHERE LOWER(haystack_column) LIKE 'needle' ``` doesn't use the index and ```sql ... WHERE haystack_column LIKE 'needle' ``` is only case-insensitive for ASCII characters. See https://sqlite.org/optoverview.html#the_like_optimization
hf-kklein
changed the title
COLLATE NOCASE to some indexes on `ahb_hierarchy_ma…COLLATE NOCASE to some indexes on ahb_hierarchy_materialized for faster search
hf-kklein
changed the title
COLLATE NOCASE to some indexes on ahb_hierarchy_materialized for faster searchCOLLATE NOCASE to some indexes on ahb_hierarchy_materialized for faster search
hf-kklein
added a commit
to Hochfrequenz/ahb-tabellen
that referenced
this pull request
Oct 21, 2025
… index) maybe we need to add `COLLATE NOCASE` to the where clause, idk... see: Hochfrequenz/xml-fundamend-python#193
There was a problem hiding this comment.
Pull Request Overview
This PR optimizes search performance on the ahb_hierarchy_materialized table by adding COLLATE NOCASE to string column indexes. This enables case-insensitive LIKE queries to utilize indexes without requiring LOWER() function calls, which prevent index usage in SQLite.
Key changes:
- Added
COLLATE NOCASEto 9 text-based indexes on columns used for search operations - Enables case-insensitive search across all Unicode characters (not just ASCII) while maintaining index performance
Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
because
doesn't use the index
and
is only case-insensitive by default for ASCII characters. See https://sqlite.org/optoverview.html#the_like_optimization