dev:proposal:search_modifications
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| dev:proposal:search_modifications [2012/11/12 14:02] – jbond | dev:proposal:search_modifications [2022/02/10 13:34] (current) – external edit 127.0.0.1 | ||
|---|---|---|---|
| Line 11: | Line 11: | ||
| Search modifications will alter the way searches perform in the following ways: | Search modifications will alter the way searches perform in the following ways: | ||
| - | | + | |
| + | |||
| + | 1. Exact Match: Now exactly matches what is typed in under normalization rules. | ||
| Example: | Example: | ||
| - | | + | |
| - | | + | |
| | | ||
| - | | + | |
| - | | + | |
| - | | + | |
| + | 2. Contains Phrase: Will now require that the phrase appear in the index being searched on. (This feature appears to be in master at the moment. The only change, now, will be that the phrase is normalized and checked against a normalized table of values). | ||
| | | ||
| - | -Before: subject | contains phrase | art greek | results found 1: Greek Art | + | * Before: subject | contains phrase | art greek | results found 1: Greek Art |
| - | -Now: subject | contains phrase | art greek | results found 3: Greek art, The art of Crete.., A handbook of Greek art | + | * Now: subject | contains phrase | art greek | results found 3: Greek art, The art of Crete.., A handbook of Greek art |
| - | - Normalized Indexes: Some indexes contain content that are all normalized characters. This will detect that anomaly and force a search without using text normalization. | + | |
| + | |||
| + | |||
| + | 3. Normalized Indexes: Some indexes contain content that are all normalized characters. This will detect that anomaly and force a search without using text normalization. | ||
| | | ||
| - | -Before: contains | !!! | results found 0: No results found | + | * Before: contains | !!! | results found 0: No results found |
| - | -Now: contains | !!! | results found 1: !!! | + | * Now: contains | !!! | results found 1: !!! |
| These changes will be organization specific and can be turned on or off. The change will be added to the Admin (.) - Local Administration - Library Settings Editor menu. | These changes will be organization specific and can be turned on or off. The change will be added to the Admin (.) - Local Administration - Library Settings Editor menu. | ||
| - | - Configuration changes added to 950.seed_values in SQL build scripts. Upgrade script is available in upgrades. | + | * Configuration changes added to 950.seed_values in SQL build scripts. Upgrade script is available in upgrades. |
| All changes will be done to the QueryParser.pm perl module at / | All changes will be done to the QueryParser.pm perl module at / | ||
| | | ||
| - | - / | + | * / |
| - Creates an object for query parser to track if search mods is on or off. | - Creates an object for query parser to track if search mods is on or off. | ||
| - | - / | + | * / |
| - Creates additions for main SQL statement returned from toSQL. Specifically modifies anything created within the flatten sub routine. | - Creates additions for main SQL statement returned from toSQL. Specifically modifies anything created within the flatten sub routine. | ||
| - | - / | + | * / |
| - Makes a call to the database to normalize a string using search_normalize stored procedure. | - Makes a call to the database to normalize a string using search_normalize stored procedure. | ||
| - | - / | + | * / |
| - Removes search characters that dictate what type of search is to be performed on the query. | - Removes search characters that dictate what type of search is to be performed on the query. | ||
| - | - / | + | * / |
| - Escapes all characters for SQL consumption. | - Escapes all characters for SQL consumption. | ||
| - | - / | + | * / |
| - Gets search modification setting. | - Gets search modification setting. | ||
| Functions Modified: | Functions Modified: | ||
| - | - / | + | * / |
| - Added a check for search mods to either create or not create the element inside queryparser. | - Added a check for search mods to either create or not create the element inside queryparser. | ||
| - | - / | + | * / |
| - Appends pieces of SQL queries to the $from and $where strings. | - Appends pieces of SQL queries to the $from and $where strings. | ||
| - | - / | + | * / |
| - Passes search_mods setting on to query_parser_fts. | - Passes search_mods setting on to query_parser_fts. | ||
| - | - / | + | * / |
| - Collection information about search_mid configuration and load it into $args for getting $results. | - Collection information about search_mid configuration and load it into $args for getting $results. | ||
| Line 61: | Line 67: | ||
| Remaining changes will be to the database, they include adding 5 tables of normalized text fields that are created from triggers from the field_entry tables. The text fields will be indexed using an extension called Pg_trgm. | Remaining changes will be to the database, they include adding 5 tables of normalized text fields that are created from triggers from the field_entry tables. The text fields will be indexed using an extension called Pg_trgm. | ||
| - | - Added 5 new tables, these tables are mapped to the *_field_entry tables. Each table contains an id which is one to one with the matching *_field_entry table. The other two columns contain the source and a value, which is a normalized value of the value field in the *_field_entry table. | + | * Added 5 new tables, these tables are mapped to the *_field_entry tables. Each table contains an id which is one to one with the matching *_field_entry table. The other two columns contain the source and a value, which is a normalized value of the value field in the *_field_entry table. |
| - | - Added an extension to index the normalized_*_field_entry tables. The index allows searching using the LIKE operator and is optimized for phrase matching as well as fuzzy matching. For more information on pg_trgm visit this site [[http:// | + | * Added an extension to index the normalized_*_field_entry tables. The index allows searching using the LIKE operator and is optimized for phrase matching as well as fuzzy matching. For more information on pg_trgm visit this site [[http:// |
| - | - Added a trigger to populate the normalized_*_field_entry tables from the *_field_entry tables. | + | * Added a trigger to populate the normalized_*_field_entry tables from the *_field_entry tables. |
| + | ==== Pull Request ==== | ||
| + | https:// | ||
| + | ==== Blue Print ==== | ||
| + | https:// | ||
| ==== Deliverable ==== | ==== Deliverable ==== | ||
dev/proposal/search_modifications.1352746946.txt.gz · Last modified: 2022/02/10 13:34 (external edit)