User Tools

Site Tools


dev:proposal:search_normalization

Search Normalization

Summary

This feature would give DBAs an internal value to set to normalize meta data differently.

NACO normalization standards can be found here

The change to normalization is minor. According to NACO standards commas and apostrophes are normalized to white space. This search normalization feature converts commas and apostrophes to nothing rather than white space. The feature can be turned on or off using an internal flag. Using this feature affects the way all data is normalized when using the search_normalize stored procedure.

The following stored procedures have been modified:

* search_normalize(text) - Modified wrapper function to check if flag was turned on in database.

* search_normalize(text, text) - Modified main search normalization function to delete commas and apostrophes when proper flags were on.

* get_internal_flag - New stored procedure added. Takes a line of text representing the name field for the config.internal_flag table. Returns the enabled field of the matching name.

* oils_tsearch2 - Modified the way the tsearch2 reads in new ts_vectors. Now normalizes the value before throwing it into to_tsvector().

* config.altered_search_normalize - New trigger function added to handle updating meta data when flag is changed inside internal_flag table.

The following tables have been modified:

* config.internal_flag - Added row to handle altered search normalization rules.

Blue Print

Deliverable

* An option to alter search normalization functionality.

dev/proposal/search_normalization.txt · Last modified: 2022/02/10 13:34 by 127.0.0.1

Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
CC Attribution-Share Alike 4.0 International Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki

© 2008-2022 GPLS and others. Evergreen is open source software, freely licensed under GNU GPLv2 or later.
The Evergreen Project is a U.S. 501(c)3 non-profit organization.