Stephen Hess
9e569bae17
renamed mt/st/ft sanitizer to something more generic
8 years ago
Stephen Hess
35ab050341
transliterate mt/ft/saint/sainte into mount/fort/st/ste
...
respectively
8 years ago
Stephen Hess
be2a336038
updated naming from component to structured
8 years ago
Stephen Hess
b18cb234b2
added sanitizer to convert country iso2->iso3
8 years ago
Stephen Hess
d2c32b5afd
added unit tests for component_geocoding query
...
started folder structure for fixture as it's getting unwieldy
8 years ago
Stephen Hess
08f4aa4b95
renamed files to be more indicative of what the function is
8 years ago
Stephen Hess
d03a8c4586
added support for component geocoding
...
- created `/component` route
- broke out trimByGranularityComponent but could conceivably be combined with existing
- added `address` support to text_parser
- added `component` sanitizer wrapper
8 years ago
Stephen Hess
8179812282
added sanitizer for synthesizing an analysis from parameters
8 years ago
Stephen Hess
248b1299c8
added post-processing step to generate labels
...
injects label generation function for easier unit testing
moved label generation code to separate package
8 years ago
Stephen Hess
3763d0b503
renamed `sanitise` -> `sanitize`
8 years ago
Diana Shkolnikov
21d4bb63f3
feat: add accuracy field
8 years ago
Diana Shkolnikov
d5ff072e9e
update tests
8 years ago
Stephen Hess
06310bd3b7
only initialize req.clean/errors/warnings if not initialized yet
...
also added tests for sanitizeAll
8 years ago
Stephen Hess
6f4ec874fe
added special override condition for libpostal query/housenumber mixup
8 years ago
Stephen Hess
5178dc1cc9
added `trimByGranularity` to tests-to-run
8 years ago
Diana Shkolnikov
a8e82b018d
Refactor deduper and write additional tests
8 years ago
Stephen Hess
46d58cafb0
renamed `_text_autocomplete` to `_text_addressit`
8 years ago
Stephen Hess
40ed4e64c4
added new test
8 years ago
Stephen Hess
3b981d97ba
copied in tests from master for `search_original`
...
commented out the tests that break because i don't know how to fix them which will probably require help from @missinglink .
8 years ago
Stephen Hess
b1cf06720b
included generatePermutations in list of tests
8 years ago
Alec Vulfson
a6ccbf17ce
Add provinces to Australian labels
8 years ago
Diana Shkolnikov
c38b67aeb4
Add nearby sanitizer and revert reverse to not have categories
8 years ago
Diana Shkolnikov
1c6436d123
Update categories sanitizer and implement unit tests for it
8 years ago
Peter Johnson
5b8a9a31d2
wrap coordinates at poles
8 years ago
Julian Simioni
23ff51fd57
Add custom access_log handlers that remove user info
...
These handlers will remove sensitive query info from the logs when DNT
is enabled
9 years ago
Julian Simioni
9e12c650d0
Add logging helper module
...
This module has helper methods for logging. Currently it has methods to:
* detect if DNT is enabled
* remove sensitive information from input fields for logging
9 years ago
Peter Johnson
b15cfb3795
refactor elasticsearch error detection, improve test coverage
9 years ago
missinglink
ee73774c89
add tokenizer, refactor how we determine if a token is 'complete' or 'incomplete'
9 years ago
Stephen Hess
bd3b8e7bbe
switched to pelias-text-analyzer package since that responsibility has been moved to there
9 years ago
Diana Shkolnikov
37d261c047
Removed a new test when merging
9 years ago
Stephen Hess
0870e30366
Refactored the label generation code to be simpler
...
Labels are now, outside US/CA/UK, just name+city+country.
Deduping now only occurs on the first 2 parts of the labels which fixes the "Luxembourg, Luxembourg" issue.
9 years ago
Diana Shkolnikov
201f4d4fb3
Convert parent WOF ids to valid Pelias ids to be used by /place
9 years ago
Diana Shkolnikov
928597e029
Fix admin parts parsing without spaces after delimeters
9 years ago
Diana Shkolnikov
7231e229d4
Convert parent WOF ids to valid Pelias ids to be used by /place
9 years ago
Peter Johnson
51279ce2cf
quattroshapes deprecation warning and wof fallback
9 years ago
Julian Simioni
b4fb62f2c9
Test that src/backend passes correct config to elasticsearch
9 years ago
Diana Shkolnikov
36b6adddfd
Add bounding_box parsing step
9 years ago
missinglink
cd16ff92b1
add common.diff() function for test debugging
9 years ago
Julian Simioni
616dd606a7
Add sources and layers sanitiser
...
This sanitiser can do a better job of determining when an invalid
combination of sources and layers was specified, and produce helpful
error messages.
9 years ago
Julian Simioni
ef78b2e0fd
Filter source and layer by new fields
...
This is functionally the same code as before, except that it uses the
new source and layer mapping.
9 years ago
Stephen Hess
3e8d1bfd9b
broke country-specific label tests out to own file for easier testing
9 years ago
Diana Shkolnikov
54187dde67
Add dedupe middleware
...
Dedupe middleware removes __exact__ dupes and truncates the results
to the specified size.
9 years ago
Peter Johnson
49d37eafed
one config per query
9 years ago
Peter Johnson
4e43310288
german street/number naming convention
9 years ago
Julian Simioni
b188a2046c
Fix mismatching name of types preference parameter
...
The parameter in clean.types being set by `helpers/text_parser.js` was
"from_address_parsing", but the code in `helper/types.js` was expecting
"from_address_parser". This commit makes both use "from_address_parser"
and adds a test.
9 years ago
Julian Simioni
59b70f7c7e
Rename helper/query_parser to helper/text_parser
9 years ago
Julian Simioni
aa08fb9772
Add optional and required group parameter sanitizers
9 years ago
Julian Simioni
f3ba5411cd
Sort test file names
9 years ago
Peter Johnson
3a54a8b32f
fix label issues
9 years ago
Peter Johnson
2b9c3d79aa
rename outputGenerator -> labelGenerator
9 years ago