Diana Shkolnikov
1435de906d
Add source_id property
9 years ago
Julian Simioni
23ff51fd57
Add custom access_log handlers that remove user info
...
These handlers will remove sensitive query info from the logs when DNT
is enabled
9 years ago
Julian Simioni
9e12c650d0
Add logging helper module
...
This module has helper methods for logging. Currently it has methods to:
* detect if DNT is enabled
* remove sensitive information from input fields for logging
9 years ago
Peter Johnson
cb67dd58d8
refactor boolean query filtering as per: https://www.elastic.co/guide/en/elasticsearch/reference/current/breaking_20_query_dsl_changes.html#_literal_filtered_literal_query_and_literal_query_literal_filter_deprecated
9 years ago
Peter Johnson
dd5215cbae
upgrade to ES2+
9 years ago
Peter Johnson
63d9329afd
add additional test case
9 years ago
Peter Johnson
0caca08787
improve error matching by using string prefix matching on known elasticsearch exception names
9 years ago
Peter Johnson
b15cfb3795
refactor elasticsearch error detection, improve test coverage
9 years ago
Julian Simioni
373a08e79b
Set all admin boosts to 1
...
They seem to interfere with the new multi_match query. More tweaking in
the future is definitely warranted.
9 years ago
Julian Simioni
ab19a12e1c
Use multi_match query for admin fields
9 years ago
missinglink
05240626fd
handle addressit case where parsed_text.street is produced and parsed_text.name is not
9 years ago
missinglink
ee73774c89
add tokenizer, refactor how we determine if a token is 'complete' or 'incomplete'
9 years ago
missinglink
e093a09a8d
remove search related improvements from this PR
9 years ago
missinglink
0c67347c27
enable borough for search
9 years ago
missinglink
da4c666538
reduce admin:borough:boost from 800->600
9 years ago
missinglink
2398f05f8d
fix borough matching for both autocomplete and search endpoints
9 years ago
missinglink
01a3233a7b
add a view to boost exact matches
9 years ago
missinglink
25ab63c3b3
change search analyzer to be more similar to what we had before the autocomplete_refactor milestone
9 years ago
Stephen Hess
bd3b8e7bbe
switched to pelias-text-analyzer package since that responsibility has been moved to there
9 years ago
Stephen Hess
9cdfce13c1
fixed extraneous comma labels for results with only a `name`
9 years ago
Stephen Hess
2c40827701
added `layer=borough` support for *all 5 boroughs* in data
9 years ago
missinglink
e40c9ef326
increase focus weight from 10->40 and simplify population/popularity subview
9 years ago
Stephen Hess
0076200728
added special case for USA in labels
...
if record is for literal United States, use the full name, otherwise use USA
9 years ago
Stephen Hess
c99fa9f0ef
added support for `macroregion`
9 years ago
Julian Simioni
3c1d758229
Fix timeout error handling
...
Timeout errors come back from the Elasticsearch module as Error objects,
so instead of pushing the entire object onto the errors array, we should
just push the message.
I'm not sure if there are other cases where errors are just strings,
errors that aren't objects with a message property are handled as
before.
9 years ago
Stephen Hess
8a54dbeef0
switched from `macrocountry` to `macrocounty`
9 years ago
Diana Shkolnikov
05f4374b0a
Add more tests without spaces
9 years ago
Diana Shkolnikov
37d261c047
Removed a new test when merging
9 years ago
Diana Shkolnikov
c415b96ead
Named admin_parts adminParts which caused problems
9 years ago
Stephen Hess
caa9745aaa
standardized on naming conventions
9 years ago
Stephen Hess
f783560224
split tests into logical units
9 years ago
Stephen Hess
c5626d6c5e
added `localadmin` for USA/GBR/default when `locality` isn't available
9 years ago
Julian Simioni
e6e9c1c574
Do not apply local naming conventions to records with no admin info
...
There's no way to decide what to do, and without handling this case the
API will return an error.
9 years ago
Stephen Hess
0870e30366
Refactored the label generation code to be simpler
...
Labels are now, outside US/CA/UK, just name+city+country.
Deduping now only occurs on the first 2 parts of the labels which fixes the "Luxembourg, Luxembourg" issue.
9 years ago
Julian Simioni
39502df284
Add borough to geojson output and USA.local labels
9 years ago
Diana Shkolnikov
8a15234e56
Fix failing test
9 years ago
Diana Shkolnikov
147c849b58
change admin property names to <place_type>_gid from <place_type>_id
9 years ago
Diana Shkolnikov
82e39fd81f
parent block properties should not be changed, only top level ones
9 years ago
Diana Shkolnikov
201f4d4fb3
Convert parent WOF ids to valid Pelias ids to be used by /place
9 years ago
Diana Shkolnikov
3862dd233e
change admin property names to <place_type>_gid from <place_type>_id
9 years ago
Diana Shkolnikov
10cd693e02
parent block properties should not be changed, only top level ones
9 years ago
Diana Shkolnikov
928597e029
Fix admin parts parsing without spaces after delimeters
9 years ago
missinglink
3a789b4a93
increase autocomplete 'phrase:slop' setting from 2->3
9 years ago
Diana Shkolnikov
7231e229d4
Convert parent WOF ids to valid Pelias ids to be used by /place
9 years ago
Diana Shkolnikov
7ebb653c22
Change properties.bounding_box to bbox at top level
9 years ago
Julian Simioni
abbd314ee8
Change deprication message to present tense
9 years ago
Peter Johnson
51279ce2cf
quattroshapes deprecation warning and wof fallback
9 years ago
Peter Johnson
aa3e764e49
update analyzers to work with https://github.com/pelias/schema/pull/109
9 years ago
Peter Johnson
63301afeac
wow this is easy to get wrong, added a unit test
9 years ago
Peter Johnson
0abda099a6
bugfixes and more tests
9 years ago