Commit graph

95 commits

Author SHA1 Message Date
Niko Storni b873d93bf6 .io to .com 2019-07-08 20:00:10 +02:00
Mark Beamer Jr db39a6c47f
skip bad claim when processing to ensure all future claims make it into elastic search. 2019-06-22 16:37:39 -04:00
Mark Beamer Jr 11d000119b
check for null value to notify lbry team. 2019-06-22 16:17:40 -04:00
Mark Beamer Jr ea2fcb56ab
log error when step in sync process fails. 2019-06-21 00:11:16 -04:00
Mark Beamer Jr 4f5206d18e
Check for Claim field 2019-06-20 23:26:36 -04:00
Mark Beamer Jr 3a061df1a4
check for null and undefined 2019-05-31 22:02:00 -04:00
Mark Beamer Jr 4056fb86cf
use escaped query for query_string
removed comments
2019-02-28 21:45:56 -05:00
Mark Beamer Jr a716124800
Added split function for multi word queries. This way it makes a contains query for each word in the query. 2019-02-28 21:34:40 -05:00
Mark Beamer Jr 5a9ce272b9
Added reverted changes back in 2019-02-26 08:50:26 -05:00
Mark 79a2470504
Revert "added channel effective amount to the claim weight." 2019-02-24 22:05:39 -05:00
Mark Beamer Jr 31f47fea76
Converted script scores to field_value_factor scores. This allows for a missing parameter to avoid the errors. 2019-02-24 21:41:22 -05:00
Mark Beamer Jr 101e55d924
added channel effective amount to the claim weight. 2019-02-24 17:03:50 -05:00
Mark Beamer Jr 81986315cb
Batched the chainquery calls for lighthouse in case it needs to grab all 700K in a redo. 2019-02-24 16:57:56 -05:00
marcdeb1 70415626c5
Added content type filter
Added claim type filter
Improved filtering and return no results when wrong input
List of types as input for mediaType and contentType
2019-02-09 16:54:29 -05:00
Thomas Zarebczan 423176da3f
Update lighthouse.js
decrease effective factor one more decimal to compare related content results while we work on proper query washing.
2018-11-13 13:23:01 -05:00
Mark Beamer Jr 5081e1bff9
added removal from query lbry:// ( lbry urls ) 2018-11-12 21:52:36 -05:00
Mark Beamer Jr af4329b9e7
Added multi character splits to split by &, , and $ 2018-11-12 21:36:47 -05:00
Mark Beamer Jr 4bdb44abb5
fixed pull_request typo. 2018-11-08 09:47:07 -05:00
Mark 9ecc9b0fc2
Merge pull request #125 from marcdeb1/search_accuracy
Changed regex
2018-11-07 13:50:03 -05:00
Mark Beamer Jr 6380e8e6d6
Don't make 'Accepted' bid state claims searchable ( mempool ). Made esQuery a variable for easy debugging when needed. 2018-11-05 20:42:44 -05:00
Mark Beamer Jr 965746b9d2
added slack integration 2018-11-04 01:01:23 -04:00
Mark Beamer Jr 36db99ddca
Added auto-deployment for lighthouse 2018-11-04 01:01:22 -04:00
marcdeb1 c6b4d63eb2 Changed regex 2018-10-24 12:21:33 +02:00
Fillerino 7b9377deff Updated the API doc to add NSFW filtering 2018-10-21 22:41:17 +02:00
filipnyquist e3e6d7c94d
Merge pull request #122 from marcdeb1/nsfw_filter
Added NSFW filter to query
2018-10-21 22:34:16 +02:00
Mark Beamer Jr a409396f69
fixed some lint issues and function name 2018-10-21 00:06:39 -04:00
marcdeb1 b4052fc921 Syntax and indentationn 2018-10-18 08:36:04 +02:00
marcdeb1 44ea0093ef Added NSFW filter to query 2018-10-17 11:42:25 +02:00
Mark Beamer Jr 5b2b274423
added blacklist for words.
don't search words less than 3 characters
2018-09-26 21:32:42 -04:00
Mark 6d52314f16
Merge pull request #114 from lbryio/trim_white_space
Trim white space
2018-09-23 10:35:37 -04:00
Mark 6e07477689
Merge pull request #115 from lbryio/addition_reserved_characters
I was missing some additional special characters
2018-09-23 10:35:12 -04:00
Mark Beamer Jr 56545cfed2
Fixed the auto-complete query to leverage the nested structure and to return only relevant claims and the text that triggered the auto-complete. 2018-09-16 01:52:19 -04:00
Mark Beamer Jr 6960a0084e
I was missing some additional special characters that needed to be escaped. 2018-09-15 22:13:01 -04:00
Mark Beamer Jr ad533e3989
trimmed whitespace for search terms. 2018-09-15 21:44:15 -04:00
filipnyquist fa18e29a8a
Update lighthouse.js 2018-08-22 19:56:09 +02:00
filipnyquist b64ef9f97a
Added back #81
Added back: 
Updated search query to include controlling and effective amount weights. Also made sure the results are sorted properly so highest score is at the top.
2018-08-22 16:38:15 +02:00
Mark Beamer Jr 9469f953d6 added escape function to escape special characters for the query_string elastic search query. 2018-08-14 20:58:53 -04:00
Mark aa4558bb57
Merge pull request #99 from lbryio/chainquery-fix
Added the breaking change of #93. Added the change, do not merge unti…
2018-08-12 13:53:24 -04:00
filipnyquist 7adbb67a2b Added swagger.json documentation instead of jsDoc. This PR also adds ReDoc to our documentation instad of apiDoc. Fixes #97 2018-08-05 15:19:11 +02:00
filipnyquist 6b3269bfe3 Added the breaking change of #93. Added the change, do not merge until the chainquery change has been merged and deployed. 2018-07-30 15:19:29 +02:00
filipnyquist 4423fc2cfc This PR adds channels into the index, this combined with the added channel filtering parameter allows us to search specific channels for content.
While adding the code for filtering I split the search query into individual parts so it easier can be edited and read.
2018-07-23 12:06:47 +02:00
Mark Beamer Jr d9a4af9636 removed effective amount function score from query. 2018-07-04 00:00:18 -04:00
Mark Beamer Jr 49a7c42e73 removed logging reference. 2018-07-03 23:51:39 -04:00
filipnyquist 22bf2b8a5d Added better winston logging, this saves logs up to 14days, then rotates them. This allows for easier debugging over time. 2018-06-28 14:24:00 +02:00
filipnyquist d418179feb Added a ENV variable for the elasticsearch url for easier debugging. 2018-06-27 15:04:41 +02:00
filipnyquist 0557855fab
Revert "Revert "Updated search query"" 2018-06-23 18:23:15 +02:00
filipnyquist 13a465fce3
Revert "Updated search query" 2018-06-21 18:24:57 +02:00
filipnyquist e9d7d75da6
Merge pull request #81 from lbryio/controlling_weight
Updated search query
2018-06-21 17:07:43 +02:00
Mark Beamer Jr 1b041f8e87 Updated search query to include controlling and effective amount weights. Also made sure the results are sorted properly so highest score is at the top. 2018-06-20 22:33:58 -04:00
Mark Beamer Jr dfcc5e3ef4 check against value not just _source 2018-06-20 22:17:59 -04:00