LBRYCommunity/lighthouse.js
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
202 commits 4 branches 0 tags 3.6 MiB
Commit graph

70 commits

Author SHA1 Message Date
Mark Beamer Jr
7e99d9eace
Added more 1..n term based breakdown of query and concatenation to assist with partial matching. Added a massive weight so these likely scenario's or "intended" scenarios pass. 2019-07-13 01:49:12 -04:00
Mark Beamer Jr
127155ef16
Removed permanent wash to avoid exact match queries from failing. 2019-07-12 20:22:52 -04:00
Mark Beamer Jr
ea2fcb56ab
log error when step in sync process fails. 2019-06-21 00:11:16 -04:00
Mark Beamer Jr
3a061df1a4
check for null and undefined 2019-05-31 22:02:00 -04:00
Mark Beamer Jr
4056fb86cf
use escaped query for query_string 
removed comments
 2019-02-28 21:45:56 -05:00
Mark Beamer Jr
a716124800
Added split function for multi word queries. This way it makes a contains query for each word in the query. 2019-02-28 21:34:40 -05:00
Mark Beamer Jr
5a9ce272b9
Added reverted changes back in 2019-02-26 08:50:26 -05:00
Mark
79a2470504
Revert "added channel effective amount to the claim weight." 2019-02-24 22:05:39 -05:00
Mark Beamer Jr
31f47fea76
Converted script scores to field_value_factor scores. This allows for a missing parameter to avoid the errors. 2019-02-24 21:41:22 -05:00
Mark Beamer Jr
101e55d924
added channel effective amount to the claim weight. 2019-02-24 17:03:50 -05:00
marcdeb1
70415626c5
Added content type filter 
Added claim type filter
Improved filtering and return no results when wrong input
List of types as input for mediaType and contentType
 2019-02-09 16:54:29 -05:00
Thomas Zarebczan
423176da3f
Update lighthouse.js 
decrease effective factor one more decimal to compare related content results while we work on proper query washing.
 2018-11-13 13:23:01 -05:00
Mark Beamer Jr
5081e1bff9
added removal from query lbry:// ( lbry urls ) 2018-11-12 21:52:36 -05:00
Mark Beamer Jr
af4329b9e7
Added multi character splits to split by &, , and $ 2018-11-12 21:36:47 -05:00
Mark Beamer Jr
4bdb44abb5
fixed pull_request typo. 2018-11-08 09:47:07 -05:00
Mark
9ecc9b0fc2
Merge pull request #125 from marcdeb1/search_accuracy 
Changed regex
 2018-11-07 13:50:03 -05:00
Mark Beamer Jr
6380e8e6d6
Don't make 'Accepted' bid state claims searchable ( mempool ). Made esQuery a variable for easy debugging when needed. 2018-11-05 20:42:44 -05:00
Mark Beamer Jr
965746b9d2
added slack integration 2018-11-04 01:01:23 -04:00
Mark Beamer Jr
36db99ddca
Added auto-deployment for lighthouse 2018-11-04 01:01:22 -04:00
marcdeb1
c6b4d63eb2 Changed regex 2018-10-24 12:21:33 +02:00
filipnyquist
e3e6d7c94d
Merge pull request #122 from marcdeb1/nsfw_filter 
Added NSFW filter to query
 2018-10-21 22:34:16 +02:00
Mark Beamer Jr
a409396f69
fixed some lint issues and function name 2018-10-21 00:06:39 -04:00
marcdeb1
b4052fc921 Syntax and indentationn 2018-10-18 08:36:04 +02:00
marcdeb1
44ea0093ef Added NSFW filter to query 2018-10-17 11:42:25 +02:00
Mark Beamer Jr
5b2b274423
added blacklist for words. 
don't search words less than 3 characters
 2018-09-26 21:32:42 -04:00
Mark
6d52314f16
Merge pull request #114 from lbryio/trim_white_space 
Trim white space
 2018-09-23 10:35:37 -04:00
Mark
6e07477689
Merge pull request #115 from lbryio/addition_reserved_characters 
I was missing some additional special characters
 2018-09-23 10:35:12 -04:00
Mark Beamer Jr
56545cfed2
Fixed the auto-complete query to leverage the nested structure and to return only relevant claims and the text that triggered the auto-complete. 2018-09-16 01:52:19 -04:00
Mark Beamer Jr
6960a0084e
I was missing some additional special characters that needed to be escaped. 2018-09-15 22:13:01 -04:00
Mark Beamer Jr
ad533e3989
trimmed whitespace for search terms. 2018-09-15 21:44:15 -04:00
filipnyquist
fa18e29a8a
Update lighthouse.js 2018-08-22 19:56:09 +02:00
filipnyquist
b64ef9f97a
Added back #81 
Added back: 
Updated search query to include controlling and effective amount weights. Also made sure the results are sorted properly so highest score is at the top.
 2018-08-22 16:38:15 +02:00
Mark Beamer Jr
9469f953d6 added escape function to escape special characters for the query_string elastic search query. 2018-08-14 20:58:53 -04:00
filipnyquist
4423fc2cfc This PR adds channels into the index, this combined with the added channel filtering parameter allows us to search specific channels for content. 
While adding the code for filtering I split the search query into individual parts so it easier can be edited and read.
 2018-07-23 12:06:47 +02:00
Mark Beamer Jr
d9a4af9636 removed effective amount function score from query. 2018-07-04 00:00:18 -04:00
filipnyquist
d418179feb Added a ENV variable for the elasticsearch url for easier debugging. 2018-06-27 15:04:41 +02:00
filipnyquist
0557855fab
Revert "Revert "Updated search query"" 2018-06-23 18:23:15 +02:00
filipnyquist
13a465fce3
Revert "Updated search query" 2018-06-21 18:24:57 +02:00
filipnyquist
e9d7d75da6
Merge pull request #81 from lbryio/controlling_weight 
Updated search query
 2018-06-21 17:07:43 +02:00
Mark Beamer Jr
1b041f8e87 Updated search query to include controlling and effective amount weights. Also made sure the results are sorted properly so highest score is at the top. 2018-06-20 22:33:58 -04:00
Mark Beamer Jr
dfcc5e3ef4 check against value not just _source 2018-06-20 22:17:59 -04:00
Mark Beamer Jr
20eedbc660 Fixed bug caused by blank claims ( deleted ) which resulted in internal server error. 2018-06-20 19:18:09 -04:00
Mark Beamer Jr
b1c7f8b8ca -chainquery integration. Instead of using lbrycrd directly, use the chainquery app as the intermediary. 2018-05-12 19:35:56 -04:00
Mark Beamer Jr
b7e0cb327a -added check to make sure size + from stays under 10,000 2018-04-29 22:09:28 -04:00
Mark Beamer Jr
69d770b032 Added size for number of results to get and from for pagination. 2018-04-26 20:11:18 -04:00
filipnyquist
b76b7b7a58
Merge pull request #61 from lbryio/autocomplete_fix 
The internal server error was because we were checking for a null val…
 2018-04-08 09:17:02 +02:00
Mark Beamer Jr
482efbdb5f The internal server error was because we were checking for a null value for a claim. This is already checked and should never be null. The intention is to make sure we can get the right information out which is only available in a stream. However, there is no stream for channel claims, only certificates. So the fix is to check for null on the stream not the value. 2018-04-08 02:36:57 -04:00
Mark Beamer Jr
c32f8e9367 I modified the query to be more complex so that relevancy is considered. 
Features of the query are below in order of importance(weight):

1) Phrase Match on Name
2) Term Match on Name
3) Contains Term on Name
4) Phrase Match on Author,Title,Description
5) Term Match on Author,Title,Description
6) Contains Term on Author,Title,Description
 2018-03-14 23:18:15 -04:00
Mark Beamer Jr
90e2d3f64b changed weight to 5 from 100. I made the weight 5 based on tests around "super" which is a query that returns 1800 hits. The intention is to make sure that channels show up first in the results. 2018-03-13 21:43:08 -04:00
Mark Beamer Jr
00a41e9e19 using ^n on a field is only valid syntax for lycene. This caused the name field to never be search which resulted in channels not being searchable. I added the boost parameter which is what is supposed to be used. I made the weight 5 based tests around "super" which is a query that returns 1800 hits. The intention is to make sure that channels show up first in the results. 2018-03-13 21:37:57 -04:00