Commit graph

108 commits

Author SHA1 Message Date
Niko Storni
ba258cae03 replace API with db connector 2019-10-14 16:40:19 +02:00
Niko Storni
cc653ec5b6 reduce weight on channel tips 2019-10-14 16:39:50 +02:00
Mark Beamer Jr
715ecc3d92
Adding channel_id search back in. Reworked to avoid null queries being passed in.
Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-09-22 21:52:15 -04:00
Mark Beamer Jr
e9598d6b76
Comment channelIDSearch while I investigate to prevent an error.
Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-09-22 20:12:20 -04:00
Mark Beamer Jr
383626525d
Add channel_id parameter to search to restrict results to claims published to a specific channel's claim_id. This helps refine search for channels that have many bidding with the same name. 2019-09-21 20:27:05 -04:00
Mark Beamer Jr
4b88db1f55
Cleanup the sync
Add syncstate to status call
Remove old sync logic

Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-09-21 18:47:23 -04:00
Mark Beamer Jr
42bec75ef9
Set last sync time to start of sync when doing a long running sync.
Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-09-21 18:09:11 -04:00
Mark Beamer Jr
162107239b
Add capability to restart sync where it left off by storing state of the sync. Set to update
Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-09-21 17:25:18 -04:00
Mark Beamer Jr
c67f298ee6
Add channel id to claim if exists for more precise filtering 2019-09-19 22:15:52 -04:00
Thomas Zarebczan
c002a09d7e fix: eslint problems 2019-09-18 12:47:21 -04:00
Mark Beamer Jr
32ebc7ac9f
Only consider the 1st 3 terms in a search query for subqueries as they are likely to be related content searches and do not need to be so precise. 2019-07-16 20:30:15 -04:00
Mark Beamer Jr
7e99d9eace
Added more 1..n term based breakdown of query and concatenation to assist with partial matching. Added a massive weight so these likely scenario's or "intended" scenarios pass. 2019-07-13 01:49:12 -04:00
Mark Beamer Jr
127155ef16
Removed permanent wash to avoid exact match queries from failing. 2019-07-12 20:22:52 -04:00
Niko Storni
b873d93bf6 .io to .com 2019-07-08 20:00:10 +02:00
Mark Beamer Jr
db39a6c47f
skip bad claim when processing to ensure all future claims make it into elastic search. 2019-06-22 16:37:39 -04:00
Mark Beamer Jr
11d000119b
check for null value to notify lbry team. 2019-06-22 16:17:40 -04:00
Mark Beamer Jr
ea2fcb56ab
log error when step in sync process fails. 2019-06-21 00:11:16 -04:00
Mark Beamer Jr
4f5206d18e
Check for Claim field 2019-06-20 23:26:36 -04:00
Mark Beamer Jr
3a061df1a4
check for null and undefined 2019-05-31 22:02:00 -04:00
Mark Beamer Jr
4056fb86cf
use escaped query for query_string
removed comments
2019-02-28 21:45:56 -05:00
Mark Beamer Jr
a716124800
Added split function for multi word queries. This way it makes a contains query for each word in the query. 2019-02-28 21:34:40 -05:00
Mark Beamer Jr
5a9ce272b9
Added reverted changes back in 2019-02-26 08:50:26 -05:00
Mark
79a2470504
Revert "added channel effective amount to the claim weight." 2019-02-24 22:05:39 -05:00
Mark Beamer Jr
31f47fea76
Converted script scores to field_value_factor scores. This allows for a missing parameter to avoid the errors. 2019-02-24 21:41:22 -05:00
Mark Beamer Jr
101e55d924
added channel effective amount to the claim weight. 2019-02-24 17:03:50 -05:00
Mark Beamer Jr
81986315cb
Batched the chainquery calls for lighthouse in case it needs to grab all 700K in a redo. 2019-02-24 16:57:56 -05:00
marcdeb1
70415626c5
Added content type filter
Added claim type filter
Improved filtering and return no results when wrong input
List of types as input for mediaType and contentType
2019-02-09 16:54:29 -05:00
Thomas Zarebczan
423176da3f
Update lighthouse.js
decrease effective factor one more decimal to compare related content results while we work on proper query washing.
2018-11-13 13:23:01 -05:00
Mark Beamer Jr
5081e1bff9
added removal from query lbry:// ( lbry urls ) 2018-11-12 21:52:36 -05:00
Mark Beamer Jr
af4329b9e7
Added multi character splits to split by &, , and $ 2018-11-12 21:36:47 -05:00
Mark Beamer Jr
4bdb44abb5
fixed pull_request typo. 2018-11-08 09:47:07 -05:00
Mark
9ecc9b0fc2
Merge pull request #125 from marcdeb1/search_accuracy
Changed regex
2018-11-07 13:50:03 -05:00
Mark Beamer Jr
6380e8e6d6
Don't make 'Accepted' bid state claims searchable ( mempool ). Made esQuery a variable for easy debugging when needed. 2018-11-05 20:42:44 -05:00
Mark Beamer Jr
965746b9d2
added slack integration 2018-11-04 01:01:23 -04:00
Mark Beamer Jr
36db99ddca
Added auto-deployment for lighthouse 2018-11-04 01:01:22 -04:00
marcdeb1
c6b4d63eb2 Changed regex 2018-10-24 12:21:33 +02:00
Fillerino
7b9377deff Updated the API doc to add NSFW filtering 2018-10-21 22:41:17 +02:00
filipnyquist
e3e6d7c94d
Merge pull request #122 from marcdeb1/nsfw_filter
Added NSFW filter to query
2018-10-21 22:34:16 +02:00
Mark Beamer Jr
a409396f69
fixed some lint issues and function name 2018-10-21 00:06:39 -04:00
marcdeb1
b4052fc921 Syntax and indentationn 2018-10-18 08:36:04 +02:00
marcdeb1
44ea0093ef Added NSFW filter to query 2018-10-17 11:42:25 +02:00
Mark Beamer Jr
5b2b274423
added blacklist for words.
don't search words less than 3 characters
2018-09-26 21:32:42 -04:00
Mark
6d52314f16
Merge pull request #114 from lbryio/trim_white_space
Trim white space
2018-09-23 10:35:37 -04:00
Mark
6e07477689
Merge pull request #115 from lbryio/addition_reserved_characters
I was missing some additional special characters
2018-09-23 10:35:12 -04:00
Mark Beamer Jr
56545cfed2
Fixed the auto-complete query to leverage the nested structure and to return only relevant claims and the text that triggered the auto-complete. 2018-09-16 01:52:19 -04:00
Mark Beamer Jr
6960a0084e
I was missing some additional special characters that needed to be escaped. 2018-09-15 22:13:01 -04:00
Mark Beamer Jr
ad533e3989
trimmed whitespace for search terms. 2018-09-15 21:44:15 -04:00
filipnyquist
fa18e29a8a
Update lighthouse.js 2018-08-22 19:56:09 +02:00
filipnyquist
b64ef9f97a
Added back #81
Added back: 
Updated search query to include controlling and effective amount weights. Also made sure the results are sorted properly so highest score is at the top.
2018-08-22 16:38:15 +02:00
Mark Beamer Jr
9469f953d6 added escape function to escape special characters for the query_string elastic search query. 2018-08-14 20:58:53 -04:00