Commit graph

118 commits

Author SHA1 Message Date
Niko Storni f4115b0edc adjust channel ID lookup
index channel claim id for claims
2019-10-31 17:43:07 +01:00
Niko Storni f1ad94d29d fix es storage object 2019-10-30 17:57:40 +01:00
Niko Storni e7cf20eda4 address review comments 2019-10-15 00:04:47 +02:00
Niko Storni 9934258046 remove unused promises 2019-10-14 16:40:19 +02:00
Niko Storni 7bdf527ec9 feedback on drained queue 2019-10-14 16:40:19 +02:00
Niko Storni 42f2a6386c possibly improve memory management 2019-10-14 16:40:19 +02:00
Niko Storni 79b9eda568 don't spam slack 2019-10-14 16:40:19 +02:00
Niko Storni c485b89972 construct object from mysql 2019-10-14 16:40:19 +02:00
Niko Storni 02f322059d parse json 2019-10-14 16:40:19 +02:00
Niko Storni 469ac7329a add debugging 2019-10-14 16:40:19 +02:00
Niko Storni ba258cae03 replace API with db connector 2019-10-14 16:40:19 +02:00
Niko Storni cc653ec5b6 reduce weight on channel tips 2019-10-14 16:39:50 +02:00
Mark Beamer Jr 715ecc3d92
Adding channel_id search back in. Reworked to avoid null queries being passed in.
Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-09-22 21:52:15 -04:00
Mark Beamer Jr e9598d6b76
Comment channelIDSearch while I investigate to prevent an error.
Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-09-22 20:12:20 -04:00
Mark Beamer Jr 383626525d
Add channel_id parameter to search to restrict results to claims published to a specific channel's claim_id. This helps refine search for channels that have many bidding with the same name. 2019-09-21 20:27:05 -04:00
Mark Beamer Jr 4b88db1f55
Cleanup the sync
Add syncstate to status call
Remove old sync logic

Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-09-21 18:47:23 -04:00
Mark Beamer Jr 42bec75ef9
Set last sync time to start of sync when doing a long running sync.
Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-09-21 18:09:11 -04:00
Mark Beamer Jr 162107239b
Add capability to restart sync where it left off by storing state of the sync. Set to update
Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-09-21 17:25:18 -04:00
Mark Beamer Jr c67f298ee6
Add channel id to claim if exists for more precise filtering 2019-09-19 22:15:52 -04:00
Thomas Zarebczan c002a09d7e fix: eslint problems 2019-09-18 12:47:21 -04:00
Mark Beamer Jr 32ebc7ac9f
Only consider the 1st 3 terms in a search query for subqueries as they are likely to be related content searches and do not need to be so precise. 2019-07-16 20:30:15 -04:00
Mark Beamer Jr 7e99d9eace
Added more 1..n term based breakdown of query and concatenation to assist with partial matching. Added a massive weight so these likely scenario's or "intended" scenarios pass. 2019-07-13 01:49:12 -04:00
Mark Beamer Jr 127155ef16
Removed permanent wash to avoid exact match queries from failing. 2019-07-12 20:22:52 -04:00
Niko Storni b873d93bf6 .io to .com 2019-07-08 20:00:10 +02:00
Mark Beamer Jr db39a6c47f
skip bad claim when processing to ensure all future claims make it into elastic search. 2019-06-22 16:37:39 -04:00
Mark Beamer Jr 11d000119b
check for null value to notify lbry team. 2019-06-22 16:17:40 -04:00
Mark Beamer Jr ea2fcb56ab
log error when step in sync process fails. 2019-06-21 00:11:16 -04:00
Mark Beamer Jr 4f5206d18e
Check for Claim field 2019-06-20 23:26:36 -04:00
Mark Beamer Jr 3a061df1a4
check for null and undefined 2019-05-31 22:02:00 -04:00
Mark Beamer Jr 4056fb86cf
use escaped query for query_string
removed comments
2019-02-28 21:45:56 -05:00
Mark Beamer Jr a716124800
Added split function for multi word queries. This way it makes a contains query for each word in the query. 2019-02-28 21:34:40 -05:00
Mark Beamer Jr 5a9ce272b9
Added reverted changes back in 2019-02-26 08:50:26 -05:00
Mark 79a2470504
Revert "added channel effective amount to the claim weight." 2019-02-24 22:05:39 -05:00
Mark Beamer Jr 31f47fea76
Converted script scores to field_value_factor scores. This allows for a missing parameter to avoid the errors. 2019-02-24 21:41:22 -05:00
Mark Beamer Jr 101e55d924
added channel effective amount to the claim weight. 2019-02-24 17:03:50 -05:00
Mark Beamer Jr 81986315cb
Batched the chainquery calls for lighthouse in case it needs to grab all 700K in a redo. 2019-02-24 16:57:56 -05:00
marcdeb1 70415626c5
Added content type filter
Added claim type filter
Improved filtering and return no results when wrong input
List of types as input for mediaType and contentType
2019-02-09 16:54:29 -05:00
Thomas Zarebczan 423176da3f
Update lighthouse.js
decrease effective factor one more decimal to compare related content results while we work on proper query washing.
2018-11-13 13:23:01 -05:00
Mark Beamer Jr 5081e1bff9
added removal from query lbry:// ( lbry urls ) 2018-11-12 21:52:36 -05:00
Mark Beamer Jr af4329b9e7
Added multi character splits to split by &, , and $ 2018-11-12 21:36:47 -05:00
Mark Beamer Jr 4bdb44abb5
fixed pull_request typo. 2018-11-08 09:47:07 -05:00
Mark 9ecc9b0fc2
Merge pull request #125 from marcdeb1/search_accuracy
Changed regex
2018-11-07 13:50:03 -05:00
Mark Beamer Jr 6380e8e6d6
Don't make 'Accepted' bid state claims searchable ( mempool ). Made esQuery a variable for easy debugging when needed. 2018-11-05 20:42:44 -05:00
Mark Beamer Jr 965746b9d2
added slack integration 2018-11-04 01:01:23 -04:00
Mark Beamer Jr 36db99ddca
Added auto-deployment for lighthouse 2018-11-04 01:01:22 -04:00
marcdeb1 c6b4d63eb2 Changed regex 2018-10-24 12:21:33 +02:00
Fillerino 7b9377deff Updated the API doc to add NSFW filtering 2018-10-21 22:41:17 +02:00
filipnyquist e3e6d7c94d
Merge pull request #122 from marcdeb1/nsfw_filter
Added NSFW filter to query
2018-10-21 22:34:16 +02:00
Mark Beamer Jr a409396f69
fixed some lint issues and function name 2018-10-21 00:06:39 -04:00
marcdeb1 b4052fc921 Syntax and indentationn 2018-10-18 08:36:04 +02:00