Commit graph

120 commits

Author SHA1 Message Date
Niko Storni
08068a2a47 add timestamp index 2019-12-02 18:01:20 +01:00
Mark Beamer Jr
5c68e32abb Strip @ prefix subquery
Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-11-20 16:14:04 -05:00
Niko Storni
f4115b0edc adjust channel ID lookup
index channel claim id for claims
2019-10-31 17:43:07 +01:00
Niko Storni
f1ad94d29d fix es storage object 2019-10-30 17:57:40 +01:00
Niko Storni
e7cf20eda4 address review comments 2019-10-15 00:04:47 +02:00
Niko Storni
9934258046 remove unused promises 2019-10-14 16:40:19 +02:00
Niko Storni
7bdf527ec9 feedback on drained queue 2019-10-14 16:40:19 +02:00
Niko Storni
42f2a6386c possibly improve memory management 2019-10-14 16:40:19 +02:00
Niko Storni
79b9eda568 don't spam slack 2019-10-14 16:40:19 +02:00
Niko Storni
c485b89972 construct object from mysql 2019-10-14 16:40:19 +02:00
Niko Storni
02f322059d parse json 2019-10-14 16:40:19 +02:00
Niko Storni
469ac7329a add debugging 2019-10-14 16:40:19 +02:00
Niko Storni
ba258cae03 replace API with db connector 2019-10-14 16:40:19 +02:00
Niko Storni
cc653ec5b6 reduce weight on channel tips 2019-10-14 16:39:50 +02:00
Mark Beamer Jr
715ecc3d92
Adding channel_id search back in. Reworked to avoid null queries being passed in.
Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-09-22 21:52:15 -04:00
Mark Beamer Jr
e9598d6b76
Comment channelIDSearch while I investigate to prevent an error.
Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-09-22 20:12:20 -04:00
Mark Beamer Jr
383626525d
Add channel_id parameter to search to restrict results to claims published to a specific channel's claim_id. This helps refine search for channels that have many bidding with the same name. 2019-09-21 20:27:05 -04:00
Mark Beamer Jr
4b88db1f55
Cleanup the sync
Add syncstate to status call
Remove old sync logic

Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-09-21 18:47:23 -04:00
Mark Beamer Jr
42bec75ef9
Set last sync time to start of sync when doing a long running sync.
Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-09-21 18:09:11 -04:00
Mark Beamer Jr
162107239b
Add capability to restart sync where it left off by storing state of the sync. Set to update
Signed-off-by: Mark Beamer Jr <markbeamerjr@gmail.com>
2019-09-21 17:25:18 -04:00
Mark Beamer Jr
c67f298ee6
Add channel id to claim if exists for more precise filtering 2019-09-19 22:15:52 -04:00
Thomas Zarebczan
c002a09d7e fix: eslint problems 2019-09-18 12:47:21 -04:00
Mark Beamer Jr
32ebc7ac9f
Only consider the 1st 3 terms in a search query for subqueries as they are likely to be related content searches and do not need to be so precise. 2019-07-16 20:30:15 -04:00
Mark Beamer Jr
7e99d9eace
Added more 1..n term based breakdown of query and concatenation to assist with partial matching. Added a massive weight so these likely scenario's or "intended" scenarios pass. 2019-07-13 01:49:12 -04:00
Mark Beamer Jr
127155ef16
Removed permanent wash to avoid exact match queries from failing. 2019-07-12 20:22:52 -04:00
Niko Storni
b873d93bf6 .io to .com 2019-07-08 20:00:10 +02:00
Mark Beamer Jr
db39a6c47f
skip bad claim when processing to ensure all future claims make it into elastic search. 2019-06-22 16:37:39 -04:00
Mark Beamer Jr
11d000119b
check for null value to notify lbry team. 2019-06-22 16:17:40 -04:00
Mark Beamer Jr
ea2fcb56ab
log error when step in sync process fails. 2019-06-21 00:11:16 -04:00
Mark Beamer Jr
4f5206d18e
Check for Claim field 2019-06-20 23:26:36 -04:00
Mark Beamer Jr
3a061df1a4
check for null and undefined 2019-05-31 22:02:00 -04:00
Mark Beamer Jr
4056fb86cf
use escaped query for query_string
removed comments
2019-02-28 21:45:56 -05:00
Mark Beamer Jr
a716124800
Added split function for multi word queries. This way it makes a contains query for each word in the query. 2019-02-28 21:34:40 -05:00
Mark Beamer Jr
5a9ce272b9
Added reverted changes back in 2019-02-26 08:50:26 -05:00
Mark
79a2470504
Revert "added channel effective amount to the claim weight." 2019-02-24 22:05:39 -05:00
Mark Beamer Jr
31f47fea76
Converted script scores to field_value_factor scores. This allows for a missing parameter to avoid the errors. 2019-02-24 21:41:22 -05:00
Mark Beamer Jr
101e55d924
added channel effective amount to the claim weight. 2019-02-24 17:03:50 -05:00
Mark Beamer Jr
81986315cb
Batched the chainquery calls for lighthouse in case it needs to grab all 700K in a redo. 2019-02-24 16:57:56 -05:00
marcdeb1
70415626c5
Added content type filter
Added claim type filter
Improved filtering and return no results when wrong input
List of types as input for mediaType and contentType
2019-02-09 16:54:29 -05:00
Thomas Zarebczan
423176da3f
Update lighthouse.js
decrease effective factor one more decimal to compare related content results while we work on proper query washing.
2018-11-13 13:23:01 -05:00
Mark Beamer Jr
5081e1bff9
added removal from query lbry:// ( lbry urls ) 2018-11-12 21:52:36 -05:00
Mark Beamer Jr
af4329b9e7
Added multi character splits to split by &, , and $ 2018-11-12 21:36:47 -05:00
Mark Beamer Jr
4bdb44abb5
fixed pull_request typo. 2018-11-08 09:47:07 -05:00
Mark
9ecc9b0fc2
Merge pull request #125 from marcdeb1/search_accuracy
Changed regex
2018-11-07 13:50:03 -05:00
Mark Beamer Jr
6380e8e6d6
Don't make 'Accepted' bid state claims searchable ( mempool ). Made esQuery a variable for easy debugging when needed. 2018-11-05 20:42:44 -05:00
Mark Beamer Jr
965746b9d2
added slack integration 2018-11-04 01:01:23 -04:00
Mark Beamer Jr
36db99ddca
Added auto-deployment for lighthouse 2018-11-04 01:01:22 -04:00
marcdeb1
c6b4d63eb2 Changed regex 2018-10-24 12:21:33 +02:00
Fillerino
7b9377deff Updated the API doc to add NSFW filtering 2018-10-21 22:41:17 +02:00
filipnyquist
e3e6d7c94d
Merge pull request #122 from marcdeb1/nsfw_filter
Added NSFW filter to query
2018-10-21 22:34:16 +02:00