Commit graph

560 commits

Author SHA1 Message Date
Jack Robison
7fe34ebb78
reduce hub writer polling delay 2022-01-19 10:38:37 -05:00
Jack Robison
ff8c08b289
executors 2022-01-19 10:38:37 -05:00
Jack Robison
d7707d0053
cleanup debug logging 2022-01-19 10:38:37 -05:00
Jack Robison
a7d64de361
rocksdb column families 2022-01-19 10:38:37 -05:00
Jack Robison
8a02796b37
executors for each reader, fix shutdown 2022-01-19 10:38:37 -05:00
Jack Robison
e3a4dab6cb
es sync notifier 2022-01-19 10:38:37 -05:00
Jack Robison
03f888f787
reader/writer move from cli 2022-01-19 10:38:37 -05:00
Jack Robison
d072b9f70b
remove redundant undo cleanup, don't delete historic touched_or_deleted 2022-01-19 10:38:37 -05:00
Jack Robison
8616fb96b1
imports, impove errors 2022-01-19 10:38:37 -05:00
Jack Robison
ebec12522b
es writer 2022-01-19 10:38:37 -05:00
Jack Robison
611ad5c655
add chain reader and reader server, new mempool, update block processor 2022-01-19 10:38:37 -05:00
Jack Robison
e06c8e8303
update undo key to include the block hash 2022-01-19 10:38:37 -05:00
Jack Robison
776dea58c2
move Prefetcher to own file 2022-01-19 10:38:37 -05:00
Jack Robison
28be7d8993
move HubDB, delete leveldb.py 2022-01-19 10:38:37 -05:00
Jack Robison
24622103cf
add mempool, trending, and touched address indexes to the hub db 2022-01-19 10:38:37 -05:00
Jack Robison
2d8ed77806
use rocksdb instead of leveldb
-dont use block processor directly from session manager
2022-01-19 10:38:37 -05:00
Victor Shyba
2a4c5a48bf increase indexed sd_hash prefix to 4 chars 2022-01-05 17:10:31 -03:00
Victor Shyba
5f5f39a4aa enable and test prefix search for sd hash 2022-01-05 17:10:31 -03:00
Victor Shyba
df54cc04af sync and search sd_hash 2022-01-05 17:10:31 -03:00
Lex Berezhny
1eaa195363 reduced crypto dependency in wallet to coincurve 2021-12-22 18:29:46 -05:00
Jack Robison
58341f4ff1
remove unused ES fields 2021-12-03 13:03:00 -05:00
Jack Robison
0d3ca80008
support lists of constraints for all range fields 2021-12-03 13:03:00 -05:00
Jack Robison
7bb293e5d6 update claim_search doc
backward compatibility for `trending_mixed`, `trending_local`, `trending_global`, and `trending_group` args to `claim_search`
2021-12-02 14:51:52 -05:00
Victor Shyba
e7458edb72 test case for stream_type search on claims missing source + fix 2021-12-01 18:42:47 -05:00
Jack Robison
7531401623
keep touched_or_deleted records 2021-11-21 13:52:03 -05:00
Brendon J. Brewer
3f6fe995b8 Rename trending 2021-11-16 10:59:10 -05:00
Jack Robison
1e00fb369d fix missing es notification for support amount changing 2021-11-15 00:58:18 -05:00
Jack Robison
54b522383a improve tests 2021-11-15 00:58:18 -05:00
Jack Robison
3fe1582432 fix duplicate trending notification to ES 2021-11-15 00:58:18 -05:00
Jack Robison
85eddd2100 fix effective amount for resolve/ES being off while claims/supports are unactivated 2021-11-15 00:58:18 -05:00
Jack Robison
ddbbb6f1dd
use mempool cache in transaction_get_batch 2021-10-27 20:19:08 -04:00
Jack Robison
1e391d211b
fix attempting to update trending on abandoned claims 2021-10-23 18:39:04 -04:00
Jack Robison
1a74d6604d skip loading tx/claim caches in the elastic sync script when not needed 2021-10-22 15:10:35 -04:00
Jack Robison
48505c2968 update trending with help from @eggplantbren 2021-10-21 00:17:12 -04:00
Jack Robison
a98ea1e66a update sync script to handle ES falling behind leveldb on shutdown 2021-10-20 23:41:11 -04:00
Jack Robison
3dec697816 logging 2021-10-20 23:41:11 -04:00
Jack Robison
b05d071a1c update Env to accept parameters from cli args 2021-10-20 23:41:11 -04:00
Jack Robison
a27d3b9689 set default CACHE_MB to 1024mb and the default QUERY_TIMEOUT_MS to 10s 2021-10-20 23:41:11 -04:00
Jack Robison
1facc0cd01 remove unused hub env settings 2021-10-20 23:41:11 -04:00
Jack Robison
6bef09a3b1 update lbry-hub-elastic-sync to support resyncing recent blocks 2021-10-19 15:53:20 -04:00
Jack Robison
e35319e5a2 add CACHE_ALL_CLAIM_TXOS hub setting 2021-10-19 15:53:20 -04:00
Jack Robison
0e548b3812 remove dead code 2021-10-19 15:53:20 -04:00
Jack Robison
bfac02ccab add CACHE_ALL_TX_HASHES setting to optionally use more memory to save i/o 2021-10-19 15:53:20 -04:00
Jack Robison
7ea1a2b361 sleeps 2021-10-19 15:53:20 -04:00
Jack Robison
99df418f1d improve resolve caching 2021-10-19 15:53:20 -04:00
Jack Robison
6416d8ce9c threadpools for block processor and es sync reader 2021-10-19 15:53:20 -04:00
Jack Robison
22b43a2b01 doc strings 2021-10-19 15:53:20 -04:00
Jack Robison
05e5d24c5e improve claims_producer performance 2021-10-19 15:53:20 -04:00
Jack Robison
eabcc30367 resolve lru cache 2021-10-19 15:53:20 -04:00
Jack Robison
f5e0ef5223 add block_txs index 2021-10-19 15:53:20 -04:00