Commit graph

573 commits

Author SHA1 Message Date
Jack Robison
7d973aaaa8
Merge branch 'lbcd-integration-2' into rocksdb-hub-lbcd
# Conflicts:
#	lbry/testcase.py
#	lbry/wallet/orchstr8/node.py
#	lbry/wallet/server/db/db.py
#	lbry/wallet/server/db/prefixes.py
#	lbry/wallet/server/server.py
#	lbry/wallet/server/session.py
#	setup.py
#	tests/integration/takeovers/test_resolve_command.py
#	tests/integration/transactions/test_internal_transaction_api.py
#	tests/integration/transactions/test_transactions.py
2022-01-21 13:32:17 -05:00
Jack Robison
bd284be69d
drop ES_MODE hub setting, rename hub entry points
`lbry-hub-writer` - keeps an up-to-date database
`lbry-hub-server` - replies to clients with data from a read only snapshot of the db
`lbry-hub-elastic-sync` - watches for changes to the db and updates elasticsearch accordingly
2022-01-21 12:37:44 -05:00
Jack Robison
d6035c1ead
delete unused code 2022-01-21 12:37:44 -05:00
Jack Robison
876a72f18d
update mempool in thread 2022-01-21 12:37:44 -05:00
Jack Robison
b82dc8e45f
fix tests 2022-01-21 12:37:44 -05:00
Jack Robison
31144a490e
fix filtering/blocking 2022-01-21 12:37:44 -05:00
Jeffrey Picard
2bd60f692c fix ssl connections and add new docker file 2022-01-19 15:57:00 +00:00
Jack Robison
607d7d9cc7
logging, update lbry-rocksdb requirement 2022-01-19 10:38:37 -05:00
Jack Robison
3c7307a2f4
wait for writing to finish before closing the db 2022-01-19 10:38:37 -05:00
Jack Robison
bbfe263591
fix unwinding readers during reorg 2022-01-19 10:38:37 -05:00
Jack Robison
7fe34ebb78
reduce hub writer polling delay 2022-01-19 10:38:37 -05:00
Jack Robison
ff8c08b289
executors 2022-01-19 10:38:37 -05:00
Jack Robison
d7707d0053
cleanup debug logging 2022-01-19 10:38:37 -05:00
Jack Robison
a7d64de361
rocksdb column families 2022-01-19 10:38:37 -05:00
Jack Robison
8a02796b37
executors for each reader, fix shutdown 2022-01-19 10:38:37 -05:00
Jack Robison
e3a4dab6cb
es sync notifier 2022-01-19 10:38:37 -05:00
Jack Robison
03f888f787
reader/writer move from cli 2022-01-19 10:38:37 -05:00
Jack Robison
d072b9f70b
remove redundant undo cleanup, don't delete historic touched_or_deleted 2022-01-19 10:38:37 -05:00
Jack Robison
8616fb96b1
imports, impove errors 2022-01-19 10:38:37 -05:00
Jack Robison
ebec12522b
es writer 2022-01-19 10:38:37 -05:00
Jack Robison
611ad5c655
add chain reader and reader server, new mempool, update block processor 2022-01-19 10:38:37 -05:00
Jack Robison
e06c8e8303
update undo key to include the block hash 2022-01-19 10:38:37 -05:00
Jack Robison
776dea58c2
move Prefetcher to own file 2022-01-19 10:38:37 -05:00
Jack Robison
28be7d8993
move HubDB, delete leveldb.py 2022-01-19 10:38:37 -05:00
Jack Robison
24622103cf
add mempool, trending, and touched address indexes to the hub db 2022-01-19 10:38:37 -05:00
Jack Robison
2d8ed77806
use rocksdb instead of leveldb
-dont use block processor directly from session manager
2022-01-19 10:38:37 -05:00
Brannon King
20e6f87af9 fixing a variety of broken tests, updated getclaimbyid usage 2022-01-17 14:11:36 -05:00
Roy Lee
13dec8756b test: update some RPC arguments to int type 2022-01-17 14:08:58 -05:00
Jack Robison
bf3dec9c89 use rocksdb instead of leveldb
-dont use block processor directly from session manager
2022-01-17 14:08:58 -05:00
Victor Shyba
2a4c5a48bf increase indexed sd_hash prefix to 4 chars 2022-01-05 17:10:31 -03:00
Victor Shyba
5f5f39a4aa enable and test prefix search for sd hash 2022-01-05 17:10:31 -03:00
Victor Shyba
df54cc04af sync and search sd_hash 2022-01-05 17:10:31 -03:00
Lex Berezhny
1eaa195363 reduced crypto dependency in wallet to coincurve 2021-12-22 18:29:46 -05:00
Jack Robison
58341f4ff1
remove unused ES fields 2021-12-03 13:03:00 -05:00
Jack Robison
0d3ca80008
support lists of constraints for all range fields 2021-12-03 13:03:00 -05:00
Jack Robison
7bb293e5d6 update claim_search doc
backward compatibility for `trending_mixed`, `trending_local`, `trending_global`, and `trending_group` args to `claim_search`
2021-12-02 14:51:52 -05:00
Victor Shyba
e7458edb72 test case for stream_type search on claims missing source + fix 2021-12-01 18:42:47 -05:00
Jack Robison
7531401623
keep touched_or_deleted records 2021-11-21 13:52:03 -05:00
Brendon J. Brewer
3f6fe995b8 Rename trending 2021-11-16 10:59:10 -05:00
Jack Robison
1e00fb369d fix missing es notification for support amount changing 2021-11-15 00:58:18 -05:00
Jack Robison
54b522383a improve tests 2021-11-15 00:58:18 -05:00
Jack Robison
3fe1582432 fix duplicate trending notification to ES 2021-11-15 00:58:18 -05:00
Jack Robison
85eddd2100 fix effective amount for resolve/ES being off while claims/supports are unactivated 2021-11-15 00:58:18 -05:00
Jack Robison
ddbbb6f1dd
use mempool cache in transaction_get_batch 2021-10-27 20:19:08 -04:00
Jack Robison
1e391d211b
fix attempting to update trending on abandoned claims 2021-10-23 18:39:04 -04:00
Jack Robison
1a74d6604d skip loading tx/claim caches in the elastic sync script when not needed 2021-10-22 15:10:35 -04:00
Jack Robison
48505c2968 update trending with help from @eggplantbren 2021-10-21 00:17:12 -04:00
Jack Robison
a98ea1e66a update sync script to handle ES falling behind leveldb on shutdown 2021-10-20 23:41:11 -04:00
Jack Robison
3dec697816 logging 2021-10-20 23:41:11 -04:00
Jack Robison
b05d071a1c update Env to accept parameters from cli args 2021-10-20 23:41:11 -04:00