Commit graph

1936 commits

Author SHA1 Message Date
Jack Robison
bd284be69d
drop ES_MODE hub setting, rename hub entry points
`lbry-hub-writer` - keeps an up-to-date database
`lbry-hub-server` - replies to clients with data from a read only snapshot of the db
`lbry-hub-elastic-sync` - watches for changes to the db and updates elasticsearch accordingly
2022-01-21 12:37:44 -05:00
Jack Robison
d6035c1ead
delete unused code 2022-01-21 12:37:44 -05:00
Jack Robison
876a72f18d
update mempool in thread 2022-01-21 12:37:44 -05:00
Jack Robison
b82dc8e45f
fix tests 2022-01-21 12:37:44 -05:00
Jack Robison
31144a490e
fix filtering/blocking 2022-01-21 12:37:44 -05:00
Jack Robison
a2e7afa87f
pylint 2022-01-19 10:38:37 -05:00
Jack Robison
607d7d9cc7
logging, update lbry-rocksdb requirement 2022-01-19 10:38:37 -05:00
Jack Robison
3c7307a2f4
wait for writing to finish before closing the db 2022-01-19 10:38:37 -05:00
Jack Robison
bbfe263591
fix unwinding readers during reorg 2022-01-19 10:38:37 -05:00
Jack Robison
7fe34ebb78
reduce hub writer polling delay 2022-01-19 10:38:37 -05:00
Jack Robison
ff8c08b289
executors 2022-01-19 10:38:37 -05:00
Jack Robison
d7707d0053
cleanup debug logging 2022-01-19 10:38:37 -05:00
Jack Robison
a7d64de361
rocksdb column families 2022-01-19 10:38:37 -05:00
Jack Robison
8a02796b37
executors for each reader, fix shutdown 2022-01-19 10:38:37 -05:00
Jack Robison
4f4ecd64cc
tests 2022-01-19 10:38:37 -05:00
Jack Robison
e3a4dab6cb
es sync notifier 2022-01-19 10:38:37 -05:00
Jack Robison
03f888f787
reader/writer move from cli 2022-01-19 10:38:37 -05:00
Jack Robison
d072b9f70b
remove redundant undo cleanup, don't delete historic touched_or_deleted 2022-01-19 10:38:37 -05:00
Jack Robison
8616fb96b1
imports, impove errors 2022-01-19 10:38:37 -05:00
Jack Robison
ebec12522b
es writer 2022-01-19 10:38:37 -05:00
Jack Robison
611ad5c655
add chain reader and reader server, new mempool, update block processor 2022-01-19 10:38:37 -05:00
Jack Robison
e06c8e8303
update undo key to include the block hash 2022-01-19 10:38:37 -05:00
Jack Robison
776dea58c2
move Prefetcher to own file 2022-01-19 10:38:37 -05:00
Jack Robison
28be7d8993
move HubDB, delete leveldb.py 2022-01-19 10:38:37 -05:00
Jack Robison
24622103cf
add mempool, trending, and touched address indexes to the hub db 2022-01-19 10:38:37 -05:00
Jack Robison
2d8ed77806
use rocksdb instead of leveldb
-dont use block processor directly from session manager
2022-01-19 10:38:37 -05:00
Lex Berezhny
302461b446 updated based on code review 2022-01-17 11:08:28 -05:00
Lex Berezhny
ac201c718e drop dependency on cryptography library in wallet module 2022-01-17 10:43:59 -05:00
Victor Shyba
0618053bd4 remove request_flight metric 2022-01-12 12:41:04 -03:00
Victor Shyba
fd9dcbf9a8 add granular metric for stored blob prefix, for network announcements calculation 2022-01-12 12:39:23 -03:00
Victor Shyba
beb8583436 change colliding bits metric to gauge 2022-01-12 12:39:23 -03:00
Victor Shyba
b44e2c0b38 count bit collisions between 8 and 16 2022-01-12 12:39:23 -03:00
Victor Shyba
06e94640b5 add counter for peers with colliding bytes 2022-01-12 12:39:23 -03:00
Victor Shyba
ff36bdc802 add requests in flight and error 2022-01-12 12:39:23 -03:00
Victor Shyba
46f576de46 add request received 2022-01-12 12:39:23 -03:00
Victor Shyba
7b09c34fce add request_sent and request_time metric on dht 2022-01-12 12:39:23 -03:00
Victor Shyba
a22f50aa84 add storing_peers and peer_manager_keys 2022-01-12 12:39:23 -03:00
Victor Shyba
2d9130b4e0 prometheus: move blobs_stored and peers to SDK. add buckets_in_routing_table 2022-01-12 12:39:23 -03:00
Victor Shyba
5cb4c06d0c add prefix_neighbors_count to routing table debug api 2022-01-12 12:39:23 -03:00
Lex Berezhny
aaa11c02bf added integration test 2022-01-10 08:46:10 -05:00
vertbyqb
d2ebbf5db6 jsonrpc_channel_sign - Convert hexdata to a string before signing
Fixes #3533
2022-01-10 08:46:10 -05:00
Victor Shyba
a8523996a9 extract cache values, increase peer cache to 2048 2022-01-07 12:58:52 -03:00
Victor Shyba
f586de2bbe DHT bugfix: failures tracking should be bound to 2048 LRU cache size 2022-01-07 12:46:00 -03:00
Victor Shyba
7df02303b2 fix missing docopt argument 2022-01-05 17:10:31 -03:00
Victor Shyba
f89c75e642 bump hub version to latest supporting sd_hash search 2022-01-05 17:10:31 -03:00
Victor Shyba
d2c1961101 update hub protobuf including sd_hash field 2022-01-05 17:10:31 -03:00
Victor Shyba
2a4c5a48bf increase indexed sd_hash prefix to 4 chars 2022-01-05 17:10:31 -03:00
Victor Shyba
5f5f39a4aa enable and test prefix search for sd hash 2022-01-05 17:10:31 -03:00
Victor Shyba
df54cc04af sync and search sd_hash 2022-01-05 17:10:31 -03:00
Victor Shyba
19fa274227 add sd hash to API 2022-01-05 17:10:31 -03:00