Commit graph

1782 commits

Author SHA1 Message Date
Jack Robison
c59d08080e update iterators to use pack_partial_key 2022-03-15 15:34:08 -03:00
Jack Robison
94e0624024 delete lbry/wallet/server/storage.py
-expose leveldb lru cache size as `CACHE_MB` hub param
2022-03-15 15:34:08 -03:00
Jack Robison
e94a2c7c94 remove dead code 2022-03-15 15:34:07 -03:00
Jack Robison
cd1ce32377 non blocking mempool loop 2022-03-15 15:34:07 -03:00
Jack Robison
d1560ef09b faster es sync 2022-03-15 15:34:07 -03:00
Jack Robison
6699d1e2f8 run advance_block in threadpool 2022-03-15 15:34:07 -03:00
Jack Robison
f1fbfa1b39 use claim_to_txo cache 2022-03-15 15:34:07 -03:00
Jack Robison
0d86717a9a faster _cached_get_active_amount for claims
-remove dead code
2022-03-15 15:34:07 -03:00
Jack Robison
528af27e4a fix claim search by fee for claims without fees 2022-03-15 15:34:07 -03:00
Jack Robison
fe69afaa56 clear claim_to_txo cache before reading 2022-03-15 15:34:07 -03:00
Jack Robison
31d7823498 handle claims that dont exist in ES sync 2022-03-15 15:34:07 -03:00
Jack Robison
ef6ec03161 in memory claim_to_txo and txo_to_claim dictionaries 2022-03-15 15:34:07 -03:00
Jack Robison
68596be1b9 fix spend_utxo 2022-03-15 15:34:07 -03:00
Jack Robison
a48fe84971 split flush from advance_block 2022-03-15 15:34:07 -03:00
Jack Robison
bfbe7c1bf5 rename extend_ops 2022-03-15 15:34:07 -03:00
Jack Robison
085ce1ff16 faster spend_utxo 2022-03-15 15:34:07 -03:00
Jack Robison
c81c0d9480 faster get_future_activated 2022-03-15 15:34:07 -03:00
Jack Robison
05b6bdb8f6 threadpool 2022-03-15 15:34:07 -03:00
Jack Robison
991d4f8859 cleanup 2022-03-15 15:34:07 -03:00
Jack Robison
22c75605ee fix getting block hash during reorg 2022-03-15 15:34:07 -03:00
Jack Robison
f52faa8d14 fix test 2022-03-15 15:34:07 -03:00
Jack Robison
8dd88a2780 fix spends in address histories 2022-03-15 15:34:07 -03:00
Jack Robison
7ad2234983 faster es sync 2022-03-15 15:34:07 -03:00
Jack Robison
fb5c008fc5 fix expiring channels 2022-03-15 15:34:07 -03:00
Jack Robison
f55b6bdc71 fix abandoning signed claims in the same tx as their channel
-fix canonical/short url in es
2022-03-15 15:34:07 -03:00
Jack Robison
de9edb0695 handle failure to generate a short id 2022-03-15 15:34:07 -03:00
Jack Robison
2180e24bc1 fix resolve by short id 2022-03-15 15:34:07 -03:00
Jack Robison
b4eaa5f918 move MemPool into BlockProcessor 2022-03-15 15:34:07 -03:00
Jack Robison
d4194954d3 combine MemPool and Notifications classes 2022-03-15 15:34:07 -03:00
Jack Robison
6e221fc7d9 fix touched hashXs notifications 2022-03-15 15:34:07 -03:00
Jack Robison
ea1285cd9f reorg claims in the search index 2022-03-15 15:34:07 -03:00
Jack Robison
4e77fa100b small fixes 2022-03-15 15:34:07 -03:00
Jack Robison
babb76d90d rename 2022-03-15 15:34:07 -03:00
Jack Robison
f73153ed8d delete stale code 2022-03-15 15:34:07 -03:00
Jack Robison
acfc1f56ee simplify advance and reorg 2022-03-15 15:34:07 -03:00
Jack Robison
81773a6497 update limited_history 2022-03-15 15:34:07 -03:00
Jack Robison
25cf751158 update lookup_utxos 2022-03-15 15:34:07 -03:00
Jack Robison
a9c8061c0c update RevertableOpStack 2022-03-15 15:34:07 -03:00
Jack Robison
f53b1ee290 add remaining db prefixes 2022-03-15 15:34:07 -03:00
Jack Robison
fd2753b95a cleanup 2022-03-15 15:34:07 -03:00
Jack Robison
768934e1cc skip es sync during initial hub sync, halt the hub upon finishing initial sync 2022-03-15 15:34:07 -03:00
Jack Robison
ad7dee3e7f fix es sync 2022-03-15 15:34:07 -03:00
Jack Robison
354c69bf4f fix non localhost elasticsearch 2022-03-15 15:34:07 -03:00
Jack Robison
1c8f92239d fix stream_update --clear_channel flag 2022-03-15 15:34:07 -03:00
Jack Robison
0c85de7839 fix signed claim invalidation corner cases 2022-03-15 15:34:07 -03:00
Jack Robison
d74d06d97b extra deletes
-the channel_to_claim/claim_to_channel entries already get deleted when the claim txo is spent
2022-03-15 15:34:07 -03:00
Jack Robison
55351c5842 fix has_no_source for reposts 2022-03-15 15:34:07 -03:00
Jack Robison
e67152ec14 update channel_to_claim and claim_to_channel at the same time 2022-03-15 15:34:07 -03:00
Jack Robison
287ff0a557 typing and fix error string 2022-03-15 15:34:07 -03:00
Jack Robison
bf539d67ea update staged txo_to_claim after invalidating channel sig
-fixes abandon of claim with invalidated signature and an update in same block
2022-03-15 15:34:07 -03:00
Jack Robison
69651453dd missing channel_to_claim delete 2022-03-15 15:34:07 -03:00
Jack Robison
7f743ff3f1 fix RepostKey 2022-03-15 15:34:07 -03:00
Jack Robison
a1b7c61b56 typing 2022-03-15 15:34:07 -03:00
Jack Robison
fbd1d53542 fix 2022-03-15 15:34:07 -03:00
Jack Robison
02adc74e2c cleanup 2022-03-15 15:34:07 -03:00
Jack Robison
3a452a3b2a rename effective_amount prefix 2022-03-15 15:34:07 -03:00
Jack Robison
91f8b3b505 fix undeleted claim_to_channel record 2022-03-15 15:34:07 -03:00
Jack Robison
ce09f2eb0f cleanup 2022-03-15 15:34:07 -03:00
Jack Robison
02d479b92d fix mismatch in claim_to_txo<->txo_to_claim 2022-03-15 15:34:07 -03:00
Jack Robison
bce14c3d79 rename things
-fix effective amount integrity error
2022-03-15 15:34:07 -03:00
Jack Robison
90cfcaac40 fix 2022-03-15 15:34:07 -03:00
Jack Robison
02563db2c7 pretty print 2022-03-15 15:34:07 -03:00
Jack Robison
cfa32a3986 fix duplicate activate 2022-03-15 15:34:07 -03:00
Jack Robison
ab4a6bc5b8 fix updating resolve by effective amount after abandoning support 2022-03-15 15:34:07 -03:00
Jack Robison
f01b8c849d use RevertableOpStack in _get_takeover_ops 2022-03-15 15:34:07 -03:00
Jack Robison
6a46f50a35 remove debug prints 2022-03-15 15:34:07 -03:00
Jack Robison
468ed91ee3 add RevertableOpStack to verify consistency of ops as they're staged 2022-03-15 15:34:07 -03:00
Jack Robison
b856e2120a fix fee amount overflow in es 2022-03-15 15:34:07 -03:00
Jack Robison
fd7bfbea78 faster claim producer
-make batches of claim txos from the iterator, and sort by tx hash before fetching to maximize cache and read ahead hits
2022-03-15 15:34:07 -03:00
Jack Robison
a74434e269 imports 2022-03-15 15:34:07 -03:00
Jack Robison
92be63ff5b close db in sync script 2022-03-15 15:34:07 -03:00
Jack Robison
4ce16b6509 try default block size 2022-03-15 15:34:07 -03:00
Jack Robison
2341667d04 update elastic sync 2022-03-15 15:34:07 -03:00
Jack Robison
89e7c8582e invalidate channel signatures upon channel abandon 2022-03-15 15:34:07 -03:00
Jack Robison
da4e4ecd23 _prepare_claim_for_sync generators 2022-03-15 15:34:07 -03:00
Jack Robison
c85648d43b logging 2022-03-15 15:34:07 -03:00
Jack Robison
c90331af98 use default sync=False during write_batch 2022-03-15 15:34:07 -03:00
Jack Robison
e5461f6d4f genesis_bytes attribute 2022-03-15 15:34:07 -03:00
Jack Robison
ac82d6b27b fix 2022-03-15 15:34:07 -03:00
Jack Robison
01db974040 disable es (revert) 2022-03-15 15:34:07 -03:00
Jack Robison
6ae6cf733d _cached_get_active_amount 2022-03-15 15:34:07 -03:00
Jack Robison
ad1d25d945 fix removing unactivated support 2022-03-15 15:34:07 -03:00
Jack Robison
69ed47fc22 debug 2022-03-15 15:34:07 -03:00
Jack Robison
7c62654534 leveldb tuning 2022-03-15 15:34:07 -03:00
Jack Robison
531e6c1a61 debug 2022-03-15 15:34:07 -03:00
Jack Robison
066f797ad4 refactor ClaimToTXO prefix 2022-03-15 15:34:07 -03:00
Jack Robison
9f0611f3d9 filter abandoned claims from those considered for early activation 2022-03-15 15:34:07 -03:00
Jack Robison
b0d2efd613 only do early takeover on a larger amount (fix case where they're equal) 2022-03-15 15:34:07 -03:00
Jack Robison
073283a433 filter supported claim hashes for claims that dont exist from early takeover/activations 2022-03-15 15:34:07 -03:00
Jack Robison
5be04448ea remove extra open functions 2022-03-15 15:34:07 -03:00
Jack Robison
5541b80179 fix flush id 2022-03-15 15:34:07 -03:00
Jack Robison
35232b3650 fix clearing pending_support caches upon abandon 2022-03-15 15:34:07 -03:00
Jack Robison
f4ca3ea66b fix putting spent unactivated supports in removed_active_support 2022-03-15 15:34:07 -03:00
Jack Robison
306efa17cc fix syncing claim to es where channel is in the same block 2022-03-15 15:34:07 -03:00
Jack Robison
83107ad877 ignore activation for headless supports 2022-03-15 15:34:07 -03:00
Jack Robison
b0cf25bf5c faster get_future_activated 2022-03-15 15:34:07 -03:00
Jack Robison
6330424bcd debugging 2022-03-15 15:34:07 -03:00
Jack Robison
5f3850bfa2 prints 2022-03-15 15:34:07 -03:00
Jack Robison
82e6658483 flush count 2022-03-15 15:34:07 -03:00
Jack Robison
49f4add8d1 tests 2022-03-15 15:34:07 -03:00