Commit graph

32 commits

Author SHA1 Message Date
Jack Robison
830ee294ef
batched catch up for the address status index 2022-05-17 19:20:31 -04:00
Jack Robison
f747637688
reduce cache sizes 2022-05-17 11:34:59 -04:00
Jack Robison
bf1667b44d
fix turning address status index on and off 2022-05-17 11:34:59 -04:00
Jack Robison
51a753c4d2
fix settings 2022-05-17 11:34:59 -04:00
Jack Robison
708c45504a
delete unused code 2022-05-17 11:34:59 -04:00
Jack Robison
460a06ec04
reduce history_tx_info_cache size 2022-05-17 11:34:59 -04:00
Jack Robison
d244136efd
add --index_address_statuses option
-scribe no longer writes address statuses nor compacts them during initial sync
-scribe will only precompute address statuses if `--index_address_statuses` is set
-combine history compaction with updating the address status
2022-05-17 11:34:59 -04:00
Jack Robison
e4ac106b98
_get_clear_mempool_ops 2022-05-17 11:34:59 -04:00
Jack Robison
869fc1698c
add tx caching layer to scribe writer to improve performance when cache_all_tx_hashes isn't on 2022-05-17 11:34:59 -04:00
Jack Robison
c5f18a4166
expose --address_history_cache_size setting for scribe 2022-05-17 11:34:59 -04:00
Jack Robison
bda9561178
type annotations 2022-05-05 16:50:39 -04:00
Jack Robison
6f22767486
split env classes 2022-05-05 16:34:27 -04:00
Jack Robison
ca39d38dda
improve cli/env settings
-remove unused settings
-add help strings
-fix required settings
2022-05-04 13:00:16 -04:00
Jack Robison
9525c86a78
add fixmes for fields that aren't yet matching lbrycrd 2022-05-02 18:05:49 -04:00
Jack Robison
4e8c8d4054
return transaction as json if verbose is given to blockchain.transaction.get
-fixes https://github.com/lbryio/scribe/issues/27
2022-05-02 15:20:58 -04:00
Jack Robison
b5f46af3b4
store block hashes in memory 2022-04-15 16:58:20 -04:00
Jack Robison
4ca8e91fb8
increase hashX_full_cache and hashX_history_cache sizes 2022-04-13 15:49:45 -04:00
Jack Robison
4f0359c177
expose rocksdb multi_get api for column families
-use multi_get for fetching tx hashes when they're not all held in memory
2022-04-13 15:49:29 -04:00
Jack Robison
ca1444eb5d
cache cache histories from the db for mempool updates 2022-04-12 15:27:28 -04:00
Jack Robison
5d8a32368a
add a migrator to build the hashX status index and to compactify histories 2022-04-06 22:01:55 -04:00
Jack Robison
d323edd252
_get_compactify_hashX_history_ops 2022-04-06 22:00:30 -04:00
Jack Robison
4cfc1b4765
precomputed address status upon new blocks and mempool
-adds HashXStatusPrefixRow and HashXMempoolStatusPrefixRow column families
2022-04-05 17:29:33 -04:00
Jack Robison
11c6e12bda
automatic address history compaction
fixes https://github.com/lbryio/scribe/issues/9
2022-04-04 19:28:59 -04:00
Jack Robison
32a2e92993
log to file 2022-04-04 10:34:51 -04:00
Jack Robison
5731016ca5
move module cli entrypoints to __main__.py files 2022-03-29 16:06:44 -04:00
Jack Robison
25915d3ec9
cleanup 2022-03-24 13:22:18 -04:00
Jack Robison
ca2ca23892
cleanup 2022-03-24 12:54:22 -04:00
Jack Robison
32b8afe154
more efficient mempool tx refresh
-hopefully safer from the rare RocksIOError without a bare iterate()
2022-03-23 12:10:09 -04:00
Jack Robison
f59adef282
block scribe-hub and scribe-elastic-sync startup on scribe initially catching up
fixes https://github.com/lbryio/scribe/issues/1
2022-03-22 12:17:47 -04:00
Jack Robison
1badc5f38c
BlockchainService base class for readers and the writer
-move base58.py and bip32.py into scribe.schema
-fix https://github.com/lbryio/scribe/issues/3
2022-03-21 22:57:38 -04:00
Jack Robison
c5dc8d5cad
refactoring, fix reconnecting to notifier 2022-03-09 17:26:20 -05:00
Jack Robison
dfef80d9c2
initial 2022-03-08 12:41:51 -05:00