Jack Robison
830ee294ef
batched catch up for the address status index
2022-05-17 19:20:31 -04:00
Jack Robison
25a8c6b558
remove unneeded labels from prometheus
2022-05-17 11:59:39 -04:00
Jack Robison
f747637688
reduce cache sizes
2022-05-17 11:34:59 -04:00
Jack Robison
bf1667b44d
fix turning address status index on and off
2022-05-17 11:34:59 -04:00
Jack Robison
51a753c4d2
fix settings
2022-05-17 11:34:59 -04:00
Jack Robison
32c21a26a9
cleanup
2022-05-17 11:34:59 -04:00
Jack Robison
708c45504a
delete unused code
2022-05-17 11:34:59 -04:00
Jack Robison
460a06ec04
reduce history_tx_info_cache size
2022-05-17 11:34:59 -04:00
Jack Robison
f91d2be91e
log if address status index is turned on
2022-05-17 11:34:59 -04:00
Jack Robison
d244136efd
add --index_address_statuses option
...
-scribe no longer writes address statuses nor compacts them during initial sync
-scribe will only precompute address statuses if `--index_address_statuses` is set
-combine history compaction with updating the address status
2022-05-17 11:34:59 -04:00
Jack Robison
e4ac106b98
_get_clear_mempool_ops
2022-05-17 11:34:59 -04:00
Jack Robison
869fc1698c
add tx caching layer to scribe writer to improve performance when cache_all_tx_hashes isn't on
2022-05-17 11:34:59 -04:00
Jack Robison
02922845dd
add multi_put and multi_delete api to the db class
2022-05-17 11:34:59 -04:00
Jack Robison
c5f18a4166
expose --address_history_cache_size setting for scribe
2022-05-17 11:34:59 -04:00
Jack Robison
19ac0e83ad
fix https://github.com/lbryio/scribe/issues/16
2022-05-17 11:26:16 -04:00
Jack Robison
d6d758c5c1
fix es timeout
2022-05-09 11:20:15 -04:00
Jack Robison
bda9561178
type annotations
2022-05-05 16:50:39 -04:00
Jack Robison
6f22767486
split env classes
2022-05-05 16:34:27 -04:00
Jack Robison
ca39d38dda
improve cli/env settings
...
-remove unused settings
-add help strings
-fix required settings
2022-05-04 13:00:16 -04:00
Jack Robison
9525c86a78
add fixmes for fields that aren't yet matching lbrycrd
2022-05-02 18:05:49 -04:00
Jack Robison
a9a4f87628
fix peer list
2022-05-02 17:58:15 -04:00
Jack Robison
4e8c8d4054
return transaction as json if verbose is given to blockchain.transaction.get
...
-fixes https://github.com/lbryio/scribe/issues/27
2022-05-02 15:20:58 -04:00
Jack Robison
00628b5596
increase cache sizes
2022-05-01 11:34:50 -04:00
Jack Robison
2f15fc56cd
reduce cache size
2022-04-30 18:17:46 -04:00
Jack Robison
6e69e1a272
remove unused attribute
2022-04-28 15:53:00 -04:00
Jack Robison
c30ef1d409
add merkle and tx lru caches to BlockchainReaderService
...
-updates batched `HubDB.get_transactions_and_merkles` to use and set new lru caches
-caches txs from new blocks in anticipation of those txs being requested soon
-removes _tx_and_merkle_cache
-fixes metrics namespace
2022-04-28 15:48:42 -04:00
Jack Robison
2d75d62d3f
add FastMerkleCacheItem for faster block tx merkle proofs
2022-04-28 15:44:41 -04:00
Jack Robison
1bf079e177
batched merkle proofs
2022-04-15 16:58:20 -04:00
Jack Robison
b5f46af3b4
store block hashes in memory
2022-04-15 16:58:20 -04:00
Jack Robison
37b6c91ba6
block_txs
2022-04-15 16:58:20 -04:00
Jack Robison
e9e5471ad3
fix cache
2022-04-15 16:58:20 -04:00
Jack Robison
ca4dc1eaac
use multi_get for transaction.get_batch
2022-04-15 16:58:20 -04:00
Jack Robison
4574680d9b
add elastic_notifier_host cli arg and env setting
...
fixes https://github.com/lbryio/scribe/issues/21
2022-04-14 12:10:33 -04:00
Jack Robison
4ca8e91fb8
increase hashX_full_cache and hashX_history_cache sizes
2022-04-13 15:49:45 -04:00
Jack Robison
4f0359c177
expose rocksdb multi_get api for column families
...
-use multi_get for fetching tx hashes when they're not all held in memory
2022-04-13 15:49:29 -04:00
Jack Robison
a2c046b513
fix touched_hashXs not being cleaned up
2022-04-12 16:24:49 -04:00
Jack Robison
7c5b02c5a1
mempool metrics
2022-04-12 16:11:21 -04:00
Jack Robison
ca1444eb5d
cache cache histories from the db for mempool updates
2022-04-12 15:27:28 -04:00
Jack Robison
cb5f396b33
add other missing scripthash apis
...
- `blockchain.scripthash.unsubscribe`
- `blockchain.scripthash.listunspent`
2022-04-11 17:45:07 -04:00
Jack Robison
aa75eebc22
re-add blockchain.scripthash.get_balance
...
fixes https://github.com/lbryio/scribe/issues/19
2022-04-10 22:54:34 -04:00
Jack Robison
881fdf347c
fix logging in migrator
2022-04-07 11:57:41 -04:00
Jack Robison
5d8a32368a
add a migrator to build the hashX status index and to compactify histories
2022-04-06 22:01:55 -04:00
Jack Robison
b1bb5927c7
faster get_hashX_status
2022-04-06 22:00:41 -04:00
Jack Robison
d323edd252
_get_compactify_hashX_history_ops
2022-04-06 22:00:30 -04:00
Jack Robison
8a2517aa36
run in thread
2022-04-05 17:29:33 -04:00
Jack Robison
4cfc1b4765
precomputed address status upon new blocks and mempool
...
-adds HashXStatusPrefixRow and HashXMempoolStatusPrefixRow column families
2022-04-05 17:29:33 -04:00
Jack Robison
a57b69391b
rename hub mempool class to HubMemPool
2022-04-05 17:29:33 -04:00
Jack Robison
5763d38017
fix incorrectly caching mempool txs
2022-04-05 16:54:00 -04:00
Jack Robison
11c6e12bda
automatic address history compaction
...
fixes https://github.com/lbryio/scribe/issues/9
2022-04-04 19:28:59 -04:00
Jack Robison
4936bd43b6
remove scribe-hub getrawtransaction calls, improve notifications
2022-04-04 10:36:30 -04:00
