Commit graph

76 commits

Author SHA1 Message Date
Jack Robison
ca39d38dda
improve cli/env settings
-remove unused settings
-add help strings
-fix required settings
2022-05-04 13:00:16 -04:00
Jack Robison
9525c86a78
add fixmes for fields that aren't yet matching lbrycrd 2022-05-02 18:05:49 -04:00
Jack Robison
a9a4f87628
fix peer list 2022-05-02 17:58:15 -04:00
Jack Robison
4e8c8d4054
return transaction as json if verbose is given to blockchain.transaction.get
-fixes https://github.com/lbryio/scribe/issues/27
2022-05-02 15:20:58 -04:00
Jack Robison
00628b5596
increase cache sizes 2022-05-01 11:34:50 -04:00
Jack Robison
2f15fc56cd
reduce cache size 2022-04-30 18:17:46 -04:00
Jack Robison
6e69e1a272
remove unused attribute 2022-04-28 15:53:00 -04:00
Jack Robison
c30ef1d409
add merkle and tx lru caches to BlockchainReaderService
-updates batched `HubDB.get_transactions_and_merkles` to use and set new lru caches
-caches txs from new blocks in anticipation of those txs being requested soon
-removes _tx_and_merkle_cache
-fixes metrics namespace
2022-04-28 15:48:42 -04:00
Jack Robison
2d75d62d3f
add FastMerkleCacheItem for faster block tx merkle proofs 2022-04-28 15:44:41 -04:00
Jack Robison
1bf079e177
batched merkle proofs 2022-04-15 16:58:20 -04:00
Jack Robison
b5f46af3b4
store block hashes in memory 2022-04-15 16:58:20 -04:00
Jack Robison
37b6c91ba6
block_txs 2022-04-15 16:58:20 -04:00
Jack Robison
e9e5471ad3
fix cache 2022-04-15 16:58:20 -04:00
Jack Robison
ca4dc1eaac
use multi_get for transaction.get_batch 2022-04-15 16:58:20 -04:00
Jack Robison
4574680d9b
add elastic_notifier_host cli arg and env setting
fixes https://github.com/lbryio/scribe/issues/21
2022-04-14 12:10:33 -04:00
Jack Robison
4ca8e91fb8
increase hashX_full_cache and hashX_history_cache sizes 2022-04-13 15:49:45 -04:00
Jack Robison
4f0359c177
expose rocksdb multi_get api for column families
-use multi_get for fetching tx hashes when they're not all held in memory
2022-04-13 15:49:29 -04:00
Jack Robison
a2c046b513
fix touched_hashXs not being cleaned up 2022-04-12 16:24:49 -04:00
Jack Robison
7c5b02c5a1
mempool metrics 2022-04-12 16:11:21 -04:00
Jack Robison
ca1444eb5d
cache cache histories from the db for mempool updates 2022-04-12 15:27:28 -04:00
Jack Robison
cb5f396b33
add other missing scripthash apis
- `blockchain.scripthash.unsubscribe`
- `blockchain.scripthash.listunspent`
2022-04-11 17:45:07 -04:00
Jack Robison
aa75eebc22
re-add blockchain.scripthash.get_balance
fixes https://github.com/lbryio/scribe/issues/19
2022-04-10 22:54:34 -04:00
Jack Robison
881fdf347c
fix logging in migrator 2022-04-07 11:57:41 -04:00
Jack Robison
5d8a32368a
add a migrator to build the hashX status index and to compactify histories 2022-04-06 22:01:55 -04:00
Jack Robison
b1bb5927c7
faster get_hashX_status 2022-04-06 22:00:41 -04:00
Jack Robison
d323edd252
_get_compactify_hashX_history_ops 2022-04-06 22:00:30 -04:00
Jack Robison
8a2517aa36
run in thread 2022-04-05 17:29:33 -04:00
Jack Robison
4cfc1b4765
precomputed address status upon new blocks and mempool
-adds HashXStatusPrefixRow and HashXMempoolStatusPrefixRow column families
2022-04-05 17:29:33 -04:00
Jack Robison
a57b69391b
rename hub mempool class to HubMemPool 2022-04-05 17:29:33 -04:00
Jack Robison
5763d38017
fix incorrectly caching mempool txs 2022-04-05 16:54:00 -04:00
Jack Robison
11c6e12bda
automatic address history compaction
fixes https://github.com/lbryio/scribe/issues/9
2022-04-04 19:28:59 -04:00
Jack Robison
4936bd43b6
remove scribe-hub getrawtransaction calls, improve notifications 2022-04-04 10:36:30 -04:00
Jack Robison
32a2e92993
log to file 2022-04-04 10:34:51 -04:00
Jack Robison
1e3087953f
kill scribe-hub upon mempool loop crashing
-allows docker to restart it
2022-04-04 10:33:47 -04:00
Jack Robison
60a1c2ec20
reduce cache sizes 2022-04-02 13:17:08 -04:00
Jack Robison
a5120d772c
try making sending header notifications faster 2022-04-02 11:44:55 -04:00
Jack Robison
ba2e2a1dcc
logging 2022-04-02 10:21:37 -04:00
Jack Robison
e07c3d39dc
improve limited_history performance 2022-04-01 10:50:51 -04:00
Jack Robison
dfda41f85f
mempool_process_time_metric 2022-03-31 12:06:36 -04:00
Jack Robison
90062296e8
separate scribe __version__ from HUB_PROTOCOL_VERSION 2022-03-31 10:37:50 -04:00
Jack Robison
5731016ca5
move module cli entrypoints to __main__.py files 2022-03-29 16:06:44 -04:00
Jack Robison
909ea901e4
fix prometheus starting height 2022-03-25 12:33:43 -04:00
Jack Robison
c83c0cd189
uncaught error 2022-03-24 21:18:32 -04:00
Jack Robison
444d1f51cc
fix https://github.com/lbryio/lbry-sdk/issues/3561 2022-03-24 21:13:08 -04:00
zeppi
879869cb31 fix shoulds in es 2022-03-24 19:33:32 -04:00
Jack Robison
25915d3ec9
cleanup 2022-03-24 13:22:18 -04:00
Jack Robison
ca2ca23892
cleanup 2022-03-24 12:54:22 -04:00
Jack Robison
ba1a93b9b0
re-add 'blockchain.address.listunspent and blockchain.address.getbalance to scribe-hub 2022-03-23 14:02:26 -04:00
Jack Robison
32b8afe154
more efficient mempool tx refresh
-hopefully safer from the rare RocksIOError without a bare iterate()
2022-03-23 12:10:09 -04:00
Jack Robison
c6e5c92765
fix prometheus teardown 2022-03-22 21:57:58 -04:00