Jack Robison
c30ef1d409
add merkle and tx lru caches to BlockchainReaderService
...
-updates batched `HubDB.get_transactions_and_merkles` to use and set new lru caches
-caches txs from new blocks in anticipation of those txs being requested soon
-removes _tx_and_merkle_cache
-fixes metrics namespace
2022-04-28 15:48:42 -04:00
Jack Robison
2d75d62d3f
add FastMerkleCacheItem for faster block tx merkle proofs
2022-04-28 15:44:41 -04:00
Jack Robison
c56b7fb133
Merge pull request #25 from lbryio/multiget-transactions
...
use `multi_get` for fetching transactions
2022-04-16 11:19:13 -04:00
Jack Robison
1bf079e177
batched merkle proofs
2022-04-15 16:58:20 -04:00
Jack Robison
b5f46af3b4
store block hashes in memory
2022-04-15 16:58:20 -04:00
Jack Robison
37b6c91ba6
block_txs
2022-04-15 16:58:20 -04:00
Jack Robison
e9e5471ad3
fix cache
2022-04-15 16:58:20 -04:00
Jack Robison
ca4dc1eaac
use multi_get for transaction.get_batch
2022-04-15 16:58:20 -04:00
Jack Robison
21d983032e
test dockerhub ci
2022-04-14 13:10:32 -04:00
Jack Robison
648e782df6
fix dockerhub action
2022-04-14 13:02:32 -04:00
Jack Robison
037e2560d0
fix action
2022-04-14 12:56:27 -04:00
Jack Robison
729428b783
dockerhub
2022-04-14 12:53:20 -04:00
Jack Robison
84bf40220c
dockerhub
2022-04-14 12:45:36 -04:00
Jack Robison
c7d5656b19
dockerhub
2022-04-14 12:34:32 -04:00
Jack Robison
0f26001fb2
dockerhub
2022-04-14 12:26:21 -04:00
Jack Robison
8510d666e0
Merge pull request #24 from lbryio/notifier-interface-setting
...
add `elastic_notifier_host` cli arg and env setting
2022-04-14 12:18:09 -04:00
Jack Robison
4574680d9b
add elastic_notifier_host cli arg and env setting
...
fixes https://github.com/lbryio/scribe/issues/21
2022-04-14 12:10:33 -04:00
Jack Robison
023fca5780
Merge pull request #23 from lbryio/multiget-tx-hashes
...
Expose `multi_get` from rocksdb, use it for fetching tx hashes
2022-04-13 15:58:04 -04:00
Jack Robison
4ca8e91fb8
increase hashX_full_cache and hashX_history_cache sizes
2022-04-13 15:49:45 -04:00
Jack Robison
4f0359c177
expose rocksdb multi_get api for column families
...
-use multi_get for fetching tx hashes when they're not all held in memory
2022-04-13 15:49:29 -04:00
Jack Robison
ce50da9abe
Merge pull request #22 from lbryio/hashX-history-cache
...
cache histories from the db for mempool updates
2022-04-12 18:33:38 -04:00
Jack Robison
a2c046b513
fix touched_hashXs not being cleaned up
2022-04-12 16:24:49 -04:00
Jack Robison
7c5b02c5a1
mempool metrics
2022-04-12 16:11:21 -04:00
Jack Robison
ca1444eb5d
cache cache histories from the db for mempool updates
2022-04-12 15:27:28 -04:00
Jack Robison
cb5f396b33
add other missing scripthash apis
...
- `blockchain.scripthash.unsubscribe`
- `blockchain.scripthash.listunspent`
2022-04-11 17:45:07 -04:00
Jack Robison
aa75eebc22
re-add blockchain.scripthash.get_balance
...
fixes https://github.com/lbryio/scribe/issues/19
2022-04-10 22:54:34 -04:00
Jack Robison
311db529a0
Merge pull request #17 from lbryio/precomputed-hashx-status
...
Precomputed hashx status
2022-04-07 12:06:18 -04:00
Jack Robison
881fdf347c
fix logging in migrator
2022-04-07 11:57:41 -04:00
Jack Robison
5d8a32368a
add a migrator to build the hashX status index and to compactify histories
2022-04-06 22:01:55 -04:00
Jack Robison
b1bb5927c7
faster get_hashX_status
2022-04-06 22:00:41 -04:00
Jack Robison
d323edd252
_get_compactify_hashX_history_ops
2022-04-06 22:00:30 -04:00
Jack Robison
8a2517aa36
run in thread
2022-04-05 17:29:33 -04:00
Jack Robison
4cfc1b4765
precomputed address status upon new blocks and mempool
...
-adds HashXStatusPrefixRow and HashXMempoolStatusPrefixRow column families
2022-04-05 17:29:33 -04:00
Jack Robison
a57b69391b
rename hub mempool class to HubMemPool
2022-04-05 17:29:33 -04:00
Jack Robison
5763d38017
fix incorrectly caching mempool txs
2022-04-05 16:54:00 -04:00
Jack Robison
5fc6f54152
Merge pull request #15 from lbryio/automatic-compaction
...
automatic address history compaction
2022-04-05 00:57:50 -04:00
Jack Robison
11c6e12bda
automatic address history compaction
...
fixes https://github.com/lbryio/scribe/issues/9
2022-04-04 19:28:59 -04:00
Jack Robison
4936bd43b6
remove scribe-hub getrawtransaction calls, improve notifications
2022-04-04 10:36:30 -04:00
Jack Robison
32a2e92993
log to file
2022-04-04 10:34:51 -04:00
Jack Robison
1e3087953f
kill scribe-hub upon mempool loop crashing
...
-allows docker to restart it
2022-04-04 10:33:47 -04:00
Jack Robison
60a1c2ec20
reduce cache sizes
2022-04-02 13:17:08 -04:00
Jack Robison
a5120d772c
try making sending header notifications faster
2022-04-02 11:44:55 -04:00
Jack Robison
ba2e2a1dcc
logging
2022-04-02 10:21:37 -04:00
Jack Robison
e07c3d39dc
improve limited_history performance
2022-04-01 10:50:51 -04:00
Jack Robison
dfda41f85f
mempool_process_time_metric
2022-03-31 12:06:36 -04:00
Jack Robison
8e01f415d0
fix dockerfile
2022-03-31 11:26:43 -04:00
Jack Robison
b90aa68103
fix dockerfile
2022-03-31 11:23:43 -04:00
Jack Robison
6206589d98
move deploy_scribe_dev.sh to scripts
...
-add docker/hooks
2022-03-31 11:17:49 -04:00
Jack Robison
eea5bb5384
rename dockerfile
2022-03-31 11:11:44 -04:00
Jack Robison
bfe48494c1
add action to build docker image
2022-03-31 10:52:16 -04:00
