Commit graph

61 commits

Author SHA1 Message Date
Jack Robison
4ca8e91fb8
increase hashX_full_cache and hashX_history_cache sizes 2022-04-13 15:49:45 -04:00
Jack Robison
4f0359c177
expose rocksdb multi_get api for column families
-use multi_get for fetching tx hashes when they're not all held in memory
2022-04-13 15:49:29 -04:00
Jack Robison
a2c046b513
fix touched_hashXs not being cleaned up 2022-04-12 16:24:49 -04:00
Jack Robison
7c5b02c5a1
mempool metrics 2022-04-12 16:11:21 -04:00
Jack Robison
ca1444eb5d
cache cache histories from the db for mempool updates 2022-04-12 15:27:28 -04:00
Jack Robison
cb5f396b33
add other missing scripthash apis
- `blockchain.scripthash.unsubscribe`
- `blockchain.scripthash.listunspent`
2022-04-11 17:45:07 -04:00
Jack Robison
aa75eebc22
re-add blockchain.scripthash.get_balance
fixes https://github.com/lbryio/scribe/issues/19
2022-04-10 22:54:34 -04:00
Jack Robison
881fdf347c
fix logging in migrator 2022-04-07 11:57:41 -04:00
Jack Robison
5d8a32368a
add a migrator to build the hashX status index and to compactify histories 2022-04-06 22:01:55 -04:00
Jack Robison
b1bb5927c7
faster get_hashX_status 2022-04-06 22:00:41 -04:00
Jack Robison
d323edd252
_get_compactify_hashX_history_ops 2022-04-06 22:00:30 -04:00
Jack Robison
8a2517aa36
run in thread 2022-04-05 17:29:33 -04:00
Jack Robison
4cfc1b4765
precomputed address status upon new blocks and mempool
-adds HashXStatusPrefixRow and HashXMempoolStatusPrefixRow column families
2022-04-05 17:29:33 -04:00
Jack Robison
a57b69391b
rename hub mempool class to HubMemPool 2022-04-05 17:29:33 -04:00
Jack Robison
5763d38017
fix incorrectly caching mempool txs 2022-04-05 16:54:00 -04:00
Jack Robison
11c6e12bda
automatic address history compaction
fixes https://github.com/lbryio/scribe/issues/9
2022-04-04 19:28:59 -04:00
Jack Robison
4936bd43b6
remove scribe-hub getrawtransaction calls, improve notifications 2022-04-04 10:36:30 -04:00
Jack Robison
32a2e92993
log to file 2022-04-04 10:34:51 -04:00
Jack Robison
1e3087953f
kill scribe-hub upon mempool loop crashing
-allows docker to restart it
2022-04-04 10:33:47 -04:00
Jack Robison
60a1c2ec20
reduce cache sizes 2022-04-02 13:17:08 -04:00
Jack Robison
a5120d772c
try making sending header notifications faster 2022-04-02 11:44:55 -04:00
Jack Robison
ba2e2a1dcc
logging 2022-04-02 10:21:37 -04:00
Jack Robison
e07c3d39dc
improve limited_history performance 2022-04-01 10:50:51 -04:00
Jack Robison
dfda41f85f
mempool_process_time_metric 2022-03-31 12:06:36 -04:00
Jack Robison
90062296e8
separate scribe __version__ from HUB_PROTOCOL_VERSION 2022-03-31 10:37:50 -04:00
Jack Robison
5731016ca5
move module cli entrypoints to __main__.py files 2022-03-29 16:06:44 -04:00
Jack Robison
909ea901e4
fix prometheus starting height 2022-03-25 12:33:43 -04:00
Jack Robison
c83c0cd189
uncaught error 2022-03-24 21:18:32 -04:00
Jack Robison
444d1f51cc
fix https://github.com/lbryio/lbry-sdk/issues/3561 2022-03-24 21:13:08 -04:00
zeppi
879869cb31 fix shoulds in es 2022-03-24 19:33:32 -04:00
Jack Robison
25915d3ec9
cleanup 2022-03-24 13:22:18 -04:00
Jack Robison
ca2ca23892
cleanup 2022-03-24 12:54:22 -04:00
Jack Robison
ba1a93b9b0
re-add 'blockchain.address.listunspent and blockchain.address.getbalance to scribe-hub 2022-03-23 14:02:26 -04:00
Jack Robison
32b8afe154
more efficient mempool tx refresh
-hopefully safer from the rare RocksIOError without a bare iterate()
2022-03-23 12:10:09 -04:00
Jack Robison
c6e5c92765
fix prometheus teardown 2022-03-22 21:57:58 -04:00
Jack Robison
5e2d5e98b3
fix prometheus 2022-03-22 21:56:23 -04:00
Jack Robison
356e613b24
partial fix for https://github.com/lbryio/scribe/issues/2 2022-03-22 21:12:02 -04:00
Jack Robison
f59adef282
block scribe-hub and scribe-elastic-sync startup on scribe initially catching up
fixes https://github.com/lbryio/scribe/issues/1
2022-03-22 12:17:47 -04:00
Jack Robison
1badc5f38c
BlockchainService base class for readers and the writer
-move base58.py and bip32.py into scribe.schema
-fix https://github.com/lbryio/scribe/issues/3
2022-03-21 22:57:38 -04:00
Jack Robison
9ff6ffcf42
uncaught error 2022-03-17 23:01:26 -04:00
Jack Robison
9618c9e702
patch channel_tx_hash and repost_tx_hash not being updated in ES
-this is a patch pending a real fix
2022-03-17 11:49:17 -04:00
Jack Robison
bd68613b74
fix catch_up 2022-03-16 22:50:40 -04:00
Jack Robison
28356b49dc
fix scribe-elastic-sync catching up with a database that's since advanced 2022-03-16 18:41:53 -04:00
Jack Robison
50b3acb4e6
refactor handling blocked claims in serialization 2022-03-16 15:32:44 -04:00
Jack Robison
9d6d9ff68f
remove binascii 2022-03-16 15:25:02 -04:00
Jack Robison
ddf663b415
add paper explaining the trending algorithm 2022-03-16 02:44:30 -04:00
Jack Robison
29676e0944
delete unused code 2022-03-15 23:58:37 -04:00
Jack Robison
24bf4082f7
update readme 2022-03-15 23:57:42 -04:00
Jack Robison
5b92706065
use ujson for serializing responses 2022-03-15 23:57:24 -04:00
Jack Robison
0daf205cb0
add channel and repost txo info to ResolveResult
-used to set references in Outputs, allows for faster serialization of resolve/claim_search responses
-requires resyncing elasticsearch
2022-03-15 23:56:37 -04:00