184 commits

Author	SHA1	Message	Date
Jack Robison	7f8268703c	update prometheus	2022-02-22 13:10:08 -05:00
Jack Robison	32d2208fd9	logging	2022-02-22 13:10:08 -05:00
Jack Robison	704ec9e553	add --reindex option to lbry-hub-elastic-sync	2022-02-22 13:10:08 -05:00
Jack Robison	a4880c1cf0	flush in advance/rollback methods	2022-02-22 13:10:08 -05:00
Jack Robison	28f25538a3	remove unused attributes	2022-02-22 13:10:08 -05:00
Jack Robison	6fc909ea41	handle mempool race errors from lbcd	2022-02-22 13:10:08 -05:00
Jack Robison	c17544d8ef	fix mempool race condition in hub db writer	2022-02-22 13:10:08 -05:00
Jeffrey Picard	31312af517	Small changes and fixes for hub refactor	2022-02-22 13:10:08 -05:00
Jack Robison	e2a75758f8	delete unused code	2022-02-22 13:09:57 -05:00
Jack Robison	f449cf61ab	update mempool in thread	2022-02-22 13:09:57 -05:00
Jack Robison	b49c9fd050	fix filtering/blocking	2022-02-22 13:09:57 -05:00
Jack Robison	b1441d4247	wait for writing to finish before closing the db	2022-02-22 13:09:57 -05:00
Jack Robison	47305e7446	executors	2022-02-22 13:09:57 -05:00
Jack Robison	ba6b985d71	cleanup debug logging	2022-02-22 13:09:57 -05:00
Jack Robison	46bcc5d725	executors for each reader, fix shutdown	2022-02-22 13:09:57 -05:00
Jack Robison	53e3828965	remove redundant undo cleanup, don't delete historic touched_or_deleted	2022-02-22 13:09:57 -05:00
Jack Robison	478bd0510b	es writer	2022-02-22 13:09:57 -05:00
Jack Robison	499ee74dfc	add chain reader and reader server, new mempool, update block processor	2022-02-22 13:09:57 -05:00
Jack Robison	d3da442727	update undo key to include the block hash	2022-02-22 13:09:57 -05:00
Jack Robison	358fa21eaf	move Prefetcher to own file	2022-02-22 13:09:57 -05:00
Jack Robison	77e64ef028	add mempool, trending, and touched address indexes to the hub db	2022-02-22 13:09:57 -05:00
Lex Berezhny	1eaa195363	reduced crypto dependency in wallet to coincurve	2021-12-22 18:29:46 -05:00
Jack Robison	7531401623	keep touched_or_deleted records	2021-11-21 13:52:03 -05:00
Jack Robison	1e00fb369d	fix missing es notification for support amount changing	2021-11-15 00:58:18 -05:00
Jack Robison	3fe1582432	fix duplicate trending notification to ES	2021-11-15 00:58:18 -05:00
Jack Robison	1e391d211b	fix attempting to update trending on abandoned claims	2021-10-23 18:39:04 -04:00
Jack Robison	1a74d6604d	skip loading tx/claim caches in the elastic sync script when not needed	2021-10-22 15:10:35 -04:00
Jack Robison	48505c2968	update trending with help from @eggplantbren	2021-10-21 00:17:12 -04:00
Jack Robison	a98ea1e66a	update sync script to handle ES falling behind leveldb on shutdown	2021-10-20 23:41:11 -04:00
Jack Robison	e35319e5a2	add CACHE_ALL_CLAIM_TXOS hub setting	2021-10-19 15:53:20 -04:00
Jack Robison	bfac02ccab	add CACHE_ALL_TX_HASHES setting to optionally use more memory to save i/o	2021-10-19 15:53:20 -04:00
Jack Robison	99df418f1d	improve resolve caching	2021-10-19 15:53:20 -04:00
Jack Robison	6416d8ce9c	threadpools for block processor and es sync reader	2021-10-19 15:53:20 -04:00
Jack Robison	eabcc30367	resolve lru cache	2021-10-19 15:53:20 -04:00
Jack Robison	f5e0ef5223	add block_txs index	2021-10-19 15:53:20 -04:00
Jack Robison	d3516f299e	clear es attributes during initial sync	2021-10-08 16:34:48 -04:00
Jack Robison	ccf03fc07b	only save undo info for blocks within reorg limit	2021-10-06 12:07:42 -04:00
Jack Robison	a7c45da10c	fix channel count	2021-10-06 00:02:16 -04:00
Jack Robison	4cf76123e5	block processor db refactoring ... -access db through HubDB class, don't use plyvel.DB directly -add channel count and support amount prefixes	2021-10-05 16:44:49 -04:00
Jack Robison	01ee4b23e6	fix and add test for abandoning a controlling in the same block a new claim is made	2021-10-05 16:44:49 -04:00
Jack Robison	33e8ef75ff	fix bug with early takeover by an update	2021-10-05 16:44:49 -04:00
Jack Robison	86f21da28b	fix activating non existent claim	2021-10-05 16:44:49 -04:00
Jack Robison	89cd6a9aa4	add tests for takeovers from amount changes in updates before/on/after activation	2021-10-05 16:44:49 -04:00
Jack Robison	02cf478d91	improve leveldb caching	2021-10-05 16:44:49 -04:00
Jack Robison	6ec70192fe	refactor reload_blocking_filtering_streams	2021-10-05 16:44:49 -04:00
Jack Robison	37ec9ab464	remove unused executor	2021-10-05 16:44:49 -04:00
Jack Robison	709f5e9a65	fix update that initiates takeover not being delayed	2021-10-05 16:44:49 -04:00
Jack Robison	165f3bb270	refactor trending	2021-10-05 16:44:49 -04:00
Jack Robison	0ba75153f3	trending fixes	2021-10-05 16:44:49 -04:00
Jack Robison	34576e880d	update trending in elasticsearch ... -add TrendingPrefixSpike to leveldb -expose `TRENDING_HALF_LIFE`, `TRENDING_WHALE_HALF_LIFE` and `TRENDING_WHALE_THRESHOLD` hub settings	2021-10-05 16:44:49 -04:00