551 commits

Author	SHA1	Message	Date
Jack Robison	478bd0510b	es writer	2022-02-22 13:09:57 -05:00
Jack Robison	499ee74dfc	add chain reader and reader server, new mempool, update block processor	2022-02-22 13:09:57 -05:00
Jack Robison	d3da442727	update undo key to include the block hash	2022-02-22 13:09:57 -05:00
Jack Robison	358fa21eaf	move Prefetcher to own file	2022-02-22 13:09:57 -05:00
Jack Robison	20f35d02fa	move HubDB, delete leveldb.py	2022-02-22 13:09:57 -05:00
Jack Robison	77e64ef028	add mempool, trending, and touched address indexes to the hub db	2022-02-22 13:09:57 -05:00
Jack Robison	0a71e2ff91	use rocksdb instead of leveldb ... -dont use block processor directly from session manager	2022-02-22 13:09:57 -05:00
Victor Shyba	2a4c5a48bf	increase indexed sd_hash prefix to 4 chars	2022-01-05 17:10:31 -03:00
Victor Shyba	5f5f39a4aa	enable and test prefix search for sd hash	2022-01-05 17:10:31 -03:00
Victor Shyba	df54cc04af	sync and search sd_hash	2022-01-05 17:10:31 -03:00
Lex Berezhny	1eaa195363	reduced crypto dependency in wallet to coincurve	2021-12-22 18:29:46 -05:00
Jack Robison	58341f4ff1	remove unused ES fields	2021-12-03 13:03:00 -05:00
Jack Robison	0d3ca80008	support lists of constraints for all range fields	2021-12-03 13:03:00 -05:00
Jack Robison	7bb293e5d6	update claim_search doc ... backward compatibility for `trending_mixed`, `trending_local`, `trending_global`, and `trending_group` args to `claim_search`	2021-12-02 14:51:52 -05:00
Victor Shyba	e7458edb72	test case for stream_type search on claims missing source + fix	2021-12-01 18:42:47 -05:00
Jack Robison	7531401623	keep touched_or_deleted records	2021-11-21 13:52:03 -05:00
Brendon J. Brewer	3f6fe995b8	Rename trending	2021-11-16 10:59:10 -05:00
Jack Robison	1e00fb369d	fix missing es notification for support amount changing	2021-11-15 00:58:18 -05:00
Jack Robison	54b522383a	improve tests	2021-11-15 00:58:18 -05:00
Jack Robison	3fe1582432	fix duplicate trending notification to ES	2021-11-15 00:58:18 -05:00
Jack Robison	85eddd2100	fix effective amount for resolve/ES being off while claims/supports are unactivated	2021-11-15 00:58:18 -05:00
Jack Robison	ddbbb6f1dd	use mempool cache in transaction_get_batch	2021-10-27 20:19:08 -04:00
Jack Robison	1e391d211b	fix attempting to update trending on abandoned claims	2021-10-23 18:39:04 -04:00
Jack Robison	1a74d6604d	skip loading tx/claim caches in the elastic sync script when not needed	2021-10-22 15:10:35 -04:00
Jack Robison	48505c2968	update trending with help from @eggplantbren	2021-10-21 00:17:12 -04:00
Jack Robison	a98ea1e66a	update sync script to handle ES falling behind leveldb on shutdown	2021-10-20 23:41:11 -04:00
Jack Robison	3dec697816	logging	2021-10-20 23:41:11 -04:00
Jack Robison	b05d071a1c	update Env to accept parameters from cli args	2021-10-20 23:41:11 -04:00
Jack Robison	a27d3b9689	set default CACHE_MB to 1024mb and the default QUERY_TIMEOUT_MS to 10s	2021-10-20 23:41:11 -04:00
Jack Robison	1facc0cd01	remove unused hub env settings	2021-10-20 23:41:11 -04:00
Jack Robison	6bef09a3b1	update lbry-hub-elastic-sync to support resyncing recent blocks	2021-10-19 15:53:20 -04:00
Jack Robison	e35319e5a2	add CACHE_ALL_CLAIM_TXOS hub setting	2021-10-19 15:53:20 -04:00
Jack Robison	0e548b3812	remove dead code	2021-10-19 15:53:20 -04:00
Jack Robison	bfac02ccab	add CACHE_ALL_TX_HASHES setting to optionally use more memory to save i/o	2021-10-19 15:53:20 -04:00
Jack Robison	7ea1a2b361	sleeps	2021-10-19 15:53:20 -04:00
Jack Robison	99df418f1d	improve resolve caching	2021-10-19 15:53:20 -04:00
Jack Robison	6416d8ce9c	threadpools for block processor and es sync reader	2021-10-19 15:53:20 -04:00
Jack Robison	22b43a2b01	doc strings	2021-10-19 15:53:20 -04:00
Jack Robison	05e5d24c5e	improve claims_producer performance	2021-10-19 15:53:20 -04:00
Jack Robison	eabcc30367	resolve lru cache	2021-10-19 15:53:20 -04:00
Jack Robison	f5e0ef5223	add block_txs index	2021-10-19 15:53:20 -04:00
Jack Robison	f46d9330b0	smaller caches	2021-10-19 15:53:20 -04:00
Jack Robison	d3516f299e	clear es attributes during initial sync	2021-10-08 16:34:48 -04:00
Jack Robison	084a76d075	fix reposted channel being missing from resolve result ... -improve names of the resolve related methods in `LevelDB`	2021-10-07 15:09:13 -04:00
Jack Robison	43432a9e48	fix compactify script	2021-10-07 00:37:55 -04:00
Jack Robison	d64a5bc12f	fix test	2021-10-06 23:53:17 -04:00
Jack Robison	ccf03fc07b	only save undo info for blocks within reorg limit	2021-10-06 12:07:42 -04:00
Jack Robison	a7c45da10c	fix channel count	2021-10-06 00:02:16 -04:00
Jack Robison	8167af9b4a	sort touched or deleted claim hashes	2021-10-05 16:44:49 -04:00
Jack Robison	4cf76123e5	block processor db refactoring ... -access db through HubDB class, don't use plyvel.DB directly -add channel count and support amount prefixes	2021-10-05 16:44:49 -04:00