568 commits

Author	SHA1	Message	Date
Jack Robison	d7ecde7040	drop ES_MODE hub setting, rename hub entry points ... `lbry-hub-writer` - keeps an up-to-date database `lbry-hub-server` - replies to clients with data from a read only snapshot of the db `lbry-hub-elastic-sync` - watches for changes to the db and updates elasticsearch accordingly	2022-02-22 13:09:57 -05:00
Jack Robison	e2a75758f8	delete unused code	2022-02-22 13:09:57 -05:00
Jack Robison	f449cf61ab	update mempool in thread	2022-02-22 13:09:57 -05:00
Jack Robison	04db81e954	fix tests	2022-02-22 13:09:57 -05:00
Jack Robison	b49c9fd050	fix filtering/blocking	2022-02-22 13:09:57 -05:00
Jack Robison	3c03fff380	logging, update lbry-rocksdb requirement	2022-02-22 13:09:57 -05:00
Jack Robison	b1441d4247	wait for writing to finish before closing the db	2022-02-22 13:09:57 -05:00
Jack Robison	81458b75e4	fix unwinding readers during reorg	2022-02-22 13:09:57 -05:00
Jack Robison	f0f8ef044b	reduce hub writer polling delay	2022-02-22 13:09:57 -05:00
Jack Robison	47305e7446	executors	2022-02-22 13:09:57 -05:00
Jack Robison	ba6b985d71	cleanup debug logging	2022-02-22 13:09:57 -05:00
Jack Robison	49802b39cb	rocksdb column families	2022-02-22 13:09:57 -05:00
Jack Robison	46bcc5d725	executors for each reader, fix shutdown	2022-02-22 13:09:57 -05:00
Jack Robison	c0ce27ccf3	es sync notifier	2022-02-22 13:09:57 -05:00
Jack Robison	cfae30a364	reader/writer move from cli	2022-02-22 13:09:57 -05:00
Jack Robison	53e3828965	remove redundant undo cleanup, don't delete historic touched_or_deleted	2022-02-22 13:09:57 -05:00
Jack Robison	4f16f1c829	imports, impove errors	2022-02-22 13:09:57 -05:00
Jack Robison	478bd0510b	es writer	2022-02-22 13:09:57 -05:00
Jack Robison	499ee74dfc	add chain reader and reader server, new mempool, update block processor	2022-02-22 13:09:57 -05:00
Jack Robison	d3da442727	update undo key to include the block hash	2022-02-22 13:09:57 -05:00
Jack Robison	358fa21eaf	move Prefetcher to own file	2022-02-22 13:09:57 -05:00
Jack Robison	20f35d02fa	move HubDB, delete leveldb.py	2022-02-22 13:09:57 -05:00
Jack Robison	77e64ef028	add mempool, trending, and touched address indexes to the hub db	2022-02-22 13:09:57 -05:00
Jack Robison	0a71e2ff91	use rocksdb instead of leveldb ... -dont use block processor directly from session manager	2022-02-22 13:09:57 -05:00
Victor Shyba	2a4c5a48bf	increase indexed sd_hash prefix to 4 chars	2022-01-05 17:10:31 -03:00
Victor Shyba	5f5f39a4aa	enable and test prefix search for sd hash	2022-01-05 17:10:31 -03:00
Victor Shyba	df54cc04af	sync and search sd_hash	2022-01-05 17:10:31 -03:00
Lex Berezhny	1eaa195363	reduced crypto dependency in wallet to coincurve	2021-12-22 18:29:46 -05:00
Jack Robison	58341f4ff1	remove unused ES fields	2021-12-03 13:03:00 -05:00
Jack Robison	0d3ca80008	support lists of constraints for all range fields	2021-12-03 13:03:00 -05:00
Jack Robison	7bb293e5d6	update claim_search doc ... backward compatibility for `trending_mixed`, `trending_local`, `trending_global`, and `trending_group` args to `claim_search`	2021-12-02 14:51:52 -05:00
Victor Shyba	e7458edb72	test case for stream_type search on claims missing source + fix	2021-12-01 18:42:47 -05:00
Jack Robison	7531401623	keep touched_or_deleted records	2021-11-21 13:52:03 -05:00
Brendon J. Brewer	3f6fe995b8	Rename trending	2021-11-16 10:59:10 -05:00
Jack Robison	1e00fb369d	fix missing es notification for support amount changing	2021-11-15 00:58:18 -05:00
Jack Robison	54b522383a	improve tests	2021-11-15 00:58:18 -05:00
Jack Robison	3fe1582432	fix duplicate trending notification to ES	2021-11-15 00:58:18 -05:00
Jack Robison	85eddd2100	fix effective amount for resolve/ES being off while claims/supports are unactivated	2021-11-15 00:58:18 -05:00
Jack Robison	ddbbb6f1dd	use mempool cache in transaction_get_batch	2021-10-27 20:19:08 -04:00
Jack Robison	1e391d211b	fix attempting to update trending on abandoned claims	2021-10-23 18:39:04 -04:00
Jack Robison	1a74d6604d	skip loading tx/claim caches in the elastic sync script when not needed	2021-10-22 15:10:35 -04:00
Jack Robison	48505c2968	update trending with help from @eggplantbren	2021-10-21 00:17:12 -04:00
Jack Robison	a98ea1e66a	update sync script to handle ES falling behind leveldb on shutdown	2021-10-20 23:41:11 -04:00
Jack Robison	3dec697816	logging	2021-10-20 23:41:11 -04:00
Jack Robison	b05d071a1c	update Env to accept parameters from cli args	2021-10-20 23:41:11 -04:00
Jack Robison	a27d3b9689	set default CACHE_MB to 1024mb and the default QUERY_TIMEOUT_MS to 10s	2021-10-20 23:41:11 -04:00
Jack Robison	1facc0cd01	remove unused hub env settings	2021-10-20 23:41:11 -04:00
Jack Robison	6bef09a3b1	update lbry-hub-elastic-sync to support resyncing recent blocks	2021-10-19 15:53:20 -04:00
Jack Robison	e35319e5a2	add CACHE_ALL_CLAIM_TXOS hub setting	2021-10-19 15:53:20 -04:00
Jack Robison	0e548b3812	remove dead code	2021-10-19 15:53:20 -04:00