305 commits

Author	SHA1	Message	Date
Jack Robison	32d2208fd9	logging	2022-02-22 13:10:08 -05:00
Jack Robison	704ec9e553	add --reindex option to lbry-hub-elastic-sync	2022-02-22 13:10:08 -05:00
Jack Robison	e0f7066163	clean up claim producer	2022-02-22 13:10:08 -05:00
Jack Robison	32b26c9fa5	convert full scan iterators to range scans	2022-02-22 13:10:08 -05:00
Jack Robison	0d9d576436	add cache_size attribute to prefix classes to set the rocksdb lru cache size ... -updates rocksdb column families to use custom sized `block_cache` (an lru cache) in a `BlockBasedTableFactory` -lowers the default max open files to 64	2022-02-22 13:10:08 -05:00
Jack Robison	e6c275f86e	remove unused closed attribute	2022-02-22 13:10:08 -05:00
Jack Robison	937adbf439	add estimate_num_keys to prefix interface	2022-02-22 13:10:08 -05:00
Jack Robison	888d47f88b	fix test	2022-02-22 13:10:08 -05:00
Jack Robison	d7e50b269f	fix test	2022-02-22 13:10:08 -05:00
Jack Robison	a4bb4db8dd	rename PrefixDB class	2022-02-22 13:10:08 -05:00
Jack Robison	de1e2d0e3b	fix column family init	2022-02-22 13:10:08 -05:00
Jack Robison	c17544d8ef	fix mempool race condition in hub db writer	2022-02-22 13:10:08 -05:00
Jack Robison	7c46cc0805	fix lower bound	2022-02-22 13:10:08 -05:00
Jack Robison	fb4dc8342a	fix tests	2022-02-22 13:10:08 -05:00
Jack Robison	7d8bc38cb9	fix iterator lower bound	2022-02-22 13:10:08 -05:00
Jack Robison	04db81e954	fix tests	2022-02-22 13:09:57 -05:00
Jack Robison	b49c9fd050	fix filtering/blocking	2022-02-22 13:09:57 -05:00
Jack Robison	3c03fff380	logging, update lbry-rocksdb requirement	2022-02-22 13:09:57 -05:00
Jack Robison	47305e7446	executors	2022-02-22 13:09:57 -05:00
Jack Robison	ba6b985d71	cleanup debug logging	2022-02-22 13:09:57 -05:00
Jack Robison	49802b39cb	rocksdb column families	2022-02-22 13:09:57 -05:00
Jack Robison	46bcc5d725	executors for each reader, fix shutdown	2022-02-22 13:09:57 -05:00
Jack Robison	c0ce27ccf3	es sync notifier	2022-02-22 13:09:57 -05:00
Jack Robison	478bd0510b	es writer	2022-02-22 13:09:57 -05:00
Jack Robison	d3da442727	update undo key to include the block hash	2022-02-22 13:09:57 -05:00
Jack Robison	20f35d02fa	move HubDB, delete leveldb.py	2022-02-22 13:09:57 -05:00
Jack Robison	77e64ef028	add mempool, trending, and touched address indexes to the hub db	2022-02-22 13:09:57 -05:00
Jack Robison	0a71e2ff91	use rocksdb instead of leveldb ... -dont use block processor directly from session manager	2022-02-22 13:09:57 -05:00
Victor Shyba	2a4c5a48bf	increase indexed sd_hash prefix to 4 chars	2022-01-05 17:10:31 -03:00
Victor Shyba	5f5f39a4aa	enable and test prefix search for sd hash	2022-01-05 17:10:31 -03:00
Victor Shyba	df54cc04af	sync and search sd_hash	2022-01-05 17:10:31 -03:00
Jack Robison	58341f4ff1	remove unused ES fields	2021-12-03 13:03:00 -05:00
Jack Robison	0d3ca80008	support lists of constraints for all range fields	2021-12-03 13:03:00 -05:00
Jack Robison	7bb293e5d6	update claim_search doc ... backward compatibility for `trending_mixed`, `trending_local`, `trending_global`, and `trending_group` args to `claim_search`	2021-12-02 14:51:52 -05:00
Jack Robison	7531401623	keep touched_or_deleted records	2021-11-21 13:52:03 -05:00
Jack Robison	54b522383a	improve tests	2021-11-15 00:58:18 -05:00
Jack Robison	ddbbb6f1dd	use mempool cache in transaction_get_batch	2021-10-27 20:19:08 -04:00
Jack Robison	1a74d6604d	skip loading tx/claim caches in the elastic sync script when not needed	2021-10-22 15:10:35 -04:00
Jack Robison	48505c2968	update trending with help from @eggplantbren	2021-10-21 00:17:12 -04:00
Jack Robison	a98ea1e66a	update sync script to handle ES falling behind leveldb on shutdown	2021-10-20 23:41:11 -04:00
Jack Robison	3dec697816	logging	2021-10-20 23:41:11 -04:00
Jack Robison	1facc0cd01	remove unused hub env settings	2021-10-20 23:41:11 -04:00
Jack Robison	6bef09a3b1	update lbry-hub-elastic-sync to support resyncing recent blocks	2021-10-19 15:53:20 -04:00
Jack Robison	e35319e5a2	add CACHE_ALL_CLAIM_TXOS hub setting	2021-10-19 15:53:20 -04:00
Jack Robison	22b43a2b01	doc strings	2021-10-19 15:53:20 -04:00
Jack Robison	eabcc30367	resolve lru cache	2021-10-19 15:53:20 -04:00
Jack Robison	f5e0ef5223	add block_txs index	2021-10-19 15:53:20 -04:00
Jack Robison	43432a9e48	fix compactify script	2021-10-07 00:37:55 -04:00
Jack Robison	ccf03fc07b	only save undo info for blocks within reorg limit	2021-10-06 12:07:42 -04:00
Jack Robison	8167af9b4a	sort touched or deleted claim hashes	2021-10-05 16:44:49 -04:00