280 commits

Author	SHA1	Message	Date
Jack Robison	20f35d02fa	move HubDB, delete leveldb.py	2022-02-22 13:09:57 -05:00
Jack Robison	77e64ef028	add mempool, trending, and touched address indexes to the hub db	2022-02-22 13:09:57 -05:00
Jack Robison	0a71e2ff91	use rocksdb instead of leveldb ... -dont use block processor directly from session manager	2022-02-22 13:09:57 -05:00
Victor Shyba	2a4c5a48bf	increase indexed sd_hash prefix to 4 chars	2022-01-05 17:10:31 -03:00
Victor Shyba	5f5f39a4aa	enable and test prefix search for sd hash	2022-01-05 17:10:31 -03:00
Victor Shyba	df54cc04af	sync and search sd_hash	2022-01-05 17:10:31 -03:00
Jack Robison	58341f4ff1	remove unused ES fields	2021-12-03 13:03:00 -05:00
Jack Robison	0d3ca80008	support lists of constraints for all range fields	2021-12-03 13:03:00 -05:00
Jack Robison	7bb293e5d6	update claim_search doc ... backward compatibility for `trending_mixed`, `trending_local`, `trending_global`, and `trending_group` args to `claim_search`	2021-12-02 14:51:52 -05:00
Jack Robison	7531401623	keep touched_or_deleted records	2021-11-21 13:52:03 -05:00
Jack Robison	54b522383a	improve tests	2021-11-15 00:58:18 -05:00
Jack Robison	ddbbb6f1dd	use mempool cache in transaction_get_batch	2021-10-27 20:19:08 -04:00
Jack Robison	1a74d6604d	skip loading tx/claim caches in the elastic sync script when not needed	2021-10-22 15:10:35 -04:00
Jack Robison	48505c2968	update trending with help from @eggplantbren	2021-10-21 00:17:12 -04:00
Jack Robison	a98ea1e66a	update sync script to handle ES falling behind leveldb on shutdown	2021-10-20 23:41:11 -04:00
Jack Robison	3dec697816	logging	2021-10-20 23:41:11 -04:00
Jack Robison	1facc0cd01	remove unused hub env settings	2021-10-20 23:41:11 -04:00
Jack Robison	6bef09a3b1	update lbry-hub-elastic-sync to support resyncing recent blocks	2021-10-19 15:53:20 -04:00
Jack Robison	e35319e5a2	add CACHE_ALL_CLAIM_TXOS hub setting	2021-10-19 15:53:20 -04:00
Jack Robison	22b43a2b01	doc strings	2021-10-19 15:53:20 -04:00
Jack Robison	eabcc30367	resolve lru cache	2021-10-19 15:53:20 -04:00
Jack Robison	f5e0ef5223	add block_txs index	2021-10-19 15:53:20 -04:00
Jack Robison	43432a9e48	fix compactify script	2021-10-07 00:37:55 -04:00
Jack Robison	ccf03fc07b	only save undo info for blocks within reorg limit	2021-10-06 12:07:42 -04:00
Jack Robison	8167af9b4a	sort touched or deleted claim hashes	2021-10-05 16:44:49 -04:00
Jack Robison	4cf76123e5	block processor db refactoring ... -access db through HubDB class, don't use plyvel.DB directly -add channel count and support amount prefixes	2021-10-05 16:44:49 -04:00
Jack Robison	89cd6a9aa4	add tests for takeovers from amount changes in updates before/on/after activation	2021-10-05 16:44:49 -04:00
Jack Robison	02cf478d91	improve leveldb caching	2021-10-05 16:44:49 -04:00
Jack Robison	72500f6948	faster read_claim_txos	2021-10-05 16:44:49 -04:00
Jack Robison	ece2d1e78a	name and normalized -> claim_name and normalized_name ... -update generated pb files	2021-10-05 16:44:49 -04:00
Jack Robison	1ee1a5f2a1	fix es sync.py	2021-10-05 16:44:49 -04:00
Jack Robison	6231861dd6	merge conflicts	2021-10-05 16:44:49 -04:00
Jack Robison	1ff7b77ee0	claim search fixes	2021-10-05 16:44:49 -04:00
Jack Robison	d23a0a8589	delete unused code	2021-10-05 16:44:49 -04:00
Jack Robison	2138e7ea33	fix tests	2021-10-05 16:44:49 -04:00
Jack Robison	32f8c9e59f	renormalization	2021-10-05 16:44:49 -04:00
Jack Robison	3a16edd8a6	fix trending overflow	2021-10-05 16:44:49 -04:00
Jack Robison	165f3bb270	refactor trending	2021-10-05 16:44:49 -04:00
Jack Robison	0ba75153f3	trending fixes	2021-10-05 16:44:49 -04:00
Jack Robison	db2789990f	make app backward compatible with trending_score ... -update trending decay function to zero out low trending score values faster	2021-10-05 16:44:49 -04:00
Jack Robison	acaf299bcb	log time to update and decay trending in elasticsearch	2021-10-05 16:44:49 -04:00
Jack Robison	1940301824	skip integrity errors for trending spikes	2021-10-05 16:44:49 -04:00
Jack Robison	34576e880d	update trending in elasticsearch ... -add TrendingPrefixSpike to leveldb -expose `TRENDING_HALF_LIFE`, `TRENDING_WHALE_HALF_LIFE` and `TRENDING_WHALE_THRESHOLD` hub settings	2021-10-05 16:44:49 -04:00
Brendon J. Brewer	65c0668d40	constants	2021-10-05 16:44:49 -04:00
Jack Robison	3a1baf0700	prefix db	2021-10-05 16:44:49 -04:00
Brendon J. Brewer	0c0e36b6f8	trending	2021-10-05 16:44:49 -04:00
Jack Robison	234c03db09	fix claims not having non-normalized names	2021-10-05 16:44:49 -04:00
Jack Robison	54461dfa75	fix merge conflicts and simplify extract_doc	2021-10-05 16:44:49 -04:00
Victor Shyba	d4137428ff	implement blocking and filtering	2021-10-05 16:44:49 -04:00
Jack Robison	fab9c90ccb	update iterators to use pack_partial_key	2021-10-05 16:44:49 -04:00