139 commits

Author	SHA1	Message	Date
Victor Shyba	6ad2e31976	sync and search sd_hash	2022-03-15 15:35:59 -03:00
Victor Shyba	3aac113d45	test case for stream_type search on claims missing source + fix	2022-03-15 15:34:09 -03:00
Jack Robison	948a58f628	improve tests	2022-03-15 15:34:09 -03:00
Jack Robison	5e73f82c23	fix effective amount for resolve/ES being off while claims/supports are unactivated	2022-03-15 15:34:09 -03:00
Jack Robison	b3705073a3	skip loading tx/claim caches in the elastic sync script when not needed	2022-03-15 15:34:08 -03:00
Jack Robison	fd2ab47a16	update sync script to handle ES falling behind leveldb on shutdown	2022-03-15 15:34:08 -03:00
Jack Robison	9aafb7a743	logging	2022-03-15 15:34:08 -03:00
Jack Robison	3cd2227c29	update Env to accept parameters from cli args	2022-03-15 15:34:08 -03:00
Jack Robison	cb6db3f3d8	remove unused hub env settings	2022-03-15 15:34:08 -03:00
Jack Robison	9020e39a83	update lbry-hub-elastic-sync to support resyncing recent blocks	2022-03-15 15:34:08 -03:00
Jack Robison	64509ca95d	add CACHE_ALL_CLAIM_TXOS hub setting	2022-03-15 15:34:08 -03:00
Jack Robison	e09588e433	add CACHE_ALL_TX_HASHES setting to optionally use more memory to save i/o	2022-03-15 15:34:08 -03:00
Jack Robison	50e00192e8	sleeps	2022-03-15 15:34:08 -03:00
Jack Robison	eeaf9a72e2	threadpools for block processor and es sync reader	2022-03-15 15:34:08 -03:00
Jack Robison	e0086682b9	improve claims_producer performance	2022-03-15 15:34:08 -03:00
Jack Robison	09e0d5c55e	add block_txs index	2022-03-15 15:34:08 -03:00
Jack Robison	dfe855c0c9	smaller caches	2022-03-15 15:34:08 -03:00
Jack Robison	172a0f0ac2	fix reposted channel being missing from resolve result ... -improve names of the resolve related methods in `LevelDB`	2022-03-15 15:34:08 -03:00
Jack Robison	8031a55dbb	fix test	2022-03-15 15:34:08 -03:00
Jack Robison	cb5c39a159	only save undo info for blocks within reorg limit	2022-03-15 15:34:08 -03:00
Jack Robison	ccc9a900ef	sort touched or deleted claim hashes	2022-03-15 15:34:08 -03:00
Jack Robison	c2a5ff0ae3	block processor db refactoring ... -access db through HubDB class, don't use plyvel.DB directly -add channel count and support amount prefixes	2022-03-15 15:34:08 -03:00
Jack Robison	68d397a269	improve leveldb caching	2022-03-15 15:34:08 -03:00
Jack Robison	66ed57c834	refactor reload_blocking_filtering_streams	2022-03-15 15:34:08 -03:00
Jack Robison	8b42475d59	fix filtering error upon abandon	2022-03-15 15:34:08 -03:00
Jack Robison	de9159d83c	faster read_claim_txos	2022-03-15 15:34:08 -03:00
Victor Shyba	a4be5eb1d8	fix blocking and filtering	2022-03-15 15:34:08 -03:00
Jack Robison	3970e91766	name and normalized -> claim_name and normalized_name ... -update generated pb files	2022-03-15 15:34:08 -03:00
Jack Robison	589a6588da	fix all_claims_producer	2022-03-15 15:34:08 -03:00
Jack Robison	c00912015a	claim search fixes	2022-03-15 15:34:08 -03:00
Jack Robison	0d19439982	fix release_time and creation_timestamp	2022-03-15 15:34:08 -03:00
Jack Robison	ff960fda0e	non blocking claim producer	2022-03-15 15:34:08 -03:00
Jack Robison	8f9e6a519d	refactor trending	2022-03-15 15:34:08 -03:00
Jack Robison	0be141188c	skip integrity errors for trending spikes	2022-03-15 15:34:08 -03:00
Jack Robison	6f2b985b73	update trending in elasticsearch ... -add TrendingPrefixSpike to leveldb -expose `TRENDING_HALF_LIFE`, `TRENDING_WHALE_HALF_LIFE` and `TRENDING_WHALE_THRESHOLD` hub settings	2022-03-15 15:34:08 -03:00
Brendon J. Brewer	ecab123a3a	Put trending score into ES	2022-03-15 15:34:08 -03:00
Jack Robison	dc4e362e10	fix non normalized canonical urls	2022-03-15 15:34:08 -03:00
Jack Robison	e212ce23e3	prefix db	2022-03-15 15:34:08 -03:00
Jack Robison	6cba95c148	fix claims not having non-normalized names	2022-03-15 15:34:08 -03:00
Jack Robison	c819d494c3	fix missing fields in reposts	2022-03-15 15:34:08 -03:00
Jack Robison	b4853c5f67	fix merge conflicts and simplify extract_doc	2022-03-15 15:34:08 -03:00
Jack Robison	c68334b421	fix bulk es sync	2022-03-15 15:34:08 -03:00
Jack Robison	613acc7b00	fix tests	2022-03-15 15:34:08 -03:00
Jack Robison	371fc4d68c	fix tests	2022-03-15 15:34:08 -03:00
Victor Shyba	08d635322e	implement blocking and filtering	2022-03-15 15:34:08 -03:00
Jack Robison	c42ee926da	fix applying expiration fork	2022-03-15 15:34:08 -03:00
Jack Robison	c59d08080e	update iterators to use pack_partial_key	2022-03-15 15:34:08 -03:00
Jack Robison	94e0624024	delete lbry/wallet/server/storage.py ... -expose leveldb lru cache size as `CACHE_MB` hub param	2022-03-15 15:34:08 -03:00
Jack Robison	d1560ef09b	faster es sync	2022-03-15 15:34:07 -03:00
Jack Robison	f1fbfa1b39	use claim_to_txo cache	2022-03-15 15:34:07 -03:00