308 commits

Author	SHA1	Message	Date
Jack Robison	43432a9e48	fix compactify script	2021-10-07 00:37:55 -04:00
Jack Robison	ccf03fc07b	only save undo info for blocks within reorg limit	2021-10-06 12:07:42 -04:00
Jack Robison	8167af9b4a	sort touched or deleted claim hashes	2021-10-05 16:44:49 -04:00
Jack Robison	4cf76123e5	block processor db refactoring ... -access db through HubDB class, don't use plyvel.DB directly -add channel count and support amount prefixes	2021-10-05 16:44:49 -04:00
Jack Robison	89cd6a9aa4	add tests for takeovers from amount changes in updates before/on/after activation	2021-10-05 16:44:49 -04:00
Jack Robison	02cf478d91	improve leveldb caching	2021-10-05 16:44:49 -04:00
Jack Robison	72500f6948	faster read_claim_txos	2021-10-05 16:44:49 -04:00
Jack Robison	ece2d1e78a	name and normalized -> claim_name and normalized_name ... -update generated pb files	2021-10-05 16:44:49 -04:00
Jack Robison	1ee1a5f2a1	fix es sync.py	2021-10-05 16:44:49 -04:00
Jack Robison	6231861dd6	merge conflicts	2021-10-05 16:44:49 -04:00
Jack Robison	1ff7b77ee0	claim search fixes	2021-10-05 16:44:49 -04:00
Jack Robison	d23a0a8589	delete unused code	2021-10-05 16:44:49 -04:00
Jack Robison	2138e7ea33	fix tests	2021-10-05 16:44:49 -04:00
Jack Robison	32f8c9e59f	renormalization	2021-10-05 16:44:49 -04:00
Jack Robison	3a16edd8a6	fix trending overflow	2021-10-05 16:44:49 -04:00
Jack Robison	165f3bb270	refactor trending	2021-10-05 16:44:49 -04:00
Jack Robison	0ba75153f3	trending fixes	2021-10-05 16:44:49 -04:00
Jack Robison	db2789990f	make app backward compatible with trending_score ... -update trending decay function to zero out low trending score values faster	2021-10-05 16:44:49 -04:00
Jack Robison	acaf299bcb	log time to update and decay trending in elasticsearch	2021-10-05 16:44:49 -04:00
Jack Robison	1940301824	skip integrity errors for trending spikes	2021-10-05 16:44:49 -04:00
Jack Robison	34576e880d	update trending in elasticsearch ... -add TrendingPrefixSpike to leveldb -expose `TRENDING_HALF_LIFE`, `TRENDING_WHALE_HALF_LIFE` and `TRENDING_WHALE_THRESHOLD` hub settings	2021-10-05 16:44:49 -04:00
Brendon J. Brewer	65c0668d40	constants	2021-10-05 16:44:49 -04:00
Jack Robison	3a1baf0700	prefix db	2021-10-05 16:44:49 -04:00
Brendon J. Brewer	0c0e36b6f8	trending	2021-10-05 16:44:49 -04:00
Jack Robison	234c03db09	fix claims not having non-normalized names	2021-10-05 16:44:49 -04:00
Jack Robison	54461dfa75	fix merge conflicts and simplify extract_doc	2021-10-05 16:44:49 -04:00
Victor Shyba	d4137428ff	implement blocking and filtering	2021-10-05 16:44:49 -04:00
Jack Robison	fab9c90ccb	update iterators to use pack_partial_key	2021-10-05 16:44:49 -04:00
Jack Robison	f0a195a6d4	faster es sync	2021-10-05 16:44:49 -04:00
Jack Robison	30b923b283	rename extend_ops	2021-10-05 16:44:49 -04:00
Jack Robison	a35dfd1fd1	faster es sync	2021-10-05 16:44:49 -04:00
Jack Robison	df5662dd69	fix resolve by short id	2021-10-05 16:44:49 -04:00
Jack Robison	496f89f184	reorg claims in the search index	2021-10-05 16:44:49 -04:00
Jack Robison	07e182aa16	rename	2021-10-05 16:44:49 -04:00
Jack Robison	b344f17b86	update RevertableOpStack	2021-10-05 16:44:49 -04:00
Jack Robison	677b8cb633	add remaining db prefixes	2021-10-05 16:44:49 -04:00
Jack Robison	c68f9f6f16	fix signed claim invalidation corner cases	2021-10-05 16:44:49 -04:00
Jack Robison	8bcfff05d7	update channel_to_claim and claim_to_channel at the same time	2021-10-05 16:44:49 -04:00
Jack Robison	6416ee8151	typing and fix error string	2021-10-05 16:44:49 -04:00
Jack Robison	a8f20361aa	fix RepostKey	2021-10-05 16:44:49 -04:00
Jack Robison	821be29f41	rename effective_amount prefix	2021-10-05 16:44:49 -04:00
Jack Robison	cf66c2a1ee	rename things ... -fix effective amount integrity error	2021-10-05 16:44:49 -04:00
Jack Robison	2ee419ffca	fix	2021-10-05 16:44:49 -04:00
Jack Robison	bfb9d696d7	pretty print	2021-10-05 16:44:49 -04:00
Jack Robison	1dc961d6eb	use RevertableOpStack in _get_takeover_ops	2021-10-05 16:44:49 -04:00
Jack Robison	d119fcfc98	remove debug prints	2021-10-05 16:44:49 -04:00
Jack Robison	4d3573724a	add RevertableOpStack to verify consistency of ops as they're staged	2021-10-05 16:44:49 -04:00
Jack Robison	218be22576	imports	2021-10-05 16:44:49 -04:00
Jack Robison	7688293716	close db in sync script	2021-10-05 16:44:49 -04:00
Jack Robison	34502752fc	update elastic sync	2021-10-05 16:44:49 -04:00
Jack Robison	d6758fd823	invalidate channel signatures upon channel abandon	2021-10-05 16:44:49 -04:00
Jack Robison	07c86502f6	refactor ClaimToTXO prefix	2021-10-05 16:44:49 -04:00
Jack Robison	8a555ecf1c	remove extra open functions	2021-10-05 16:44:49 -04:00
Jack Robison	f493f13b25	prints	2021-10-05 16:44:49 -04:00
Jack Robison	338488f16d	tests	2021-10-05 16:44:49 -04:00
Jack Robison	2abc67c3e8	reposts	2021-10-05 16:44:49 -04:00
Jack Robison	eb1ba143ec	fix updating the ES search index ... -update search index to use ResolveResult tuples	2021-10-05 16:44:49 -04:00
Jack Robison	6f5bca0f67	bid ordered resolve, feed ES claim data from block processor	2021-10-05 16:44:49 -04:00
Jack Robison	62a4f0fc04	fix early takeovers by not-yet activated claims	2021-10-05 16:44:49 -04:00
Jack Robison	3eb9d23108	require previous_winning arg for get_takeover_name_ops	2021-10-05 16:44:49 -04:00
Jack Robison	410d4aeb21	fix takeover edge case ... if a claim with a higher value than that of a claim taking over a name exists but isn't yet activated, activate it early and have it take over the name	2021-10-05 16:44:49 -04:00
Jack Robison	b69faf6920	bid ordered resolve (WIP)	2021-10-05 16:44:49 -04:00
Jack Robison	586b19675e	claim takeovers	2021-10-05 16:44:49 -04:00
Jack Robison	f2907536b4	move get_expiration_height and claimtrie constants to Coin class	2021-10-05 16:44:49 -04:00
Jack Robison	9a11ac06bf	claim activations and takeovers (WIP)	2021-10-05 16:44:49 -04:00
Jack Robison	6d4c1cd879	LBRYBlockProcessor -> BlockProcessor ... - temporarily disable claim_search	2021-10-05 16:44:49 -04:00
Jack Robison	b7df277a5c	db state struct ... -remove dead code	2021-10-05 16:44:49 -04:00
Jack Robison	c681041b48	claim expiration	2021-10-05 16:44:49 -04:00
Jack Robison	588edf98be	claims db ... -move all leveldb prefixes to DB_PREFIXES enum -add serializable RevertableOp interface for key/value puts and deletes -resolve urls from leveldb	2021-10-05 16:44:49 -04:00
Victor Shyba	b64aa51c0c	fix stream_types being an integer	2021-09-10 18:57:20 -03:00
Victor Shyba	9e81dd2360	refactor arguments fixup	2021-09-10 18:57:20 -03:00
Victor Shyba	1c31ec66f2	simplify operator handling	2021-09-10 18:57:20 -03:00
Victor Shyba	21c71bfac1	update sync utility	2021-08-09 18:33:47 -03:00
Victor Shyba	6baaed3581	refactor query with new fields	2021-08-09 18:33:47 -03:00
Victor Shyba	152dbfd5d1	reflect fee_currency, fee_amount and duration on repost searches	2021-08-09 18:33:47 -03:00
Victor Shyba	a56d14086b	reflect media_type on repost searches	2021-08-09 18:33:47 -03:00
Victor Shyba	aee87693f8	reflect stream_type on repost searches	2021-08-09 18:33:47 -03:00
Victor Shyba	43989122bb	add error type and message to error readme and update code	2021-08-09 15:07:44 -03:00
Victor Shyba	72712d6047	raise and disconnect if too many parameters are used on search	2021-08-09 15:07:44 -03:00
Victor Shyba	c591792de9	has_source is a special case	2021-07-22 16:25:55 -03:00
Victor Shyba	3108543ae5	3 missing fields	2021-07-22 16:25:55 -03:00
Victor Shyba	1eb221c743	translate reposted, signature_valid and normalized	2021-07-22 16:25:55 -03:00
Alex Grin	bebf6bc2e7	Update constants.py	2021-07-22 16:25:55 -03:00
Alex Grin	9e91cc2138	Update constants.py	2021-07-22 16:25:55 -03:00
Victor Shyba	5bd411ca27	filtering hash->id	2021-07-22 16:25:55 -03:00
Victor Shyba	a533cda6f0	ES: all _hash to _id	2021-07-22 16:25:55 -03:00
Lex Berezhny	e457b2f0d6	fix trending to use built-in sqlite instead of apsw	2021-06-15 18:22:42 -04:00
Lex Berezhny	c9cf7fd4d4	drop apsw in wallet.server.db.elasticsearch.sync	2021-06-15 18:22:42 -04:00
Lex Berezhny	25e16c3565	dropping apsw	2021-06-15 18:22:42 -04:00
Victor Shyba	3974df4a62	fix interaction between two modes	2021-05-27 20:14:12 -03:00
Victor Shyba	ca28de02d8	test and implementation for remove_duplicates on post-search filtering	2021-05-27 20:14:12 -03:00
Victor Shyba	bfc15ea029	handle limit being 0 and skip reordering if 0/none	2021-05-27 20:14:12 -03:00
Victor Shyba	6e8b8a5920	always call search_ahead	2021-05-27 20:14:12 -03:00
Victor Shyba	09f6637fe0	remove unused multiprocessin.Manager	2021-05-17 15:07:32 -03:00
Victor Shyba	ccadd88af5	fix cache call	2021-05-13 22:40:21 -03:00
Victor Shyba	cc02a0efc2	fix es migration bug, expand test case	2021-05-13 19:00:53 -03:00
Victor Shyba	43a1385b79	test sync helper	2021-05-13 19:00:53 -03:00
Jack Robison	eba0c9be34	fix typo	2021-05-07 16:51:19 -04:00
Jack Robison	81ebde88db	resync ES search index on version bumps ... -bump ES search index to version 1	2021-05-07 14:36:53 -04:00
Victor Shyba	a4058b84ce	clean out unused sharding	2021-05-07 15:03:37 -03:00