794 commits

Author	SHA1	Message	Date
Jack Robison	c2a5ff0ae3	block processor db refactoring ... -access db through HubDB class, don't use plyvel.DB directly -add channel count and support amount prefixes	2022-03-15 15:34:08 -03:00
Jack Robison	afa710dcb5	fix and add test for abandoning a controlling in the same block a new claim is made	2022-03-15 15:34:08 -03:00
Jack Robison	830fc7f8cc	fix ES index name so it stays the same within a test case	2022-03-15 15:34:08 -03:00
Jack Robison	88e8926a59	fix bug with early takeover by an update	2022-03-15 15:34:08 -03:00
Jack Robison	acd0c2188f	fix activating non existent claim	2022-03-15 15:34:08 -03:00
Jack Robison	6155cda66f	add tests for takeovers from amount changes in updates before/on/after activation	2022-03-15 15:34:08 -03:00
Jack Robison	f77f2f6e80	batch address history notifications	2022-03-15 15:34:08 -03:00
Jack Robison	68d397a269	improve leveldb caching	2022-03-15 15:34:08 -03:00
Jack Robison	66ed57c834	refactor reload_blocking_filtering_streams	2022-03-15 15:34:08 -03:00
Jack Robison	8b42475d59	fix filtering error upon abandon	2022-03-15 15:34:08 -03:00
Jack Robison	de9159d83c	faster read_claim_txos	2022-03-15 15:34:08 -03:00
Jack Robison	b66adfdf78	remove unused executor	2022-03-15 15:34:08 -03:00
Victor Shyba	a4be5eb1d8	fix blocking and filtering	2022-03-15 15:34:08 -03:00
Jack Robison	7d3eef1fd9	fix logging number of notified sessions	2022-03-15 15:34:08 -03:00
Jack Robison	6e93c5bc0d	fix update that initiates takeover not being delayed	2022-03-15 15:34:08 -03:00
Jack Robison	16b21b8bda	use hub binary from https://github.com/lbryio/hub/pull/13	2022-03-15 15:34:08 -03:00
Jack Robison	a0e0039988	handle invalid release time	2022-03-15 15:34:08 -03:00
Jack Robison	3970e91766	name and normalized -> claim_name and normalized_name ... -update generated pb files	2022-03-15 15:34:08 -03:00
Jack Robison	c4126edb79	fix es sync.py	2022-03-15 15:34:08 -03:00
Jack Robison	589a6588da	fix all_claims_producer	2022-03-15 15:34:08 -03:00
Jack Robison	1ec4111b9f	merge conflicts	2022-03-15 15:34:08 -03:00
Jack Robison	c00912015a	claim search fixes	2022-03-15 15:34:08 -03:00
Jack Robison	0d19439982	fix release_time and creation_timestamp	2022-03-15 15:34:08 -03:00
Jack Robison	12f790ab01	delete unused code	2022-03-15 15:34:08 -03:00
Jack Robison	ff960fda0e	non blocking claim producer	2022-03-15 15:34:08 -03:00
Jack Robison	72e45b5cb1	fix tests	2022-03-15 15:34:08 -03:00
Jack Robison	b59e0490a2	renormalization	2022-03-15 15:34:08 -03:00
Jack Robison	ca335b7a65	fix trending overflow	2022-03-15 15:34:08 -03:00
Jack Robison	8f9e6a519d	refactor trending	2022-03-15 15:34:08 -03:00
Jack Robison	da75968078	trending fixes	2022-03-15 15:34:08 -03:00
Jack Robison	3800fb1ab0	make app backward compatible with trending_score ... -update trending decay function to zero out low trending score values faster	2022-03-15 15:34:08 -03:00
Jack Robison	a51bf6a4fa	log time to update and decay trending in elasticsearch	2022-03-15 15:34:08 -03:00
Jack Robison	0be141188c	skip integrity errors for trending spikes	2022-03-15 15:34:08 -03:00
Jack Robison	6f2b985b73	update trending in elasticsearch ... -add TrendingPrefixSpike to leveldb -expose `TRENDING_HALF_LIFE`, `TRENDING_WHALE_HALF_LIFE` and `TRENDING_WHALE_THRESHOLD` hub settings	2022-03-15 15:34:08 -03:00
Brendon J. Brewer	8eba05308d	constants	2022-03-15 15:34:08 -03:00
Brendon J. Brewer	ecab123a3a	Put trending score into ES	2022-03-15 15:34:08 -03:00
Brendon J. Brewer	180f6c4519	Mark claims as touched	2022-03-15 15:34:08 -03:00
Jack Robison	dc4e362e10	fix non normalized canonical urls	2022-03-15 15:34:08 -03:00
Jack Robison	7e78fdec04	handle unicode error for unnormalized names	2022-03-15 15:34:08 -03:00
Jack Robison	e212ce23e3	prefix db	2022-03-15 15:34:08 -03:00
Brendon J. Brewer	0c7be8975f	trending	2022-03-15 15:34:08 -03:00
Jack Robison	6cba95c148	fix claims not having non-normalized names	2022-03-15 15:34:08 -03:00
Jack Robison	91a86fd12f	merge conflicts	2022-03-15 15:34:08 -03:00
Jack Robison	c819d494c3	fix missing fields in reposts	2022-03-15 15:34:08 -03:00
Jack Robison	b4853c5f67	fix merge conflicts and simplify extract_doc	2022-03-15 15:34:08 -03:00
Jack Robison	c68334b421	fix bulk es sync	2022-03-15 15:34:08 -03:00
Jack Robison	613acc7b00	fix tests	2022-03-15 15:34:08 -03:00
Jack Robison	371fc4d68c	fix tests	2022-03-15 15:34:08 -03:00
Jack Robison	7ef0ae12a1	handle invalid claim update	2022-03-15 15:34:08 -03:00
Jack Robison	dc34e8884c	fix keeping claim_hash_to_txo and txo_to_claim in sync	2022-03-15 15:34:08 -03:00
Victor Shyba	08d635322e	implement blocking and filtering	2022-03-15 15:34:08 -03:00
Jack Robison	bc0c1b9a3e	fix _get_pending_claim_name	2022-03-15 15:34:08 -03:00
Jack Robison	c42ee926da	fix applying expiration fork	2022-03-15 15:34:08 -03:00
Jack Robison	c59d08080e	update iterators to use pack_partial_key	2022-03-15 15:34:08 -03:00
Jack Robison	94e0624024	delete lbry/wallet/server/storage.py ... -expose leveldb lru cache size as `CACHE_MB` hub param	2022-03-15 15:34:08 -03:00
Jack Robison	e94a2c7c94	remove dead code	2022-03-15 15:34:07 -03:00
Jack Robison	cd1ce32377	non blocking mempool loop	2022-03-15 15:34:07 -03:00
Jack Robison	d1560ef09b	faster es sync	2022-03-15 15:34:07 -03:00
Jack Robison	6699d1e2f8	run advance_block in threadpool	2022-03-15 15:34:07 -03:00
Jack Robison	f1fbfa1b39	use claim_to_txo cache	2022-03-15 15:34:07 -03:00
Jack Robison	0d86717a9a	faster _cached_get_active_amount for claims ... -remove dead code	2022-03-15 15:34:07 -03:00
Jack Robison	528af27e4a	fix claim search by fee for claims without fees	2022-03-15 15:34:07 -03:00
Jack Robison	fe69afaa56	clear claim_to_txo cache before reading	2022-03-15 15:34:07 -03:00
Jack Robison	31d7823498	handle claims that dont exist in ES sync	2022-03-15 15:34:07 -03:00
Jack Robison	ef6ec03161	in memory claim_to_txo and txo_to_claim dictionaries	2022-03-15 15:34:07 -03:00
Jack Robison	68596be1b9	fix spend_utxo	2022-03-15 15:34:07 -03:00
Jack Robison	a48fe84971	split flush from advance_block	2022-03-15 15:34:07 -03:00
Jack Robison	bfbe7c1bf5	rename extend_ops	2022-03-15 15:34:07 -03:00
Jack Robison	085ce1ff16	faster spend_utxo	2022-03-15 15:34:07 -03:00
Jack Robison	c81c0d9480	faster get_future_activated	2022-03-15 15:34:07 -03:00
Jack Robison	05b6bdb8f6	threadpool	2022-03-15 15:34:07 -03:00
Jack Robison	991d4f8859	cleanup	2022-03-15 15:34:07 -03:00
Jack Robison	22c75605ee	fix getting block hash during reorg	2022-03-15 15:34:07 -03:00
Jack Robison	f52faa8d14	fix test	2022-03-15 15:34:07 -03:00
Jack Robison	8dd88a2780	fix spends in address histories	2022-03-15 15:34:07 -03:00
Jack Robison	7ad2234983	faster es sync	2022-03-15 15:34:07 -03:00
Jack Robison	fb5c008fc5	fix expiring channels	2022-03-15 15:34:07 -03:00
Jack Robison	f55b6bdc71	fix abandoning signed claims in the same tx as their channel ... -fix canonical/short url in es	2022-03-15 15:34:07 -03:00
Jack Robison	de9edb0695	handle failure to generate a short id	2022-03-15 15:34:07 -03:00
Jack Robison	2180e24bc1	fix resolve by short id	2022-03-15 15:34:07 -03:00
Jack Robison	b4eaa5f918	move MemPool into BlockProcessor	2022-03-15 15:34:07 -03:00
Jack Robison	d4194954d3	combine MemPool and Notifications classes	2022-03-15 15:34:07 -03:00
Jack Robison	6e221fc7d9	fix touched hashXs notifications	2022-03-15 15:34:07 -03:00
Jack Robison	ea1285cd9f	reorg claims in the search index	2022-03-15 15:34:07 -03:00
Jack Robison	4e77fa100b	small fixes	2022-03-15 15:34:07 -03:00
Jack Robison	babb76d90d	rename	2022-03-15 15:34:07 -03:00
Jack Robison	f73153ed8d	delete stale code	2022-03-15 15:34:07 -03:00
Jack Robison	acfc1f56ee	simplify advance and reorg	2022-03-15 15:34:07 -03:00
Jack Robison	81773a6497	update limited_history	2022-03-15 15:34:07 -03:00
Jack Robison	25cf751158	update lookup_utxos	2022-03-15 15:34:07 -03:00
Jack Robison	a9c8061c0c	update RevertableOpStack	2022-03-15 15:34:07 -03:00
Jack Robison	f53b1ee290	add remaining db prefixes	2022-03-15 15:34:07 -03:00
Jack Robison	fd2753b95a	cleanup	2022-03-15 15:34:07 -03:00
Jack Robison	768934e1cc	skip es sync during initial hub sync, halt the hub upon finishing initial sync	2022-03-15 15:34:07 -03:00
Jack Robison	ad7dee3e7f	fix es sync	2022-03-15 15:34:07 -03:00
Jack Robison	354c69bf4f	fix non localhost elasticsearch	2022-03-15 15:34:07 -03:00
Jack Robison	0c85de7839	fix signed claim invalidation corner cases	2022-03-15 15:34:07 -03:00
Jack Robison	d74d06d97b	extra deletes ... -the channel_to_claim/claim_to_channel entries already get deleted when the claim txo is spent	2022-03-15 15:34:07 -03:00
Jack Robison	55351c5842	fix has_no_source for reposts	2022-03-15 15:34:07 -03:00
Jack Robison	e67152ec14	update channel_to_claim and claim_to_channel at the same time	2022-03-15 15:34:07 -03:00