530 commits

Author	SHA1	Message	Date
Jack Robison	ff960fda0e	non blocking claim producer	2022-03-15 15:34:08 -03:00
Jack Robison	72e45b5cb1	fix tests	2022-03-15 15:34:08 -03:00
Jack Robison	b59e0490a2	renormalization	2022-03-15 15:34:08 -03:00
Jack Robison	ca335b7a65	fix trending overflow	2022-03-15 15:34:08 -03:00
Jack Robison	8f9e6a519d	refactor trending	2022-03-15 15:34:08 -03:00
Jack Robison	da75968078	trending fixes	2022-03-15 15:34:08 -03:00
Jack Robison	3800fb1ab0	make app backward compatible with trending_score ... -update trending decay function to zero out low trending score values faster	2022-03-15 15:34:08 -03:00
Jack Robison	a51bf6a4fa	log time to update and decay trending in elasticsearch	2022-03-15 15:34:08 -03:00
Jack Robison	0be141188c	skip integrity errors for trending spikes	2022-03-15 15:34:08 -03:00
Jack Robison	6f2b985b73	update trending in elasticsearch ... -add TrendingPrefixSpike to leveldb -expose `TRENDING_HALF_LIFE`, `TRENDING_WHALE_HALF_LIFE` and `TRENDING_WHALE_THRESHOLD` hub settings	2022-03-15 15:34:08 -03:00
Brendon J. Brewer	8eba05308d	constants	2022-03-15 15:34:08 -03:00
Brendon J. Brewer	ecab123a3a	Put trending score into ES	2022-03-15 15:34:08 -03:00
Brendon J. Brewer	180f6c4519	Mark claims as touched	2022-03-15 15:34:08 -03:00
Jack Robison	dc4e362e10	fix non normalized canonical urls	2022-03-15 15:34:08 -03:00
Jack Robison	7e78fdec04	handle unicode error for unnormalized names	2022-03-15 15:34:08 -03:00
Jack Robison	e212ce23e3	prefix db	2022-03-15 15:34:08 -03:00
Brendon J. Brewer	0c7be8975f	trending	2022-03-15 15:34:08 -03:00
Jack Robison	6cba95c148	fix claims not having non-normalized names	2022-03-15 15:34:08 -03:00
Jack Robison	91a86fd12f	merge conflicts	2022-03-15 15:34:08 -03:00
Jack Robison	c819d494c3	fix missing fields in reposts	2022-03-15 15:34:08 -03:00
Jack Robison	b4853c5f67	fix merge conflicts and simplify extract_doc	2022-03-15 15:34:08 -03:00
Jack Robison	c68334b421	fix bulk es sync	2022-03-15 15:34:08 -03:00
Jack Robison	613acc7b00	fix tests	2022-03-15 15:34:08 -03:00
Jack Robison	371fc4d68c	fix tests	2022-03-15 15:34:08 -03:00
Jack Robison	7ef0ae12a1	handle invalid claim update	2022-03-15 15:34:08 -03:00
Jack Robison	dc34e8884c	fix keeping claim_hash_to_txo and txo_to_claim in sync	2022-03-15 15:34:08 -03:00
Victor Shyba	08d635322e	implement blocking and filtering	2022-03-15 15:34:08 -03:00
Jack Robison	bc0c1b9a3e	fix _get_pending_claim_name	2022-03-15 15:34:08 -03:00
Jack Robison	c42ee926da	fix applying expiration fork	2022-03-15 15:34:08 -03:00
Jack Robison	c59d08080e	update iterators to use pack_partial_key	2022-03-15 15:34:08 -03:00
Jack Robison	94e0624024	delete lbry/wallet/server/storage.py ... -expose leveldb lru cache size as `CACHE_MB` hub param	2022-03-15 15:34:08 -03:00
Jack Robison	e94a2c7c94	remove dead code	2022-03-15 15:34:07 -03:00
Jack Robison	cd1ce32377	non blocking mempool loop	2022-03-15 15:34:07 -03:00
Jack Robison	d1560ef09b	faster es sync	2022-03-15 15:34:07 -03:00
Jack Robison	6699d1e2f8	run advance_block in threadpool	2022-03-15 15:34:07 -03:00
Jack Robison	f1fbfa1b39	use claim_to_txo cache	2022-03-15 15:34:07 -03:00
Jack Robison	0d86717a9a	faster _cached_get_active_amount for claims ... -remove dead code	2022-03-15 15:34:07 -03:00
Jack Robison	528af27e4a	fix claim search by fee for claims without fees	2022-03-15 15:34:07 -03:00
Jack Robison	fe69afaa56	clear claim_to_txo cache before reading	2022-03-15 15:34:07 -03:00
Jack Robison	31d7823498	handle claims that dont exist in ES sync	2022-03-15 15:34:07 -03:00
Jack Robison	ef6ec03161	in memory claim_to_txo and txo_to_claim dictionaries	2022-03-15 15:34:07 -03:00
Jack Robison	68596be1b9	fix spend_utxo	2022-03-15 15:34:07 -03:00
Jack Robison	a48fe84971	split flush from advance_block	2022-03-15 15:34:07 -03:00
Jack Robison	bfbe7c1bf5	rename extend_ops	2022-03-15 15:34:07 -03:00
Jack Robison	085ce1ff16	faster spend_utxo	2022-03-15 15:34:07 -03:00
Jack Robison	c81c0d9480	faster get_future_activated	2022-03-15 15:34:07 -03:00
Jack Robison	05b6bdb8f6	threadpool	2022-03-15 15:34:07 -03:00
Jack Robison	991d4f8859	cleanup	2022-03-15 15:34:07 -03:00
Jack Robison	22c75605ee	fix getting block hash during reorg	2022-03-15 15:34:07 -03:00
Jack Robison	f52faa8d14	fix test	2022-03-15 15:34:07 -03:00
Jack Robison	8dd88a2780	fix spends in address histories	2022-03-15 15:34:07 -03:00
Jack Robison	7ad2234983	faster es sync	2022-03-15 15:34:07 -03:00
Jack Robison	fb5c008fc5	fix expiring channels	2022-03-15 15:34:07 -03:00
Jack Robison	f55b6bdc71	fix abandoning signed claims in the same tx as their channel ... -fix canonical/short url in es	2022-03-15 15:34:07 -03:00
Jack Robison	de9edb0695	handle failure to generate a short id	2022-03-15 15:34:07 -03:00
Jack Robison	2180e24bc1	fix resolve by short id	2022-03-15 15:34:07 -03:00
Jack Robison	b4eaa5f918	move MemPool into BlockProcessor	2022-03-15 15:34:07 -03:00
Jack Robison	d4194954d3	combine MemPool and Notifications classes	2022-03-15 15:34:07 -03:00
Jack Robison	6e221fc7d9	fix touched hashXs notifications	2022-03-15 15:34:07 -03:00
Jack Robison	ea1285cd9f	reorg claims in the search index	2022-03-15 15:34:07 -03:00
Jack Robison	4e77fa100b	small fixes	2022-03-15 15:34:07 -03:00
Jack Robison	babb76d90d	rename	2022-03-15 15:34:07 -03:00
Jack Robison	f73153ed8d	delete stale code	2022-03-15 15:34:07 -03:00
Jack Robison	acfc1f56ee	simplify advance and reorg	2022-03-15 15:34:07 -03:00
Jack Robison	81773a6497	update limited_history	2022-03-15 15:34:07 -03:00
Jack Robison	25cf751158	update lookup_utxos	2022-03-15 15:34:07 -03:00
Jack Robison	a9c8061c0c	update RevertableOpStack	2022-03-15 15:34:07 -03:00
Jack Robison	f53b1ee290	add remaining db prefixes	2022-03-15 15:34:07 -03:00
Jack Robison	fd2753b95a	cleanup	2022-03-15 15:34:07 -03:00
Jack Robison	768934e1cc	skip es sync during initial hub sync, halt the hub upon finishing initial sync	2022-03-15 15:34:07 -03:00
Jack Robison	ad7dee3e7f	fix es sync	2022-03-15 15:34:07 -03:00
Jack Robison	354c69bf4f	fix non localhost elasticsearch	2022-03-15 15:34:07 -03:00
Jack Robison	0c85de7839	fix signed claim invalidation corner cases	2022-03-15 15:34:07 -03:00
Jack Robison	d74d06d97b	extra deletes ... -the channel_to_claim/claim_to_channel entries already get deleted when the claim txo is spent	2022-03-15 15:34:07 -03:00
Jack Robison	55351c5842	fix has_no_source for reposts	2022-03-15 15:34:07 -03:00
Jack Robison	e67152ec14	update channel_to_claim and claim_to_channel at the same time	2022-03-15 15:34:07 -03:00
Jack Robison	287ff0a557	typing and fix error string	2022-03-15 15:34:07 -03:00
Jack Robison	bf539d67ea	update staged txo_to_claim after invalidating channel sig ... -fixes abandon of claim with invalidated signature and an update in same block	2022-03-15 15:34:07 -03:00
Jack Robison	69651453dd	missing channel_to_claim delete	2022-03-15 15:34:07 -03:00
Jack Robison	7f743ff3f1	fix RepostKey	2022-03-15 15:34:07 -03:00
Jack Robison	a1b7c61b56	typing	2022-03-15 15:34:07 -03:00
Jack Robison	fbd1d53542	fix	2022-03-15 15:34:07 -03:00
Jack Robison	02adc74e2c	cleanup	2022-03-15 15:34:07 -03:00
Jack Robison	3a452a3b2a	rename effective_amount prefix	2022-03-15 15:34:07 -03:00
Jack Robison	91f8b3b505	fix undeleted claim_to_channel record	2022-03-15 15:34:07 -03:00
Jack Robison	ce09f2eb0f	cleanup	2022-03-15 15:34:07 -03:00
Jack Robison	02d479b92d	fix mismatch in claim_to_txo<->txo_to_claim	2022-03-15 15:34:07 -03:00
Jack Robison	bce14c3d79	rename things ... -fix effective amount integrity error	2022-03-15 15:34:07 -03:00
Jack Robison	90cfcaac40	fix	2022-03-15 15:34:07 -03:00
Jack Robison	02563db2c7	pretty print	2022-03-15 15:34:07 -03:00
Jack Robison	cfa32a3986	fix duplicate activate	2022-03-15 15:34:07 -03:00
Jack Robison	ab4a6bc5b8	fix updating resolve by effective amount after abandoning support	2022-03-15 15:34:07 -03:00
Jack Robison	f01b8c849d	use RevertableOpStack in _get_takeover_ops	2022-03-15 15:34:07 -03:00
Jack Robison	6a46f50a35	remove debug prints	2022-03-15 15:34:07 -03:00
Jack Robison	468ed91ee3	add RevertableOpStack to verify consistency of ops as they're staged	2022-03-15 15:34:07 -03:00
Jack Robison	b856e2120a	fix fee amount overflow in es	2022-03-15 15:34:07 -03:00
Jack Robison	fd7bfbea78	faster claim producer ... -make batches of claim txos from the iterator, and sort by tx hash before fetching to maximize cache and read ahead hits	2022-03-15 15:34:07 -03:00
Jack Robison	a74434e269	imports	2022-03-15 15:34:07 -03:00
Jack Robison	92be63ff5b	close db in sync script	2022-03-15 15:34:07 -03:00
Jack Robison	4ce16b6509	try default block size	2022-03-15 15:34:07 -03:00