794 commits

Author	SHA1	Message	Date
Victor Shyba	239ee2437c	estimate only whats not downloaded	2020-04-27 10:34:49 -04:00
Victor Shyba	ced368db31	hold headers file in memory during runtime	2020-04-27 10:34:49 -04:00
Tom	49458d1085	fix: reposts being returned for single tags	2020-04-22 23:16:30 -04:00
Jack Robison	21c112d059	lbrycrd url	2020-04-20 12:16:31 -04:00
Jack Robison	7ffdfd12f8	faster not tags	2020-04-17 10:47:01 -04:00
Jack Robison	cb9a30f285	faster query	2020-04-17 10:47:01 -04:00
Lex Berezhny	f5d7570102	fix issue with --exclude_internal_transfers where it was filtering out sent payments	2020-04-16 17:55:49 -04:00
Jack Robison	d615f6761a	automatically batch large resolve requests	2020-04-06 12:03:33 -04:00
Jack Robison	5b29894048	add reset clients counter to prometheus	2020-04-06 12:03:33 -04:00
Victor Shyba	b2f70c7120	return none for unconfirmed time estimation	2020-04-06 06:03:35 -03:00
Jack Robison	87cdf1e3a0	improve test_reorg_change_claim_height	2020-04-05 16:58:36 -04:00
Jack Robison	57fd47022e	test_reorg_change_claim_height	2020-04-03 13:39:44 -04:00
Jack Robison	5eafd3bf6b	feedback	2020-04-03 13:39:44 -04:00
Jack Robison	640b5b0ea9	delete_claims_above_height with thread lock	2020-04-03 13:39:44 -04:00
Jack Robison	e4fb2f4680	test_reorg_dropping_claim	2020-04-03 13:39:44 -04:00
Jack Robison	f7065c6f0c	add reorg count metric to prometheus	2020-04-03 13:39:44 -04:00
Jack Robison	64f7f837e7	delete claims above reorg height from the database	2020-04-03 13:39:44 -04:00
Jack Robison	e94c28cfa2	fix header checkpoints on testnet	2020-04-03 12:21:17 -04:00
Victor Shyba	bac09e9b9f	bump checkpoints	2020-04-03 12:26:52 -03:00
Lex Berezhny	f28e3bfe37	lint	2020-04-01 20:53:09 -04:00
Lex Berezhny	6474c86d32	cleaned up *_list commands	2020-04-01 20:44:34 -04:00
Lex Berezhny	769ea8cdfe	added --is_spent filter to txo list/sum commands	2020-03-31 23:08:51 -04:00
Lex Berezhny	a5d06fb4a4	wallet_status no longer fails if wallet component has not started	2020-03-31 16:20:13 -04:00
Victor Shyba	1b83a1d09a	test and fix verifying from middle	2020-03-30 19:42:27 -03:00
Victor Shyba	d2fb7a7151	lock only when fetching, giving a chance for tip updates	2020-03-30 19:42:27 -03:00
Victor Shyba	7ad3447598	repair tip on open	2020-03-30 19:42:27 -03:00
Lex Berezhny	48d2497eb2	added txo_spend command to support liquidating large number of txos (eg. tips)	2020-03-30 17:47:38 -04:00
Lex Berezhny	a8153627c6	move on_read.first to earlier	2020-03-30 17:02:08 -04:00
Lex Berezhny	ca31363180	listen for on_read.first before it is triggered	2020-03-30 14:53:52 -04:00
Lex Berezhny	0422d2a021	estimated timestamp should be integer	2020-03-29 19:39:37 -04:00
Victor Shyba	1052126522	add wallet_syncing status	2020-03-26 11:43:48 -04:00
Jack Robison	6486f986e8	bump min required server version	2020-03-26 11:41:49 -04:00
Jack Robison	bc4075e2ed	create_task instead of ensure_future	2020-03-26 11:41:49 -04:00
Jack Robison	11525c7d0d	fix caching transaction_show	2020-03-26 11:41:49 -04:00
Jack Robison	bb12ae9ce6	fix duplicate get_merkle requests	2020-03-26 11:41:49 -04:00
Jack Robison	66b4ad0c44	improve log	2020-03-26 11:41:49 -04:00
Jack Robison	af7a7b4dc6	fix maybe_migrate_certificates blocking the api while populating channel signing keys	2020-03-26 11:41:49 -04:00
Jack Robison	ec20d9a2a8	faster wallet sync with get_transaction_and_merkle	2020-03-26 11:41:49 -04:00
Lex Berezhny	f086ebbb8e	lint	2020-03-26 00:42:11 -04:00
Lex Berezhny	e5bf6a5bfc	added txo_plot command to allow plotting txo sums over time	2020-03-26 00:37:13 -04:00
Victor Shyba	2893f1eb9e	add other taskgroup for non-start-important tasks	2020-03-23 12:36:05 -03:00
Victor Shyba	a08cbf412d	on_ready.wait so we start after tx syncs	2020-03-23 12:26:07 -03:00
Victor Shyba	342cb00625	less concurrent repeated header checks	2020-03-23 01:19:34 -03:00
Victor Shyba	952fc01efd	add script that generates checkpoints	2020-03-23 00:05:36 -03:00
Victor Shyba	3eebe301fe	move checkpoints out of folder into file	2020-03-22 23:45:14 -03:00
Victor Shyba	19c0a81c42	fix bad usages of hash and some tests	2020-03-22 23:31:47 -03:00
Victor Shyba	9fc7f9904b	fix tests, delete old code	2020-03-22 23:31:47 -03:00
Victor Shyba	b04a516063	better locking, stop corrupting headers, fix some tests	2020-03-22 23:31:47 -03:00
Victor Shyba	241e946d91	first experimental version	2020-03-22 23:31:45 -03:00
Victor Shyba	e45375dc26	more async parts	2020-03-22 23:30:11 -03:00
Victor Shyba	ec8e243323	estimate timestamps instead of using block headers	2020-03-22 23:30:11 -03:00
Victor Shyba	af0e9368d4	headers get now async	2020-03-22 23:30:11 -03:00
Lex Berezhny	73a91d5569	added --include_received_tips to claim_list/txo_list	2020-03-22 17:22:15 -04:00
Lex Berezhny	b11184de68	fix purchase_create	2020-03-22 12:23:21 -04:00
Lex Berezhny	61d02fc5d7	fix to prevent transaction cache from leaking some information about outputs between unrelated wallets	2020-03-22 11:45:40 -04:00
Lex Berezhny	09644914a6	added --include_is_my_output to claim_search	2020-03-22 01:51:09 -04:00
Lex Berezhny	b5c24d6a48	fixing unit tests	2020-03-22 01:29:26 -04:00
Lex Berezhny	bdd2ac2c25	renamed some flags	2020-03-22 01:13:26 -04:00
Lex Berezhny	76376f0d33	lint	2020-03-22 00:24:38 -04:00
Lex Berezhny	9749da46ae	added flags to resolve: --include_purchase_receipt, --include_is_my_output, --include_my_supports, --include_my_tips	2020-03-21 23:44:57 -04:00
Lex Berezhny	6a58148a89	added support for --order_by=none	2020-03-21 18:16:25 -04:00
Lex Berezhny	5cd7e9a9b8	increment scema version and force specific indexes to be used for get_txos()	2020-03-21 15:08:14 -04:00
Lex Berezhny	7cb530c334	added --channel_id and --order_by to txo_list	2020-03-20 23:19:26 -04:00
Lex Berezhny	5e0324cc91	added --reposted_claim_id to txo_list	2020-03-20 20:22:57 -04:00
Lex Berezhny	6293e227ea	added txo_sum command	2020-03-20 19:08:47 -04:00
Lex Berezhny	d6d83a5c76	integration test fix	2020-03-20 19:08:47 -04:00
Lex Berezhny	93fc883b90	fixing unit tests	2020-03-20 19:08:47 -04:00
Lex Berezhny	dd21803598	working --is_my_input_or_output --is_my_input --is_my_output etc	2020-03-20 19:08:47 -04:00
Lex Berezhny	af2f2282c2	txo_list returns txo funded by my account but sent to external address	2020-03-20 19:08:47 -04:00
Jack Robison	44b2964a6a	add blockchain.transaction.get_batch	2020-03-19 19:20:30 -04:00
Jack Robison	8fddb57e0a	reduce block lru cache sizes	2020-03-19 19:20:30 -04:00
Jack Robison	c7a5a0cab0	add blockchain.transaction.info	2020-03-19 19:20:30 -04:00
Jack Robison	95a9a76598	windows	2020-03-19 19:19:02 -04:00
Jack Robison	923cfa3d50	another	2020-03-19 19:19:02 -04:00
Jack Robison	2c489168c2	feedback	2020-03-19 19:19:02 -04:00
Jack Robison	f3292b4d34	feedback	2020-03-19 19:19:02 -04:00
Jack Robison	9769829b72	fix android executor	2020-03-19 19:19:02 -04:00
Jack Robison	f4645f570c	more read only calls	2020-03-19 19:19:02 -04:00
Jack Robison	61603ccfce	write lock	2020-03-19 19:19:02 -04:00
Jack Robison	a26cfc639c	WAL	2020-03-19 19:19:02 -04:00
Jack Robison	d1b330028c	multiple db reader processeses	2020-03-19 19:19:02 -04:00
Jack Robison	7a6b1930bf	rename executor -> writer_executor	2020-03-19 19:19:02 -04:00
Lex Berezhny	e71c17d7e7	upgrade lbrycrd to v0.17.4.4	2020-03-19 12:54:19 -04:00
Brendon J. Brewer	5f043b9a78	variable decay	2020-03-12 10:33:15 +13:00
Lex Berezhny	8ef2647fa9	is_received	2020-03-08 23:11:03 -04:00
Lex Berezhny	3ff9e99416	added txo_list command	2020-03-08 16:22:49 -04:00
Lex Berezhny	c255c606a7	added is_spent attribute to transaction outputs	2020-03-06 20:12:38 -05:00
Lex Berezhny	05228529b0	fix tests	2020-03-03 20:26:07 -05:00
Lex Berezhny	3cbeadfbc3	lbrynet status command returns features available of currenty connected wallet server, including thetrending algorithm used	2020-03-03 20:04:57 -05:00
Jack Robison	dc6194f862	perf counter	2020-03-01 15:17:21 -05:00
Jack Robison	de50214e1f	block lru cache	2020-03-01 15:17:21 -05:00
Jack Robison	5ec4a88c35	block hash lru cache	2020-03-01 15:17:05 -05:00
Jack Robison	9d5760d899	fix test	2020-03-01 14:41:14 -05:00
Jack Robison	7945e1ea3c	mempool threadpool	2020-03-01 12:40:13 -05:00
Jack Robison	d94c40e371	leveldb threadpool	2020-03-01 12:40:13 -05:00
Jack Robison	31f22122e8	block processor threadpool	2020-03-01 12:40:13 -05:00
Lex Berezhny	a02b251c9b	when using --resolve with local claim list commands, update resolved result with local metadata (such as is_mine and is_mine)	2020-02-29 09:42:11 -05:00
Lex Berezhny	33679b56fd	update claim_type_* indexes to be more peformant	2020-02-27 12:07:38 -05:00
Lex Berezhny	f514123ef0	update lbrycrd	2020-02-22 13:42:28 -05:00
Lex Berezhny	8c7908b200	reposts inherit the tags of the original claim	2020-02-22 12:23:11 -05:00
Lex Berezhny	d57900a069	claim_search --not_channel_ids excludes the channel itself and not just claims in the channel	2020-02-21 21:59:46 -05:00
Victor Shyba	1086a3297f	check its broadcasted and use a retriable call	2020-02-21 17:51:46 -03:00
Victor Shyba	f41cfbfb97	max wallet server payment fee defaults to 0 and component doesnt start in that case	2020-02-21 14:47:09 -03:00
Lex Berezhny	b1318a9958	minor cleanup	2020-02-21 10:05:46 -05:00
Victor Shyba	d2560d260c	use stream controller and documented errors	2020-02-21 00:04:37 -03:00
Jack Robison	7fd0d6507f	disconnect from client sending message larger than MAX_RECEIVE	2020-02-20 16:08:21 -05:00
Jack Robison	2f1d08e417	add MAX_RECEIVE wallet server setting	2020-02-20 14:11:16 -05:00
Victor Shyba	f0e1db319c	make wallet server payments a component	2020-02-18 19:18:30 -03:00
Victor Shyba	3950715237	add max_wallet_server_fee conf to limit daily wallet server payments	2020-02-18 18:10:58 -03:00
Victor Shyba	ae9ba14b59	use both donation and payment addresses separately	2020-02-18 18:10:58 -03:00
Victor Shyba	ad6c6fbe35	fixes from review and add analytics	2020-02-18 18:10:58 -03:00
Victor Shyba	ffa5c20c88	fix hanging test	2020-02-18 18:10:58 -03:00
Victor Shyba	5a6218eeca	improve tests, fix types	2020-02-18 18:10:58 -03:00
Victor Shyba	15a2f048ac	pay wallet server test and initial prototype	2020-02-18 18:10:58 -03:00
Victor Shyba	d317a4042c	change daily_fee to be lbc instead of dewies	2020-02-18 18:10:58 -03:00
Victor Shyba	c2d717aba5	old code from #2683	2020-02-18 18:10:58 -03:00
Lex Berezhny	0b2d9e15b4	added order bys for fee_amount	2020-02-17 17:24:48 -05:00
Lex Berezhny	d14e5e75e8	all three order bys for duration filter	2020-02-17 17:24:48 -05:00
Lex Berezhny	df11ef34d2	index cleanup	2020-02-17 17:24:48 -05:00
Lex Berezhny	4fc619262c	replacing indexes on trending_global, trending_mixed to be trending_group, trending_mixed	2020-02-17 17:24:48 -05:00
Lex Berezhny	71cb03345b	removed default order_by for claim_search	2020-02-17 16:26:29 -05:00
Jack Robison	c8c10d2bb0	fix claim apis failing with --resolve if no claims are present ... fixes https://github.com/lbryio/lbry-sdk/issues/2802	2020-02-13 14:58:51 -05:00
Jack Robison	9b46d03c91	fix race between setting items in and clearing the resolve/claim_search cache	2020-02-13 11:17:21 -05:00
Jack Robison	78eef25f1a	add reposted_claim_hash index ... fixes https://github.com/lbryio/lbry-sdk/issues/2782	2020-02-12 17:39:57 -05:00
Lex Berezhny	605fc8ecd8	claim_search by --claim_type=repost support	2020-02-12 11:51:35 -05:00
Lex Berezhny	6b745c53dc	make sure SQL IN works with python set	2020-02-12 11:41:32 -05:00
Lex Berezhny	be4515ec9a	use sets for __in constraint values	2020-02-12 10:39:25 -05:00
Lex Berezhny	dcb1b64696	SQL generation fix to handle IN operation for one value lists	2020-02-12 10:31:27 -05:00
Lex Berezhny	ffbef69dc7	manually incremented version and added support to release script to release current version	2020-02-09 20:26:15 -05:00
Brendon J. Brewer	3697d9e1f0	Tweaked some parameters, back to 134	2020-02-09 17:38:34 -05:00
Brendon J. Brewer	94524f7330	lint	2020-02-09 17:38:34 -05:00
Brendon J. Brewer	17d8a3e5d6	Use claim_hash not claim_id	2020-02-09 17:38:24 -05:00
Brendon J. Brewer	39996d7612	Only create file during install if logging is turned on	2020-02-09 17:37:55 -05:00
Brannon King	e53209e5ae	handle early lbrycrd exit in tests	2020-02-09 17:02:16 -05:00
Lex Berezhny	15a2fa6199	claim_list --claim_type argument can be repeated	2020-02-08 23:34:04 -05:00
Lex Berezhny	9607d21828	censored searches/resolves include metadata of channel which did the censoring	2020-02-07 18:50:29 -05:00
Jack Robison	bf4cbe1204	add version to session count metric	2020-02-04 12:18:32 -05:00
Jack Robison	28eee4da25	add version metrics to prometheus	2020-02-04 10:52:08 -05:00
Jack Robison	933ccf6deb	add block updates to prometheus	2020-02-04 10:26:22 -05:00
Jack Robison	9ac41322e5	add cpu count to prometheus	2020-02-04 10:25:40 -05:00
Lex Berezhny	1e81d6f848	added database index for various channel_hash based queries	2020-02-03 20:28:39 -05:00
Jack Robison	dd1de530c3	catch TimeoutError when attempting to send notifications	2020-02-03 18:46:17 -05:00
Lex Berezhny	b40bb35652	change MINIMUM_REQUIRED on client for servers it connects to	2020-02-03 13:41:05 -05:00
Lex Berezhny	dfe257af86	Revert "test to make sure next release tests pass" ... This reverts commit ebb2a09107.	2020-02-03 13:39:36 -05:00
Lex Berezhny	ebb2a09107	test to make sure next release tests pass	2020-02-03 13:22:33 -05:00
Lex Berezhny	448635a945	added --resolve to local *_list commands	2020-02-01 17:59:10 -05:00
Lex Berezhny	bfe711bd42	fixing tests	2020-02-01 13:29:55 -05:00
Lex Berezhny	15abf49211	censored resolve responses return appropriate error	2020-02-01 12:53:39 -05:00
Brendon J. Brewer	22bca7a16e	Length zero could also just mean there aren't any claims	2020-01-31 07:34:43 +13:00
jessop	73c958222b	add duration to claim search params	2020-01-29 15:46:47 -05:00
Lex Berezhny	790bbfcc99	integrate ar trending algorithm into configurable trending system	2020-01-28 18:11:32 -05:00
Brendon J. Brewer	994e70d43a	ar trending algorithm	2020-01-28 18:11:32 -05:00
Jack Robison	11530c675d	initialize_request_handlers, remove local rpc handlers	2020-01-28 15:54:22 -05:00
Jack Robison	1c474352fe	add wallet server prometheus metrics ... -sessions gauge -requests counter -response times histogram -notification counter -request errors counter -interrupt counter -operational error counter -internal error counter -reader executor times histogram -pending queries gauge -lbrycrd request counter -client versions counter	2020-01-28 15:54:22 -05:00
Jack Robison	3b2d635390	Revert "Revert "configurable trending algorithms"" ... This reverts commit 55e08f96a6.	2020-01-28 15:53:57 -05:00
Jack Robison	55e08f96a6	Revert "configurable trending algorithms"	2020-01-28 15:03:09 -05:00
Lex Berezhny	01ed71b243	configurable trending	2020-01-28 11:58:27 -05:00
Lex Berezhny	595c058517	moved trending.py to trending/zscore.py	2020-01-28 11:58:27 -05:00
Alex Grintsvayg	e04b0a6995	add docker tag to prometheus version info	2020-01-27 14:16:18 -05:00
Jack Robison	6fb1c72b7d	cached wallet id	2020-01-27 13:57:21 -05:00
Alex Grintsvayg	0732ab6ad5	add min_version and method name to metrics	2020-01-23 13:13:20 -05:00
Alex Grintsvayg	7fd56e0add	build_type.py -> build_info.py	2020-01-23 13:13:19 -05:00
Lex Berezhny	8d8a5b36b6	Merge pull request #2737 from lbryio/fix_repost_resolve_bug ... fix bug where repost claims were not being fully resolved	2020-01-22 23:32:55 -05:00
Lex Berezhny	a70cc7beb1	fix bug where repost claims were not being fully resolved	2020-01-22 22:59:05 -05:00
Alex Grintsvayg	d9f809864f	include version and build info in prometheus output	2020-01-22 19:13:58 -05:00
Lex Berezhny	bb23f509d7	rename BLOCKING_CHANNELS_IDS/FILTERING_CHANNELS_IDS to remove double S	2020-01-22 11:02:01 -05:00
Alex Grintsvayg	6c07141abd	Add prometheus metrics collection to client and server	2020-01-22 10:28:17 -05:00
Lex Berezhny	2cd7ea257c	Added support to differentiate between filtering and blocking for content censoring	2020-01-22 08:39:14 -05:00
Alex Grintsvayg	1299c9162c	Revert "Add prometheus metrics collection to client and server" ... This reverts commit 59a5bacb2e.	2020-01-21 10:30:49 -05:00
Alex Grintsvayg	8d28bb5a66	bump min protocol version	2020-01-20 12:53:10 -05:00
Lex Berezhny	9d79c52d20	add index for claim_type and release_time	2020-01-20 12:50:20 -05:00
Lex Berezhny	1ac03e2f1d	fix test	2020-01-20 12:50:16 -05:00
Lex Berezhny	801f05f45e	fix json api generator	2020-01-20 12:50:16 -05:00
Lex Berezhny	345196aa3b	add pagination for claim_search	2020-01-20 12:49:42 -05:00
Lex Berezhny	86cedfe8b2	using multiprocessing.Manager to keep blocked content synced between readers	2020-01-20 12:49:41 -05:00
Alex Grintsvayg	59a5bacb2e	Add prometheus metrics collection to client and server	2020-01-20 12:43:49 -05:00
Jack Robison	53eb033034	disconnect from server that returns rpc error for server.version ... -the server returns this error if it thinks we are incompatible with it	2020-01-15 17:06:13 -05:00
Jack Robison	1bf51e855d	check minimum server version from wallet client	2020-01-15 15:55:39 -05:00
Victor Shyba	d34f5c2712	fix None in history, check records after wait	2020-01-13 21:17:10 -05:00
Jack Robison	1a802469f5	missing fetchall()	2020-01-12 16:16:48 -05:00
Jack Robison	b34f44c867	logging	2020-01-11 00:17:32 -05:00
Jack Robison	0bb4cdadd9	use network.subscribe_address	2020-01-10 13:57:52 -05:00
Jack Robison	08f6520557	bare excepts	2020-01-10 12:27:56 -05:00
Jack Robison	38b108752e	batched blockchain.address.subscribe	2020-01-09 23:40:04 -05:00
Jack Robison	0ee7870bdf	defaultdict	2020-01-09 23:06:29 -05:00
Jack Robison	37d46ecdb2	fix looping over same things in _transaction_io	2020-01-09 23:06:29 -05:00
Victor Shyba	3615e0de34	cleanup leftover comment from review	2020-01-07 19:57:34 -05:00
Victor Shyba	e73c081d36	remove bandwidth_limit env option	2020-01-07 19:57:34 -05:00
Victor Shyba	60194cbafd	remove bw_limit on server	2020-01-07 19:57:34 -05:00
Lex Berezhny	78732513c8	set wallet server min/max 0.52.0-0.99.0	2020-01-06 12:17:09 -05:00
Lex Berezhny	cbc6d6a572	pylint passes for lbry/wallet	2020-01-03 03:08:15 -05:00
Lex Berezhny	fb1af9e3d2	update imports and more merging	2020-01-03 03:08:15 -05:00
Lex Berezhny	c9e410a6f4	merged torba base classes with lbry sub-classes	2020-01-03 03:08:15 -05:00
Lex Berezhny	2968f74c6c	moved lbry up one level	2020-01-01 15:57:56 -05:00