1380 commits

Author	SHA1	Message	Date
Jack Robison	e9c7cf6f63	logging	2021-01-21 14:51:59 -05:00
Jack Robison	68f1661452	add LRUCache with no prometheus metrics	2021-01-21 14:37:08 -05:00
Jack Robison	36fd1b91ae	cache server features	2021-01-21 14:37:08 -05:00
Jack Robison	a4ec430ac0	improve subscription performance	2021-01-21 14:37:08 -05:00
Jack Robison	519614b2fd	skip libtorrent component in tests	2021-01-21 14:37:08 -05:00
Lex Berezhny	bf0118c8ef	added support for --not_channel_id to txo_list commands	2021-01-21 14:03:59 -05:00
Jack Robison	7952fc8324	fix reflector loop propagating cancelled error	2021-01-08 09:53:12 -05:00
Victor Shyba	2a17787242	fix test	2021-01-04 18:04:06 -03:00
Victor Shyba	0a53ad5721	use the comment api signing implementation	2021-01-04 18:04:06 -03:00
Victor Shyba	6da6bdc863	adds jsonrpc_channel_sign signing api	2021-01-04 18:04:06 -03:00
Jack Robison	77e19ab1a4	prometheus metrics for asyncio loop responsiveness	2021-01-01 15:25:31 -05:00
Victor Shyba	b882f1a010	log checkpoint finishing for gathering information on wal/shm file bug	2020-12-31 16:11:22 -03:00
Jack Robison	0758b85179	skip null args given to channel_ids in claim search	2020-12-29 21:41:07 -05:00
Jack Robison	ab3d9bd080	block cache metrics	2020-12-29 21:40:39 -05:00
Jack Robison	66029e60d3	v0.87.0	2020-12-23 21:51:13 -05:00
Jack Robison	9dd5159414	increase server cache sizes	2020-12-23 20:47:05 -05:00
Jack Robison	13e38d6fd8	use LRUCache instead of pylru in wallet server	2020-12-23 20:47:05 -05:00
Jack Robison	10dcb64715	lru cache metrics	2020-12-23 20:47:03 -05:00
Victor Shyba	adb418aafc	group cache hits in a single dict	2020-12-23 21:37:20 -03:00
Victor Shyba	270da80d64	return whole batches	2020-12-23 19:10:19 -03:00
Victor Shyba	b2027cfd66	sync in batches of 10, clearing after	2020-12-23 18:30:52 -03:00
Jack Robison	7a7446c8bd	force resync blockchain.db	2020-12-22 20:08:26 -05:00
Jack Robison	8c71b744f3	fix request_synced_transactions edge cases	2020-12-22 15:19:08 -05:00
Jack Robison	4cbf4230e8	fix txi.txo_ref	2020-12-22 14:05:37 -05:00
Victor Shyba	6a610187e0	cache bypass	2020-12-22 13:01:30 -03:00
Victor Shyba	eb2a4aebba	unrestricted and reusing verified cache hits	2020-12-21 16:49:08 -03:00
Victor Shyba	21a2e67755	fix rebase	2020-12-20 21:39:36 -03:00
Victor Shyba	3b9e312615	fix verification	2020-12-20 21:25:26 -03:00
Victor Shyba	26dab04c9e	checkpoint	2020-12-20 21:25:26 -03:00
Victor Shyba	00713c0d11	asyncgens	2020-12-20 21:25:26 -03:00
Victor Shyba	751b5f3027	refactor duplicate code	2020-12-20 21:25:26 -03:00
Victor Shyba	e8261b000e	wip, see jack	2020-12-20 21:23:58 -03:00
Victor Shyba	41ecb70297	join network can only happen after initial header sync returns	2020-12-20 21:15:11 -03:00
Jack Robison	e3a4964787	catch any remaining index errors in fs_tx_hash	2020-12-16 01:28:30 -05:00
Jack Robison	9bf72910a4	fix off by one error in reorg	2020-12-16 01:27:03 -05:00
Jack Robison	ee39e20e6d	logging	2020-12-16 01:26:19 -05:00
Jack Robison	0821ce44b5	remove unused heavy call	2020-12-15 19:22:12 -05:00
Jack Robison	674ce02e58	logging	2020-12-14 14:38:36 -05:00
Jack Robison	8dfa2767ec	new_touched	2020-12-14 13:52:26 -05:00
Jack Robison	20dad7f07f	only notify hashxs touched since last notification	2020-12-14 13:42:20 -05:00
Jack Robison	751cc4c44d	don't deserialize mempool in a thread	2020-12-13 13:48:50 -05:00
Jack Robison	2318e6d8e9	faster fs_transactions	2020-12-13 13:48:02 -05:00
Jack Robison	61b4a492c3	v0.86.1	2020-12-08 16:41:46 -05:00
Jack Robison	8da73ad3dd	improve hash_to_hex_str performance	2020-12-08 15:39:03 -05:00
Jack Robison	b8c16d8ac5	fix mempool txs being re-requested with each address notification	2020-12-08 15:39:03 -05:00
Jack Robison	429c0951f3	v0.86.0	2020-12-07 21:19:24 -05:00
Jack Robison	74e103c791	version	2020-12-07 21:15:15 -05:00
Jack Robison	f941950ee2	fix comment_create docs	2020-12-07 21:13:43 -05:00
Jack Robison	846df2eef1	v0.86.0	2020-12-07 15:58:05 -05:00
Jack Robison	eae0290978	fix mempool notification bloat	2020-12-07 13:16:37 -05:00
Jack Robison	3467d1fed0	fix tests	2020-12-03 22:16:28 -05:00
Jack Robison	d02ff232e5	_single_batch	2020-12-03 20:50:25 -05:00
Jack Robison	2d1c6a5402	fix	2020-12-03 19:15:15 -05:00
Jack Robison	eab3b65629	calculate notifications for all subscriptions instead of per session	2020-12-03 19:15:15 -05:00
Jack Robison	929617273d	resync blockchain.db	2020-12-03 15:56:35 -05:00
Jack Robison	2717bf7d49	increase default tx_cache_size setting	2020-12-03 15:56:35 -05:00
Jack Robison	9b4afe9816	store txids in memory, faster address subscription/history	2020-11-25 16:30:11 -05:00
Jack Robison	af1d7813e9	ensure transactions are returned in the order they're requested	2020-11-24 11:52:07 -05:00
Jack Robison	c02750edbd	fix tx_merkle	2020-11-23 16:48:24 -05:00
Jack Robison	faeba9a7e4	faster blockchain.transaction.get_batch	2020-11-23 12:05:47 -05:00
Jack Robison	190d238a1f	faster read_headers	2020-11-23 12:03:11 -05:00
Jack Robison	715451b5fb	v0.85.0	2020-11-21 00:14:20 -05:00
Jack Robison	923d817751	store headers in memory	2020-11-20 22:37:42 -05:00
Victor Shyba	b8b9dcc2ee	WAL_CHECKPOINT on close	2020-11-20 20:16:03 -03:00
Jack Robison	34f4f12eb9	pylint	2020-11-20 16:15:57 -05:00
Jack Robison	fa63bf758d	delete single_call_context, use session pool	2020-11-20 15:52:11 -05:00
Jack Robison	2c7fd58e34	threaded compress headers	2020-11-20 13:09:54 -05:00
Jack Robison	f2fd42b47a	use write_batch	2020-11-19 18:37:49 -05:00
Jack Robison	1b4ccad938	allow settings TRENDING_ALGORITHMS to nothing	2020-11-19 18:36:34 -05:00
Jack Robison	a9de1ce8e0	fix fs_transactions	2020-11-19 12:40:46 -05:00
Jack Robison	632d8d02d2	remove dead code	2020-11-17 16:17:24 -05:00
Jack Robison	48aeb26e02	threaded_get_merkle ... -remove dead code	2020-11-17 16:05:08 -05:00
Jack Robison	1694af8b5e	get transactions from leveldb instead of lbrycrd rpc	2020-11-17 15:30:48 -05:00
Jack Robison	83bcab9cd2	cleanup	2020-11-17 15:30:48 -05:00
Jack Robison	bdc7f4b3f5	combine tx_count_db and hashes_db, add tx db	2020-11-17 15:30:48 -05:00
Lex Berezhny	912065a121	remove url sequence feature from code and tests	2020-11-17 11:24:29 -05:00
Thomas Zarebczan	c8466afac2	Remove * from invalid characters ... This is already part of other URLs and channels, will be removed from spec as it won't be used for sequencing.	2020-11-16 14:09:04 -05:00
Victor Shyba	2619e162c1	recover invalid state described on #3026	2020-11-09 16:03:38 -05:00
Lex Berezhny	e1112e17f8	v0.84.0	2020-11-08 19:42:33 -05:00
Jack Robison	bbed9b94c1	null language filtering for claim search	2020-11-05 21:23:49 -05:00
Brendon J. Brewer	1cdff47477	Rewrite of variable_decay.py for speed improvements	2020-11-05 21:15:55 -05:00
Jack Robison	d83936a66a	fix uncaught error	2020-11-04 22:21:35 -05:00
Jack Robison	5517d2bf56	fix new_sdk_server arg for resolve	2020-11-03 16:23:31 -05:00
Jack Robison	925a458abe	tags	2020-11-03 10:39:08 -05:00
Jack Robison	76946c447f	use single_call_context for claim_search and resolve	2020-11-03 10:39:08 -05:00
Lex Berezhny	5e17ce0a0b	minor fixup	2020-10-30 11:37:54 -04:00
Kevin Raoofi	e8d299d3b6	Allow : or # for claim_id ... This removes the code for trying multiple patterns and the setup for it Added a few unit tests to check that the parsed URL is as expected	2020-10-30 11:37:54 -04:00
Kevin Raoofi	7637aa2ab6	Added support for spec compliant URL parsing ... Legacy URLs are preserved by attempting to parse the new URL format and, on failing that, it'll attempt the legacy one. Tests had to be updated such that the correct things are asserted against each other.	2020-10-30 11:37:54 -04:00
Jack Robison	ab067d1d3a	fix unclean closing of blockchain.db	2020-10-26 16:23:28 -04:00
Lex Berezhny	4c5429af15	fix lint	2020-10-16 12:03:01 -04:00
Alex Grintsvayg	0a0ac3b7c9	pass-through for new support_sum api	2020-10-16 12:03:01 -04:00
Lex Berezhny	24833ce9fb	v0.83.0	2020-10-10 13:03:42 -04:00
jessop	7384609e74	support comment pinning	2020-10-10 13:02:38 -04:00
Lex Berezhny	3047649650	v0.82.0	2020-09-29 08:49:16 -04:00
Lex Berezhny	ec2f6c6b80	lint	2020-09-29 07:52:33 -04:00
Akinwale Ariwodola	838cc60161	conditional import	2020-09-29 07:52:33 -04:00
Akinwale Ariwodola	310c61a5cc	check KIVY_BUILD env variable	2020-09-29 07:52:33 -04:00
Jack Robison	3a64ceb4d6	add forward compatibility for byte datagram keys	2020-09-28 15:56:13 -04:00
Jack Robison	46dc15dd29	use language indexes	2020-09-28 14:45:51 -04:00
Jack Robison	8dc654b513	add language table and indexes	2020-09-28 14:45:51 -04:00
Jack Robison	7000ac3f3f	update indexed tags	2020-09-28 14:45:51 -04:00
jessop	0231139b01	support anonymous react_list	2020-09-27 16:36:51 -04:00
jessop	d6ee6446dd	react list takes comment_ids	2020-09-26 15:21:26 -04:00
Lex Berezhny	7b666efcf8	lbrycrd download path	2020-09-24 20:11:40 -04:00
Lex Berezhny	eb5d2198fc	lint	2020-09-24 20:09:46 -04:00
Lex Berezhny	34e44ebd1c	minor cleanup and lint fixes	2020-09-24 20:03:22 -04:00
jessop	bf2f4bc040	wip	2020-09-24 17:47:59 -04:00
jessop	9dc4559aba	new comment and reactions api	2020-09-23 16:43:28 -04:00
Lex Berezhny	eba8856261	v0.81.0	2020-08-19 15:47:53 -04:00
Jack Robison	dec79f3742	pylint	2020-08-19 15:24:17 -04:00
Jack Robison	8bdcac0f3e	close reader before deleting blob	2020-08-19 15:24:17 -04:00
Jack Robison	8426b674a3	improve reflector upload cancellation handling	2020-08-19 15:24:17 -04:00
Lex Berezhny	2d7443d454	slight cleanup	2020-08-19 13:59:26 -04:00
Lex Berezhny	991987ed76	docopt fix	2020-08-19 12:08:41 -04:00
Lex Berezhny	ec24ebf2cf	added --limit_claims_per_channel argument to claim_search to only return up to the specified number of claims per channel	2020-08-19 10:51:31 -04:00
Baltazar Gomez	2b88d01a01	Add webvtt mime type ( subtitles, captions )	2020-08-12 02:25:01 -05:00
Lex Berezhny	0c09f24cbf	v0.80.0	2020-08-04 16:53:52 -04:00
Lex Berezhny	9f1ed6e8c3	release_all_outputs on startup	2020-08-04 15:03:58 -04:00
Lex Berezhny	91194bf422	doc fix	2020-08-04 14:12:40 -04:00
Lex Berezhny	9c5f940b00	claim search forwarding to new sdk	2020-08-04 12:11:02 -04:00
Lex Berezhny	455b4043b8	new resolve	2020-08-04 11:33:39 -04:00
jessop	f6bdf7c09a	allow faster comment retrieval ... switch default for include replies to false	2020-07-31 10:07:12 -04:00
Lex Berezhny	2db8afb8c2	v0.79.1	2020-07-21 21:59:15 -04:00
Lex Berezhny	8996aafe0d	always cast modified_on to int()	2020-07-21 19:14:57 -04:00
Lex Berezhny	9dc25ef7af	v0.79.0	2020-07-20 20:23:51 -04:00
Lex Berezhny	097c8b674c	fix modified_on when modifying account	2020-07-20 14:28:19 -04:00
Lex Berezhny	ba649d4b94	convert modified_on timestamp to int to avoid floating point conflicts when syncing	2020-07-20 14:24:53 -04:00
Jack Robison	df5b6a8380	feedback	2020-07-20 12:20:00 -04:00
Jack Robison	1f82a8b99e	catch reflector error if a blob is deleted while it's being sent	2020-07-16 12:15:51 -04:00
Jack Robison	0c95d96f32	update pyyaml requirement to 5.3.1	2020-07-16 12:15:51 -04:00
Jack Robison	c2f5f84118	fix uncaught errors from broken reflector connections	2020-07-16 12:15:47 -04:00
Jack Robison	b3b5e3d8f0	test reflector connection breaking mid-transfer	2020-07-15 16:42:55 -04:00
Lex Berezhny	506d3f3cd9	v0.78.0	2020-07-14 23:33:34 -04:00
Lex Berezhny	2f81e9d374	pylint	2020-07-14 23:13:14 -04:00
Jack Robison	2d8703bb8d	pylint	2020-07-14 23:13:14 -04:00
Jack Robison	76e60d9bc3	logging	2020-07-14 23:13:14 -04:00
Jack Robison	9d5370be5f	fix	2020-07-14 23:13:14 -04:00
Jack Robison	fc1a06bc45	fix	2020-07-14 23:13:14 -04:00
Jack Robison	fce80374f4	batched sync	2020-07-14 23:13:14 -04:00
Jack Robison	420c9f10c2	remove _update_cache_item	2020-07-14 23:13:14 -04:00
Jack Robison	5a39681a2e	log	2020-07-14 23:13:14 -04:00
Jack Robison	7a1b7db7c8	support multiple blocks with blockchain.transaction.get_batch	2020-07-14 23:13:14 -04:00
Jack Robison	03a643da52	use block cache	2020-07-14 23:13:14 -04:00
Lex Berezhny	c6c668676c	changed video_bitrate_maximum from 8.4MB to 5MB	2020-07-14 21:54:42 -04:00
Trent N	7b01dde063	convert sample_rate to integer and dont force a volume_filter ... added volume_filter example deleted _get_volume_filter	2020-07-14 21:49:25 -04:00
Trent	8c25f65024	check sample rate and lower if too high	2020-07-14 21:49:25 -04:00
Lex Berezhny	1e478e3545	Merge pull request #2996 from DispatchCommit/patch-1 ... updates HLS .m3u8 media type and adds new DASH .mpd media type	2020-07-14 19:47:22 -04:00
Dispatch	33c7c3ee12	Fixes HLS .m3u8 and DASH .mpd extension ... HLS uses a playlist .m3u8 file to provide video content Transport Segments (.ts) files. DASH uses a playlist .mpd file to provide video content of a few different containers.	2020-07-10 05:39:46 -07:00
Victor Shyba	f9b41d34ae	expose reflector task errors, add debug statements for ongoing issue	2020-07-07 00:39:59 -03:00
Jack Robison	ac1a8b4daf	metric for time to send notifications	2020-07-02 18:57:36 -04:00
Jack Robison	28838c1759	notifications_in_flight_metric	2020-07-02 18:57:36 -04:00
Jack Robison	50ecb0dac9	fix notify	2020-07-02 18:57:36 -04:00
Jack Robison	e22bc01cbd	re-add wakeup event, add address history metric	2020-07-02 18:57:36 -04:00
Jack Robison	6c28713a4c	read history in one loop	2020-07-02 18:57:36 -04:00
Jack Robison	fc9023386c	non-blocking history lookup in notify	2020-07-02 18:57:36 -04:00
Jack Robison	e6cae9bcc3	remove mempool wakeup event, lower refresh delay	2020-07-02 18:57:36 -04:00
Jack Robison	a9eeca1302	mempool processing time metric	2020-07-02 18:57:36 -04:00
Jack Robison	8c695e42ca	fix sqlite coin chooser floor	2020-07-02 18:57:36 -04:00
Jack Robison	0aa7fd47d5	combine loops	2020-07-02 18:57:36 -04:00
Jack Robison	70596042d6	mempool_process_time_metric	2020-07-02 18:57:36 -04:00
Jack Robison	caf616234b	flush databases during sync	2020-07-02 18:57:36 -04:00
Jack Robison	375187aa70	tx hashes db	2020-07-02 18:57:36 -04:00
Jack Robison	71eccdc0e3	hashes path	2020-07-02 18:57:36 -04:00
Jack Robison	639b1e48f5	blocks dir	2020-07-02 18:57:36 -04:00
Jack Robison	0bb4cb4472	tx count db	2020-07-02 18:57:36 -04:00
Jack Robison	cc51543851	headers db	2020-07-02 18:57:36 -04:00
Jack Robison	98565eb67c	run read_raw_block in executor	2020-07-02 18:57:36 -04:00
Jack Robison	fa60b9f9d3	logging	2020-07-02 17:35:38 -04:00
Jack Robison	644120ca31	add --blocking to account_send	2020-07-02 17:32:32 -04:00
Jack Robison	a50a625b3b	add --blocking arg to wallet_send	2020-07-02 17:32:32 -04:00
Lex Berezhny	7297c13331	v0.77.0	2020-06-24 11:32:41 -04:00
Jack Robison	a056cd78f7	remove loggly	2020-06-24 11:13:29 -04:00
Lex Berezhny	a30f3c86c2	v0.76.0	2020-06-08 23:11:41 -04:00
Jack Robison	872b89ee93	fix mempool conflicts following cancelled api calls that send transactions with the blocking flag	2020-06-05 20:06:42 -04:00
Jack Robison	ae53062518	integration test for sqlite coin chooser	2020-06-05 20:06:42 -04:00
Jack Robison	17f76c9cb3	leave inputs for rejected tx reserved	2020-06-05 20:06:42 -04:00
Jack Robison	5de944146a	logging	2020-06-05 20:06:42 -04:00
Jack Robison	a32a2ef04e	add sqlite coin chooser	2020-06-05 20:06:42 -04:00
Lex Berezhny	1f94c53dd2	added support protobuf	2020-06-05 15:50:00 -04:00
Lex Berezhny	9c426373f2	lint	2020-06-05 15:49:18 -04:00
Lex Berezhny	c03e30a01f	added support for signed supports	2020-06-05 15:49:18 -04:00
Lex Berezhny	07f7a77ac0	Merge pull request #2971 from lbryio/faster-publish ... Speed up publish response time by not blocking on updating the content claim db	2020-06-05 15:47:40 -04:00
Jack Robison	1beb13dd80	fix attribute error	2020-06-04 09:31:37 -04:00
Jack Robison	ddae84abb3	fix pending_count	2020-06-04 09:31:37 -04:00
Jack Robison	863b9a2c98	don't block returning from publish on updating the content claim table	2020-06-04 09:31:37 -04:00
Jack Robison	9d44bbdb48	don't block the notification loop on sending the notifications	2020-06-04 09:25:41 -04:00
Jack Robison	8d93dd5adc	improve wallet server address history cache	2020-06-04 09:15:21 -04:00
Lex Berezhny	48502961cf	v0.75.0	2020-06-03 14:44:02 -04:00
Lex Berezhny	7296c7df1a	Origin: null no longer allowed	2020-06-03 14:19:16 -04:00
Lex Berezhny	f3ee6603de	improve allowed_origin request handling	2020-06-03 13:55:20 -04:00
Lex Berezhny	ee0aabda1d	backwards compatible allowed_origin, default browsers not allowed	2020-06-03 13:28:32 -04:00
Jack Robison	08d37a4b0f	add allowed_origin to config ... -raise 403 error if a request doesn't have a matching origin	2020-06-03 12:55:24 -04:00
Jack Robison	f030d41dc7	add test_is_valid_ipv4	2020-06-02 15:56:57 -04:00
Jack Robison	8d079bfcd1	Merge branch 'master' into master	2020-06-02 15:52:04 -04:00
Thomas Zarebczan	ce7816a968	more aggressive video transdoing ... Have noticed the defaults aren't aggressive enough to stream smoothly (yet). Downgrade max rate to 5500K, higher crf = smaller file size for now.	2020-06-01 13:11:56 -04:00
Jack Robison	4bbd850898	fix uncaught ValueError in hashX_unsubscribe	2020-05-25 10:25:04 -04:00
Jack Robison	34eae6e608	fix wallet server prometheus bucket sizes	2020-05-25 10:24:31 -04:00
Jack Robison	6a0302fec6	fix uncaught dht DecodeError	2020-05-25 10:23:11 -04:00
Jack Robison	cae7792a1e	add transaction_cache_size to config	2020-05-25 10:16:18 -04:00
Lex Berezhny	7f6b2fe4f1	v0.74.0	2020-05-18 16:56:58 -04:00