3897 commits

Author	SHA1	Message	Date
Lex Berezhny	2c4fde06c5	--new-signing-key -> --new_signing_key	2019-03-29 21:14:20 -04:00
Lex Berezhny	eca83d7f47	--clear-tags -> --clear_tags	2019-03-29 21:14:20 -04:00
Lex Berezhny	87e818ac39	v0.35.0rc2	2019-03-27 22:20:09 -04:00
Lex Berezhny	5f8482bdb7	hash -> sd_hash, encoding fixes, update to new protobufs	2019-03-27 21:57:22 -04:00
Lex Berezhny	cd266477fb	stop regenerating v1 protobufs	2019-03-27 21:57:22 -04:00
Lex Berezhny	7860b956ff	fixes and tests for publish command	2019-03-27 21:57:22 -04:00
Thomas Zarebczan	148481a5ca	doh	2019-03-27 21:54:19 -04:00
Thomas Zarebczan	93faa276a5	update BIP32	2019-03-27 21:54:19 -04:00
Victor Shyba	53e67a6e81	fixes from rebase	2019-03-27 10:31:37 -04:00
Victor Shyba	3ad6808d87	remove unused claim_id_hash	2019-03-27 10:31:37 -04:00
Victor Shyba	071ab32ab7	fix hash references	2019-03-27 10:31:37 -04:00
Victor Shyba	ab87588250	use torba parsing for addresses too, erase old code	2019-03-27 10:31:37 -04:00
Victor Shyba	22db29ee1d	use torba tx parsing on wallet server	2019-03-27 10:31:37 -04:00
Lex Berezhny	66bf6c61f0	v0.35.0rc1	2019-03-25 23:57:59 -04:00
Lex Berezhny	9abf40d21f	stream_type fix	2019-03-25 23:45:10 -04:00
Lex Berezhny	51bb8fd283	pylint	2019-03-25 22:54:08 -04:00
Lex Berezhny	183e3ac1c7	claim search	2019-03-25 22:54:08 -04:00
Lex Berezhny	8087b457c6	reorganized commands and finished support_abandon with --keep	2019-03-25 22:54:08 -04:00
Lex Berezhny	fedb7c23d0	bring back blocks_behind in wallet status	2019-03-25 22:54:08 -04:00
Lex Berezhny	c708c1db07	audio/video/image stream types	2019-03-25 22:54:08 -04:00
Lex Berezhny	2007c48af3	fixed tests for setting claim values	2019-03-25 22:54:08 -04:00
Lex Berezhny	0592cee567	claim integration test fixes	2019-03-25 22:54:08 -04:00
Lex Berezhny	814eaca524	cli tests fixed	2019-03-25 22:54:08 -04:00
Lex Berezhny	25436893bc	pylint and a few other fixes	2019-03-25 22:54:08 -04:00
Lex Berezhny	5b9d41fd5c	regeneate script after modifying protobufs	2019-03-25 22:54:08 -04:00
Victor Shyba	b1720d1659	fix setting sd hash	2019-03-25 22:54:08 -04:00
Lex Berezhny	4b3a6ab875	big support tests passes	2019-03-25 22:54:08 -04:00
Lex Berezhny	67dcede2d8	lots of stuff deleted	2019-03-25 22:54:08 -04:00
Lex Berezhny	af73e1a2f5	chris45 passing again	2019-03-25 22:54:08 -04:00
Lex Berezhny	c1fbb02bfe	dont validate inputs in json_response_encoder	2019-03-25 22:54:08 -04:00
Lex Berezhny	d47575e8e0	progress	2019-03-25 22:54:08 -04:00
Victor Shyba	fe9aa666e9	fix name is not part of old sigs	2019-03-25 22:54:08 -04:00
Victor Shyba	a9e0eeba7e	add tests and fix verification of old signatures	2019-03-25 22:54:08 -04:00
Victor Shyba	f2236eb7a4	resolve: check if there is a cert before fetching a tx	2019-03-25 22:54:08 -04:00
Lex Berezhny	df649341cd	json output formatting fix for Claim	2019-03-25 22:54:08 -04:00
Lex Berezhny	ea09aca175	pylint fixes and ClaimDict->Claim	2019-03-25 22:54:08 -04:00
Lex Berezhny	ca92fddecf	pylint	2019-03-25 22:54:08 -04:00
Lex Berezhny	8259d7c680	txo.claim_hash and other fixes related to proto3 refactor	2019-03-25 22:54:08 -04:00
Victor Shyba	6653da2973	all	2019-03-25 22:54:08 -04:00
Lex Berezhny	e74998209d	for victor	2019-03-25 22:54:08 -04:00
Lex Berezhny	2bea0f697a	pylint	2019-03-25 22:54:08 -04:00
Lex Berezhny	1d68bef6f2	client side pretty much done	2019-03-25 22:54:08 -04:00
Lex Berezhny	cd2b535afb	moved claim signing to TXO	2019-03-25 22:54:08 -04:00
Lex Berezhny	9dfe7bbcf6	imports updated after moving lbrynet.extras.wallet to lbrynet.wallet	2019-03-25 22:54:08 -04:00
Lex Berezhny	120618ffd5	updated imports due to lbrynet.extras.wallet -> lbrynet.wallet move	2019-03-25 22:54:08 -04:00
Lex Berezhny	e8abcbb06e	moved lbrynet.extras.wallet -> lbrynet.wallet	2019-03-25 22:54:08 -04:00
Lex Berezhny	1ec8f0b0b4	wip	2019-03-25 22:54:08 -04:00
Lex Berezhny	323694fb12	removed address.py	2019-03-25 22:54:08 -04:00
Lex Berezhny	d5e37acd8f	minor Fee changes	2019-03-25 22:54:08 -04:00
Lex Berezhny	129a886f2b	+ fee.amount	2019-03-25 22:54:08 -04:00
Lex Berezhny	cd15230a92	getting close to a nice model	2019-03-25 22:54:08 -04:00
Lex Berezhny	c1b7fdc68e	deleted bunch of stuff	2019-03-25 22:54:08 -04:00
Lex Berezhny	9fd67aaad6	removed legacy_schema_v1	2019-03-25 22:54:08 -04:00
Lex Berezhny	ce9dc1836e	moved schema/current_schema/claim.py into schema/claim.py	2019-03-25 22:54:08 -04:00
Lex Berezhny	2e557d3a36	converted everyting in schema/legacy/* into schema/jsonschema.py	2019-03-25 22:54:08 -04:00
Lex Berezhny	5df05cb37e	make schema.types a module	2019-03-25 22:54:08 -04:00
Lex Berezhny	326b62dc57	moved proto2/proto3 to types/v1 and types/v2 respectively	2019-03-25 22:54:08 -04:00
Lex Berezhny	25cc7ba284	updated schema to latest types: Claim uses oneof type for Channel/Stream	2019-03-25 22:54:08 -04:00
Victor Shyba	550f064302	baseschema	2019-03-25 22:54:08 -04:00
Victor Shyba	11086b93f1	migrate other fields	2019-03-25 22:54:08 -04:00
Victor Shyba	df5662136d	migrate cert + adapt to latest types repo	2019-03-25 22:54:08 -04:00
Victor Shyba	291d65070d	move common schema values to constants.py	2019-03-25 22:54:08 -04:00
Victor Shyba	9b64ee33dc	fix imports: schema.schema -> schema.legacy_schema_v1	2019-03-25 22:54:08 -04:00
Victor Shyba	5404d26f2f	schema.schema -> schema.legacy_schema_v1	2019-03-25 22:54:08 -04:00
Victor Shyba	26ade1f228	bump merged proto3	2019-03-25 22:54:08 -04:00
Victor Shyba	b49f1f1b54	fix imports	2019-03-25 22:54:08 -04:00
Victor Shyba	3bafa2ad22	regenerate protos	2019-03-25 22:54:08 -04:00
Victor Shyba	378ec44f3c	update make to generate proto2 and proto3	2019-03-25 22:54:08 -04:00
Victor Shyba	9d0d17b422	rename proto proto2	2019-03-25 22:54:08 -04:00
Lex Berezhny	0de17730ca	v0.34.0	2019-03-15 16:21:29 -04:00
Jack Robison	664f91bfab	add lbrynet.dht.protocol.distance unit tests	2019-03-15 12:44:41 -04:00
Jack Robison	6565ca8558	improve lbrynet.dht.serialization unit tests	2019-03-14 18:45:56 -04:00
Jack Robison	3b0ba3e534	v0.34.0rc2	2019-03-14 16:03:39 -04:00
Jack Robison	c9b2829227	fix/test fixed_peer_delay and added_fixed_peers	2019-03-14 15:08:26 -04:00
Jack Robison	4f2f8b16f3	fix pending downloads not being removed	2019-03-14 13:52:00 -04:00
Jack Robison	2ab2b846b1	fix default download timeout not being set	2019-03-14 13:07:11 -04:00
Jack Robison	ab5d71ff61	fix the time to the head blob including the time to the sd blob in analytics	2019-03-13 16:24:23 -04:00
Lex Berezhny	99b289f135	v0.34.0rc1	2019-03-12 20:29:10 -04:00
Lex Berezhny	98d8b7d463	sync uses new apply APIs in torba	2019-03-12 20:22:41 -04:00
Lex Berezhny	96f1883fc4	check modified_on	2019-03-12 20:22:41 -04:00
Lex Berezhny	a914de155a	working sync	2019-03-12 20:22:41 -04:00
Lex Berezhny	2dee0ff0bf	wip account manifest command	2019-03-12 20:22:41 -04:00
Jack Robison	993cb43e5b	fix tests ... -fix cleanup of a failed download	2019-03-12 20:22:01 -04:00
Jack Robison	5d212a0f82	time to first bytes analytics	2019-03-12 20:22:01 -04:00
Victor Shyba	f390ff144d	handle sigint	2019-03-12 13:43:12 -04:00
Jack Robison	4cbde1b08f	use _batched_select to populate channel names when initializing files	2019-03-12 09:58:19 -04:00
Lex Berezhny	c6740d8d70	v0.33.0	2019-03-08 20:00:45 -05:00
Lex Berezhny	46358142ed	v0.33.0rc1	2019-03-06 22:18:04 -05:00
Brannon King	c326a9382c	changed to pull down the newer lbrycrd	2019-03-05 09:32:43 -05:00
Brannon King	5bdd87c904	removed name-to-claim lookup table ... added unit test for Greek and made it work pylint: revert bad move revert claim_sequence changes fixed broken test	2019-03-05 09:32:43 -05:00
Jack Robison	ad134fe8bb	v0.32.4	2019-03-01 17:24:55 -05:00
Jack Robison	2f3c616acd	v0.32.4rc1	2019-03-01 16:33:59 -05:00
Jack Robison	e38a0f7a95	logging	2019-03-01 15:26:45 -05:00
Jack Robison	9de3f3ff09	don't block on sending download analytics events	2019-03-01 15:22:19 -05:00
Jack Robison	df8934d472	restore old download analytics and update tests	2019-03-01 14:50:06 -05:00
Jack Robison	d97d978961	use certifi for all operating systems	2019-02-28 12:45:56 -05:00
Jack Robison	f52e44b56a	typing	2019-02-28 12:42:23 -05:00
Jack Robison	10d73fe480	use certifi	2019-02-28 12:40:11 -05:00
Jack Robison	d95903d219	update aiohttp and pylint	2019-02-28 12:04:07 -05:00
Victor Shyba	e047748961	log dropped api request instead of stack trace	2019-02-26 17:42:45 -05:00
Victor Shyba	9f071bbe36	pylint	2019-02-26 17:42:45 -05:00
Victor Shyba	2d8ebe25ed	refactor so we can stop trapping CancelledError everywhere	2019-02-26 17:42:45 -05:00
Victor Shyba	7a96e742f2	stop trapping CancelledError	2019-02-26 17:42:45 -05:00
Victor Shyba	e8c9abb944	add LRU to KademliaPeer creation	2019-02-26 09:42:32 -05:00
Thomas Zarebczan	2a82ff7cc5	Update mime_types.py	2019-02-22 11:11:10 -05:00
Jack Robison	673b958020	v0.32.3	2019-02-21 19:38:14 -05:00
Victor Shyba	b834f29634	nullify length on blob delete	2019-02-21 21:00:28 -03:00
Victor Shyba	fcdd9295b4	delete upon failing to decode JSON from sd blob	2019-02-21 20:53:21 -03:00
Victor Shyba	4e7d88311f	raise proper exception on undecode-able blobs	2019-02-21 20:42:51 -03:00
Jack Robison	690e2e7e0c	v0.32.3rc1	2019-02-21 18:37:19 -05:00
Jack Robison	fc64d8d1a8	fix slow ping queue shutdown	2019-02-21 17:44:02 -05:00
Jack Robison	7fe9513857	v0.32.2	2019-02-21 14:46:36 -05:00
Jack Robison	e76107c318	v0.32.2rc3	2019-02-21 14:28:13 -05:00
Jack Robison	3868dea819	don't join buckets if there is only one	2019-02-21 14:18:48 -05:00
Jack Robison	03cd6b7200	fix cases where buckets could be unjoined after removing a peer	2019-02-21 13:53:35 -05:00
Jack Robison	6915a7a553	v0.32.2rc2	2019-02-21 13:16:32 -05:00
Jack Robison	4294bf742d	simplify/fix ping queue	2019-02-21 13:00:23 -05:00
Jack Robison	e260de59f1	fix updating/setting contact triple	2019-02-21 10:50:11 -05:00
Jack Robison	154702e6dd	fix KBucket.add_peer	2019-02-21 10:50:11 -05:00
Victor Shyba	59325ad8c1	fix delete log	2019-02-20 17:04:08 -03:00
Jack Robison	ee12985135	dont ping outselves	2019-02-20 14:15:31 -05:00
Jack Robison	4c7f357441	v0.32.2rc1	2019-02-20 12:12:04 -05:00
Jack Robison	cb5d428d12	add split_buckets_under_index config setting for seed nodes	2019-02-20 11:25:50 -05:00
Victor Shyba	38ed212c01	refactor, dont call storage from blob_manager + missing await	2019-02-19 21:45:14 -03:00
Victor Shyba	d035c13883	file_path can be None, add helper to check if stream output file exists instead	2019-02-19 21:45:14 -03:00
Jack Robison	82ce2ccee6	update docs	2019-02-19 17:27:31 -05:00
Jack Robison	fcbdaa336f	fix KBucket.key_in_range ... The range_min and range_max of a KBucket where mistakenly bounding the node id of a peer to be added rather than the distance from the local node id to the peer node id	2019-02-19 13:57:11 -05:00
Lex Berezhny	3ae6137edb	v0.32.1	2019-02-18 22:56:35 -05:00
Lex Berezhny	0fdd2ae178	added tx to JSON response from get	2019-02-18 22:53:11 -05:00
Victor Shyba	d2150cf142	fix balance check	2019-02-18 22:53:11 -05:00
Lex Berezhny	c2dc1f3c1d	v0.32.1rc1	2019-02-18 17:17:20 -05:00
Victor Shyba	b36c22e2f4	unban after 10 seconds, give up after 60	2019-02-18 17:16:10 -05:00
Lex Berezhny	461c3c8408	downloading header from S3 correctly tracks progress	2019-02-18 17:15:40 -05:00
Jack Robison	3f7e466c97	return failure message for invalid blob hash in blob_delete	2019-02-18 12:18:56 -05:00
Jack Robison	4483380352	fix terminator blob hash (None) being included when running blob_list for an sd hash	2019-02-18 12:12:14 -05:00
Lex Berezhny	4a0a6b0243	v0.32.0	2019-02-16 20:17:41 -05:00
Thomas Zarebczan	a003e794ba	listen on internal port instead of upnp redirect	2019-02-16 18:55:58 -05:00
Lex Berezhny	051fabc180	v0.32.0rc3	2019-02-16 15:07:07 -05:00
Jack Robison	fc450eb164	add TestMimeTypes, pylint	2019-02-15 20:42:55 -05:00
Thomas Zarebczan	652d7cbd24	consider . extension	2019-02-15 20:40:55 -05:00
Thomas Zarebczan	43b372c0fe	fix extension - remove dot ... The rest of our extensions don't have a dot. Also, strip off any characters and lowercase it to be safe.	2019-02-15 20:40:55 -05:00
Victor Shyba	576da1bc30	do not keep trying when blob is being written	2019-02-15 21:20:06 -03:00
Victor Shyba	5c217f1544	resovle reflector IP before adding it	2019-02-15 21:20:06 -03:00
Jack Robison	fd081496c0	fix blocking on data being written for resumed streams	2019-02-15 17:35:46 -05:00
Jack Robison	32b4405a4c	logging ... fix https://github.com/lbryio/lbry/issues/1881	2019-02-15 17:26:28 -05:00
Jack Robison	0d558bd552	fix default file list sorting	2019-02-15 17:26:24 -05:00
Jack Robison	ca835f3f80	fix 1883	2019-02-15 16:26:13 -05:00
Jack Robison	dbb6ba6241	recover streams with missing sd blobs, handle previous sd blob bugs ... -test download and recover stream with old key sorting	2019-02-15 15:21:29 -05:00
Jack Robison	a228d20137	move store_stream and store_file to standalone functions	2019-02-15 15:21:07 -05:00
Jack Robison	f1b60e3ef2	fix get_blobs_for_stream	2019-02-15 15:21:07 -05:00
Jack Robison	39737c790f	sync blob files in database with those in directory on startup	2019-02-15 15:21:07 -05:00
Victor Shyba	918122e7cf	supress invalid token error to debug	2019-02-15 16:31:47 -03:00
Victor Shyba	a49f479a5f	move wait to where its needed on assembler	2019-02-15 10:26:05 -05:00
Jack Robison	9d89f9b834	use executemany instead of batched_operation	2019-02-14 15:57:24 -05:00
Jack Robison	56c41b2fea	fix integration test ... -cancel running reflector uploads from publishes upon shutdown -refactor blob.delete to be non-async -delete blobs synchronously	2019-02-14 15:43:26 -05:00
Jack Robison	9c8593d88e	fix file_delete being slow	2019-02-14 12:33:48 -05:00
Jack Robison	85f41887fd	don't create BlobFile object when deleting if it doesn't already exist	2019-02-14 12:28:42 -05:00
Lex Berezhny	d2ba3fdcfb	v0.32.0rc2	2019-02-14 00:18:21 -05:00
Victor Shyba	04f70d1f31	stop when data timeout	2019-02-14 00:10:44 -05:00
Victor Shyba	dbc8cfe5ae	delete incomplete files on assembler stop	2019-02-14 00:10:44 -05:00
Victor Shyba	b6df2b9d28	missing None for optional field + pylint	2019-02-13 23:33:49 -05:00
Victor Shyba	5c1ab42277	resume should put the stream into wait as done usually on get calls	2019-02-13 23:33:49 -05:00
Victor Shyba	bbdc96e762	file_name as a property of managed stream, to reflect internal changes	2019-02-13 23:33:49 -05:00
Victor Shyba	fc0c949187	properly update file name on downloader/assembler	2019-02-13 23:33:49 -05:00
Victor Shyba	37bb765a2e	resume downloads if DHT disabled	2019-02-13 23:33:49 -05:00
hackrush	21ca4f60f7	Stop the daemon on calling lbrynet stop	2019-02-13 14:22:23 -05:00
Victor Shyba	0a068011d8	fix chunked response parsing	2019-02-13 13:10:27 -05:00
Lex Berezhny	76ecb5d50d	renamed resolve argument url to urls	2019-02-13 11:55:12 -05:00
Lex Berezhny	dbc1164562	v0.32.0rc1	2019-02-12 21:35:41 -05:00
Victor Shyba	e2170ec83d	fix download timeout types	2019-02-12 20:58:31 -05:00
Lex Berezhny	68905d82b9	pass conf instead of data_dir to migrate_db, fixes #1898	2019-02-12 18:10:34 -05:00
Lex Berezhny	5e509c9fd6	testing get	2019-02-12 11:54:00 -05:00
Lex Berezhny	8aa50aa14f	cleaned up resolve command	2019-02-12 11:54:00 -05:00
Jack Robison	6732b302bb	logging	2019-02-11 15:31:31 -05:00
Jack Robison	c9d54bb049	fix max_key_fee	2019-02-11 15:26:13 -05:00
Alex Grintsvayg	f65e70df2f	better resolve description	2019-02-11 12:34:57 -05:00
Jack Robison	6386815a29	fix reflect_streams not being followed	2019-02-08 20:13:26 -05:00
Jack Robison	0c93090d2c	faster is_valid_hashcharacter	2019-02-08 19:57:26 -05:00
Jack Robison	45404b6ad4	faster is_valid_blobhash	2019-02-08 19:54:59 -05:00
Jack Robison	aeb2891baa	faster population of channel names	2019-02-08 19:51:13 -05:00
Jack Robison	8abfdc82b2	faster blob manager startup	2019-02-08 17:37:35 -05:00
Jack Robison	da9b4e317a	limit blobs to announce	2019-02-08 16:29:55 -05:00
Jack Robison	e414cc5c48	whitespace	2019-02-08 16:11:56 -05:00
Jack Robison	939edb2f18	logging ... -call loop.set_debug when using --verbose	2019-02-08 16:06:38 -05:00
Jack Robison	868110a6f2	populate stream manager with a single batch query	2019-02-08 16:06:35 -05:00
Victor Shyba	9ecec52412	check lock acquired to prevent races	2019-02-08 04:39:28 -03:00
Victor Shyba	8b25acff6e	do not wait blob to be written, log errors from races	2019-02-08 04:32:53 -03:00
Victor Shyba	e2b06677b5	defer db insert during downloads	2019-02-08 03:45:23 -03:00
Victor Shyba	af1619ebfb	disable race limiting for now	2019-02-08 03:32:38 -03:00
Victor Shyba	3352e0e4f4	score peers by speed	2019-02-08 03:08:08 -03:00
Victor Shyba	141d68a2cd	fix write race condition	2019-02-08 02:39:29 -03:00
Victor Shyba	c06ec6cd69	manage connections, reusing them when possible	2019-02-08 02:27:58 -03:00
Victor Shyba	1be5dce30e	stop racing during long streams	2019-02-08 01:28:03 -03:00
Victor Shyba	73da223ae1	conf: give up first contact earlier, but let the transfer go longer	2019-02-08 01:05:58 -03:00
Victor Shyba	2d7eb83518	change score calculation, wait for active peers too, simplify peer sorting/keeping	2019-02-08 01:04:38 -03:00
Victor Shyba	ad03f91d24	let cancelled errors flow	2019-02-08 01:03:13 -03:00
Victor Shyba	5586a226c2	bypass parser during download	2019-02-07 21:19:31 -03:00
Victor Shyba	a616582733	wait on connection tasks	2019-02-07 20:11:57 -03:00
Victor Shyba	43ac928f0b	remove dht locks	2019-02-07 20:11:57 -03:00
Lex Berezhny	a121110743	v0.31.0	2019-02-06 14:28:40 -05:00
Victor Shyba	3a15ff4bcd	test incomplete streams, respect real length, delete on incomplete assembly	2019-02-06 15:56:06 -03:00
Jack Robison	dfdc8eda00	improve test, fix stream_finished_event	2019-02-06 13:32:50 -05:00
Jack Robison	58f6cb71c6	test stream manager	2019-02-06 13:08:57 -05:00
Jack Robison	ae11c5bb4b	fix setting finished event	2019-02-06 12:18:24 -05:00
Jack Robison	f22b5da170	fix raised error for a peer address mismatch	2019-02-06 12:11:22 -05:00
Jack Robison	c1c6d5bc99	fix deleting partial downloads when stopped and previous streams when updating a publish	2019-02-06 11:43:05 -05:00
Jack Robison	0e972ec2ae	refactor BlobFile.close to be non async	2019-02-06 11:00:57 -05:00
Victor Shyba	8b5803c945	format error dict on get	2019-02-06 11:55:12 -03:00
Jack Robison	76c8447a56	add stream descriptor tests	2019-02-05 21:25:31 -05:00
Jack Robison	7c8ad0fe30	fix deleting incomplete downloads upon stop ... fix deleting previous streams (not assembled/published files) for a claim being updated	2019-02-05 15:33:08 -05:00
Jack Robison	073ffdd049	proto and type args	2019-02-05 13:36:25 -05:00
Jack Robison	7fe211d134	fix resolve_host	2019-02-05 13:31:57 -05:00
Victor Shyba	a4ced4dbd2	set verified after callback	2019-02-05 13:17:00 -03:00
Victor Shyba	c6b910a5f3	use time_getter on storage	2019-02-05 13:14:59 -03:00
Victor Shyba	63d1ec3c28	fixes from jack comments	2019-02-05 13:01:12 -03:00
Victor Shyba	7b8f42e6d0	remove dead set_should_announce code	2019-02-05 13:01:12 -03:00
Victor Shyba	2c275efa48	remove redundant calls to should announce	2019-02-05 13:01:12 -03:00
Victor Shyba	6ead932ccb	announces naturally, removes redundant calls	2019-02-05 13:01:12 -03:00
Victor Shyba	f766dbefe0	announce and set completed after inserts	2019-02-05 13:01:12 -03:00
Jack Robison	0685bc5689	include torba in log file	2019-02-04 18:25:47 -05:00
Jack Robison	8cda3143f2	fix setting should_announce and blob status	2019-02-04 18:22:44 -05:00
Jack Robison	5af351a234	reflector logging	2019-02-04 17:33:25 -05:00
Victor Shyba	b82d2c3120	handle and log if downloading from bad sendfile implementations	2019-02-04 19:13:31 -03:00
Jack Robison	2bce7cecfa	fix sendfile on windows	2019-02-04 16:48:48 -05:00
Jack Robison	8883587cc7	logging	2019-02-04 16:19:27 -05:00
Jack Robison	c85991704d	catch invalid data error	2019-02-04 16:19:27 -05:00
Jack Robison	377442d9f0	fix request_blob cancellation	2019-02-04 16:19:24 -05:00
Jack Robison	f0b49fc153	always return close peers from findValue	2019-02-04 15:07:42 -05:00
Jack Robison	ae1162f5b0	don't try downloading from oneself ... -don't return the querying peer in results for findValue	2019-02-04 14:50:53 -05:00
Victor Shyba	ad71a9a89d	refactor reflect to close protocol	2019-02-04 13:34:18 -03:00
Jack Robison	13b3e4ba8e	v0.31.0rc5	2019-02-04 10:22:43 -05:00
Victor Shyba	736a949cb5	resume streams on startup	2019-02-03 20:49:09 -03:00
Victor Shyba	11bb1cc7ee	use with clause to avoid leaking fds	2019-02-03 20:41:47 -03:00
Jack Robison	dcd78bd86e	always delete file from downloads if download was not complete	2019-02-03 16:43:40 -05:00
Jack Robison	e5af041627	fix connection status message	2019-02-03 16:20:52 -05:00
Jack Robison	0a027cf2de	logging	2019-02-03 15:47:19 -05:00
Jack Robison	3f98b16800	fix blob announce time, use time.time instead of loop.time	2019-02-03 15:47:15 -05:00
Jack Robison	8f5a8ab8ba	fix peer_ping	2019-02-02 02:02:19 -05:00
Jack Robison	91e581422c	v0.31.0rc4	2019-02-02 00:30:57 -05:00
Jack Robison	f2968aab22	add re-reflect task to stream manager, add concurrent_reflector_uploads to config	2019-02-01 22:59:41 -05:00
Jack Robison	ccbe8aa0eb	create data. download, and wallet directories if they don't exist on startup	2019-02-01 22:45:28 -05:00
Jack Robison	478f79353a	fix bytes error	2019-02-01 22:20:11 -05:00
Jack Robison	c3b0151943	fix dht status error during startup	2019-02-01 22:12:07 -05:00
Jack Robison	e96b75a0d0	fix file/download paths ... move download-from-uri logic into stream manager	2019-02-01 21:40:35 -05:00
Jack Robison	efe4afd09e	fix blob announce time	2019-02-01 21:28:59 -05:00
Jack Robison	c7cb6822cc	logging	2019-02-01 21:28:59 -05:00
Jack Robison	c75665d3f0	update file_list docs, add blobs_remaining to file list args and to file dict result	2019-02-01 21:28:59 -05:00
Jack Robison	744375b2c0	re-assemble file / resume downloads	2019-02-01 21:28:59 -05:00
Victor Shyba	40da5b6cb6	rework data parser	2019-02-01 20:09:14 -03:00
Victor Shyba	b36cf3e36c	remove closing peers from active connections	2019-02-01 20:09:14 -03:00
Jack Robison	0a08f445a4	close blob server transport on sendfile failing	2019-02-01 15:11:37 -05:00
Victor Shyba	f5bf1463af	fixes from review	2019-02-01 17:09:37 -03:00
Victor Shyba	ca4a55ef28	set verified event earlier and remove stop awaits	2019-02-01 16:05:14 -03:00
Victor Shyba	832be0758b	let cancel propagate	2019-02-01 16:05:14 -03:00
Victor Shyba	25050fdeeb	fixes for writers (check inside lock and dont hold verified bytes)	2019-02-01 16:05:14 -03:00
Jack Robison	dabd9cbe1e	faster stream manager startup	2019-02-01 13:53:03 -05:00
Jack Robison	2336015f9a	fix publish ... fixes https://github.com/lbryio/lbry/issues/1826 - remove `sources` argument from `publish` - only add/update files we have - delete existing stream if updating with a new one	2019-02-01 13:35:18 -05:00
Jack Robison	31445c7797	remove lock from PeerManager	2019-01-31 20:57:48 -05:00
Jack Robison	87f5d1bd4a	fix updating claim with existing stream	2019-01-31 20:49:19 -05:00
Jack Robison	2e9acd1baa	remove blob request asyncio.Lock	2019-01-31 20:19:50 -05:00
Jack Robison	df86937f4e	fix deleting a file mid download	2019-01-31 17:59:42 -05:00
Jack Robison	957d0290df	add torba logging	2019-01-31 16:53:54 -05:00
Jack Robison	40b90ce79b	fix hanging download	2019-01-31 16:53:27 -05:00
Jack Robison	aa7f0845cc	catch sendfile errors	2019-01-31 16:10:27 -05:00
Jack Robison	6e69d306de	tests	2019-01-31 15:39:23 -05:00
Jack Robison	d85d3dfaa4	increase default max_connections_per_download	2019-01-31 15:39:20 -05:00
Jack Robison	2b035009ef	handle both urls and ip addresses for fixed nodes and reflector servers	2019-01-31 15:39:20 -05:00
Jack Robison	f9fd62c214	add fixed peers immediately if the dht has no peers	2019-01-31 15:39:20 -05:00
Jack Robison	e8a1953815	add fixed peers immediately if dht is skipped	2019-01-31 15:39:20 -05:00
Jack Robison	34776e7eb9	fix test	2019-01-31 15:39:20 -05:00
Jack Robison	a4419f562f	pylint	2019-01-31 15:39:20 -05:00
Jack Robison	e60e5b3919	fix updating content claim for a file ... -fix file name and download dir not being hex encoded during publish, add repair script	2019-01-31 15:39:20 -05:00
Jack Robison	3589cc9977	call update_reflected_stream upon reflector finishing	2019-01-31 15:39:20 -05:00
Jack Robison	2e978c00b2	prioritize peers to download from	2019-01-31 15:39:20 -05:00
Jack Robison	2335243de9	pylint	2019-01-31 15:39:20 -05:00
Jack Robison	6ad68eabd9	tests	2019-01-31 15:39:20 -05:00
Jack Robison	262b9a624b	update file_reflect	2019-01-31 15:39:20 -05:00
Jack Robison	05915c540a	set fully reflected if the server indicates it had all of the stream	2019-01-31 15:39:20 -05:00
Jack Robison	6aef6a80b7	refactor downloader ... split peer accumulation out, use Queues instead of locks	2019-01-31 15:39:20 -05:00
Jack Robison	16efe9ba95	add fixed_peer_delay setting	2019-01-31 15:39:20 -05:00
Jack Robison	fcda9500fe	add accumulate_peers to Node ... simplifies collecting peers during a download by giving a queue of hashes to search for and a queue or peers as they are found	2019-01-31 15:39:20 -05:00
Victor Shyba	5ee4b2173a	fix probes bugs, partial DHT refactor	2019-01-31 01:49:52 -03:00
Victor Shyba	3e1c3d1e4b	use node_id parameter instead of your own	2019-01-31 01:11:09 -03:00
Victor Shyba	21f2b2dcd7	cast timestamp to integer before querying	2019-01-31 01:09:57 -03:00
Jack Robison	ffc7fc0793	fix uncaught exception in BlobServerProtocol when client disconnects during a blob transfer	2019-01-30 12:03:05 -05:00
Victor Shyba	2e633c0ee6	fix chunked requests for server	2019-01-30 12:11:05 -03:00
Jack Robison	933d58d49b	logging	2019-01-29 20:47:02 -05:00
Jack Robison	8f7cf0b38f	verbose logging	2019-01-29 13:08:11 -05:00
Jack Robison	418def56ac	fix log	2019-01-28 22:38:17 -05:00
Jack Robison	cefe3eb520	fix file_delete	2019-01-28 22:01:43 -05:00
Jack Robison	64dffa306f	logging, cleanup	2019-01-28 22:01:43 -05:00
Jack Robison	7d33b4f1f3	fix unawaited task	2019-01-28 22:01:43 -05:00
Jack Robison	f507d95198	always add fixed peers if configured after 2s	2019-01-28 22:01:43 -05:00
Jack Robison	2a7d80f8b4	logging	2019-01-28 22:01:43 -05:00
Jack Robison	bfaebf0085	fix timeout error	2019-01-28 17:20:14 -05:00
Jack Robison	71f9f8ae9c	fix race condition in reflector server	2019-01-28 16:51:11 -05:00
Jack Robison	330862e487	fix https://github.com/lbryio/lbry/issues/1297	2019-01-28 16:00:37 -05:00
Jack Robison	778d3826ab	clean up settings and use them	2019-01-28 15:51:27 -05:00
Jack Robison	4a11cf007f	remove unused settings and constants	2019-01-27 19:51:44 -05:00
Jack Robison	573285a5bb	fix error encoding find value response	2019-01-26 17:04:11 -05:00