2545 commits

Author	SHA1	Message	Date
Lex Berezhny	1b027fae87	add some extra linux meta data to analytics	2018-05-28 18:07:23 -04:00
Jack Robison	187f920961	disable Daemon headers check for now	2018-05-28 10:57:48 -04:00
Jack Robison	6d4b678b96	Revert "WIP: feature/1098/sorted-claim-results"	2018-05-22 17:15:34 -04:00
kafene	76a7cc4e58	refactor file list sorting per request	2018-05-21 00:24:18 -04:00
kafene	1790393273	remove unused attrgetter import	2018-05-21 00:04:27 -04:00
kafene	5069351287	refactor file_list sort to allow sorting by any field	2018-05-21 00:04:27 -04:00
kafene	72bae90e06	use range instead of xrange, list is only 10 elements and range works in python3	2018-05-21 00:04:27 -04:00
kafene	852354719f	add unit test for file list sorting	2018-05-21 00:04:27 -04:00
kafene	eec3734d2f	some semantic variable renaing	2018-05-21 00:04:27 -04:00
kafene	e7b22521ee	remove pprint import	2018-05-21 00:04:27 -04:00
kafene	326d0cb8a3	initial naive implementation of file_list sorting	2018-05-21 00:04:21 -04:00
Sergey Rozhnov	13353bcfe4	refactored unit test for sort_claim_results	2018-05-18 18:51:28 +04:00
Sergey Rozhnov	40bcf96c3d	refactored sorting of claims and unit tests	2018-05-18 12:53:32 +04:00
Victor Shyba	b48492c1d6	verify streams on a new migration instead	2018-05-17 12:29:12 -03:00
Sergey Rozhnov	3d0f74c8ce	implemented additional test cases for claims sorting; updated changelog	2018-05-17 13:49:09 +04:00
Sergey Rozhnov	a7a5bb8887	simplified claims comparison logic; refactored unit tests	2018-05-17 13:36:32 +04:00
Sergey Rozhnov	208284a0f8	claim_list and claim_list_mine in Daemon return sorted results	2018-05-16 18:29:44 +04:00
Victor Shyba	b6cedfec56	batch-start the file manager	2018-05-11 12:17:55 -03:00
Victor Shyba	ca86af736e	add batching support to get_supports and tests	2018-05-11 12:17:55 -03:00
Victor Shyba	d55ded78ee	get claim with channel_name from a stream hash in a single query	2018-05-11 12:17:55 -03:00
Victor Shyba	acd330aa2a	get claim info and channel name using a single query	2018-05-11 12:17:55 -03:00
Victor Shyba	df735252e5	verify streams only after migration	2018-05-11 12:17:55 -03:00
Jack Robison	b3bf193188	Merge remote-tracking branch 'origin/treq_and_cryptography'	2018-05-11 09:22:28 -04:00
Victor Shyba	a0a7187f7d	add integrity checks after s3 download as well	2018-05-08 16:09:06 -03:00
Jack Robison	aa4240de85	track successful reflector uploads in sqlite to minimize how many streams are attempted by auto re-reflect ... -increase the default `auto_re_reflect_interval` to a day	2018-05-08 14:41:56 -04:00
Victor Shyba	2299098884	add integrity check for the headers file	2018-05-07 15:10:19 -03:00
Victor Shyba	fd04c607b2	typos and fixes from code review	2018-05-07 13:11:31 -03:00
Victor Shyba	805bfbd18e	remove point trader testing client	2018-05-07 11:49:54 -03:00
Victor Shyba	3ee0f9756d	add treq as a dependency + pep8	2018-05-05 20:58:10 -03:00
Victor Shyba	c90140f701	make the exchange manager use treq instead of requests	2018-05-05 02:33:37 -03:00
Victor Shyba	e170f3db3e	remove txrequests dependency	2018-05-05 02:20:21 -03:00
Victor Shyba	7f88dda0ae	use treq on loggly	2018-05-05 02:18:03 -03:00
Victor Shyba	0bf65836c7	resume download from S3 instead of starting from scratch	2018-05-05 02:05:02 -03:00
Victor Shyba	3982e15091	download headers from s3 using treq	2018-05-05 01:16:26 -03:00
Victor Shyba	d03fc80eac	make analytics use treq	2018-05-05 00:50:42 -03:00
Victor Shyba	fab932abb6	replace pycrypto->cryptography	2018-05-04 23:56:51 -03:00
Victor Shyba	b389e59452	replace pycrypto->cryptography on tests	2018-05-04 22:12:43 -03:00
Jack Robison	cc34c4b95f	Merge pull request #1189 from lbryio/faster-headers ... magic	2018-05-04 11:10:43 -04:00
Thomas Zarebczan	df2339231a	magic	2018-05-04 00:47:08 -04:00
Jack Robison	6977d6944e	show local, remote, and s3 header heights in the log	2018-05-02 17:25:00 -04:00
Jack Robison	f1e3682302	socket might not have TCP_KEEPx attributes	2018-05-02 17:16:00 -04:00
Jack Robison	f42733ecba	fix tests	2018-05-02 15:00:57 -04:00
Jack Robison	129d2687b9	download headers from s3 when more than 10 chunks behind	2018-05-02 15:00:50 -04:00
Jack Robison	1f1b348638	fix handling ancient non-decodable claims	2018-04-19 17:37:23 -04:00
Jack Robison	8b7e86e046	fix appveyor?	2018-04-19 17:36:26 -04:00
Jack Robison	fe6a850fc5	appveyor	2018-04-19 17:11:27 -04:00
Jack Robison	9c25a37d4d	Bump version 0.20.0rc8 --> 0.20.0rc9 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-04-19 17:04:48 -04:00
Jack Robison	1e87767a0c	fix appveyor	2018-04-19 16:56:48 -04:00
Jack Robison	487ef6516e	fix reflector test	2018-04-19 16:35:15 -04:00
Jack Robison	4a1f3a79a5	fix mock announcer	2018-04-19 16:18:19 -04:00
Jack Robison	11aad04c31	datagram decode error logging	2018-04-19 15:47:42 -04:00
Jack Robison	b89823c968	fix blob announce locking up the daemon process	2018-04-19 15:47:19 -04:00
Jack Robison	baf55165aa	lint	2018-04-19 14:35:11 -04:00
Jack Robison	769bc2e36e	Revert "elif" ... This reverts commit c3e047a2aa.	2018-04-19 14:34:49 -04:00
Alex Grintsvayg	c3e047a2aa	elif	2018-04-19 13:47:24 -04:00
Jack Robison	1c793931ed	Bump version 0.20.0rc7 --> 0.20.0rc8 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-04-19 12:31:54 -04:00
Jack Robison	fa49b40389	fix claim_show	2018-04-19 12:31:36 -04:00
Jack Robison	89b4487eb9	Bump version 0.20.0rc6 --> 0.20.0rc7 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-04-19 11:05:42 -04:00
Jack Robison	450bed6350	fix kwargs bug	2018-04-19 11:00:44 -04:00
Alex Grintsvayg	f8e418fb44	undeprecated report_bug while app team works on a new bug reporting flow	2018-04-18 14:58:58 -04:00
Jack Robison	2655797692	move docs tests to own file	2018-04-12 14:04:22 -04:00
Niko	c089f1954a	fix documentation for blob_reflect	2018-04-12 13:27:06 -04:00
Niko	0a14d51b96	fix documentation for peer_ping command	2018-04-12 13:08:58 -04:00
Jack Robison	bb7e17e54a	Bump version 0.20.0rc5 --> 0.20.0rc6 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-04-03 13:21:17 -04:00
Jack Robison	5cea031f38	return list of dictionaries from peer_list, include peer node ids	2018-04-03 13:10:30 -04:00
Jack Robison	2903ccaeb4	add peer_ping	2018-04-03 13:10:30 -04:00
Jack Robison	eae97a8133	off by one	2018-04-03 13:08:36 -04:00
Jack Robison	bc3128ae3b	Bump version 0.20.0rc4 --> 0.20.0rc5 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-04-03 12:34:45 -04:00
Jack Robison	4e7bdafdcf	fix positional and keyword args	2018-04-03 12:27:49 -04:00
Jack Robison	12d378af13	show not connected error in lbrynet-cli when using auth	2018-04-03 12:25:18 -04:00
Jack Robison	ca73d632d3	Bump version 0.20.0rc3 --> 0.20.0rc4 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-04-02 10:13:02 -04:00
Jack Robison	743ae59d54	fix lbrynet-cli when using authentication ... -add explanation of daemon authentication to AuthJSONRPCServer docstring -remove auth_required decorator, use auth for all api methods if use_authentication is true -fix issues with the command line --http-auth flag to lbrynet-daemon and the use_http_auth setting in the config file	2018-04-01 18:31:03 -04:00
Jack Robison	ea5190aa9a	Bump version 0.20.0rc2 --> 0.20.0rc3 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-03-29 15:06:41 -04:00
Jack Robison	51662b1e5b	re-add hash_queue_size function	2018-03-29 15:06:08 -04:00
Jack Robison	789ca3693f	Bump version 0.20.0rc1 --> 0.20.0rc2 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-03-29 12:20:54 -04:00
Jack Robison	8c2b626f97	fix cli kwargs	2018-03-29 12:19:41 -04:00
Jack Robison	0279d37b32	fix status docstring	2018-03-29 12:19:18 -04:00
Jack Robison	f4aca40ff9	Bump version 0.19.3rc2 --> 0.20.0rc1 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-03-29 09:55:34 -04:00
Jack Robison	08e9f9ac0e	Bump version 0.19.3rc1 --> 0.19.3rc2 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-03-29 09:50:14 -04:00
Jack Robison	9a9b2f47ce	pass sd_hash to reflector client factory instead of looking it up	2018-03-29 09:46:34 -04:00
Jack Robison	b9600101ae	Bump version 0.19.2 --> 0.19.3rc1 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-03-28 19:36:39 -04:00
Jack Robison	492858596e	add single_announce column to blob table ... -remove deprecated blob_announce_all function -remove announce_all parameter to blob_announce -change blob_announce to be asynchronous	2018-03-28 18:50:24 -04:00
Jack Robison	dff1fd3fe9	logging, raise default concurrent announcers	2018-03-28 18:50:24 -04:00
Jack Robison	eabf4a0e40	remove delay from udp write	2018-03-28 18:50:24 -04:00
Jack Robison	5bab6f7d39	remove bandwidth stats	2018-03-28 18:50:24 -04:00
Jack Robison	a41bbd5e27	pylint and tests	2018-03-28 18:50:18 -04:00
Jack Robison	43d3f7c087	add concurrent_announcers to config	2018-03-28 15:53:51 -04:00
Jack Robison	c5bf64cf0a	refactor DHTHashAnnouncer ... -remove hash_announcer from Node and DiskBlobManager -remove announcement related functions from DiskBlobManager -update SQLiteStorage to store announcement times and provide blob hashes needing to be announced -use dataExpireTimeout from lbrynet.dht.constants for re-announce timing -use DeferredSemaphore for concurrent blob announcement	2018-03-28 15:53:51 -04:00
Jack Robison	ea0ea704a2	refactor iterativeAnnounceHaveBlob ... -change to only self_store if the number of contacts to store to is less than k and we are the closest node to the hash	2018-03-28 15:53:51 -04:00
Jack Robison	14f9bb7b82	log EWOULDBLOCK	2018-03-28 15:53:51 -04:00
Jack Robison	a8025b02c6	log invalid vs missing token	2018-03-28 15:53:51 -04:00
Jack Robison	333d70860b	add last_announced_time to blob table	2018-03-28 15:53:50 -04:00
Lex Berezhny	267f50474b	removing more references to PTCWallet	2018-03-28 15:53:50 -04:00
Lex Berezhny	866f220d9b	removed PTCWallet	2018-03-28 15:53:50 -04:00
Jack Robison	a96d827c0f	use reactor time in Delay	2018-03-28 15:53:50 -04:00
Jack Robison	4eab77fa10	safe start_listening	2018-03-28 15:53:50 -04:00
Jack Robison	5013426e02	logging and docstring	2018-03-28 15:53:50 -04:00
Jack Robison	cb09be5336	remove unused stuff	2018-03-28 15:53:50 -04:00
Lex Berezhny	339e666f38	+ Wallet.wait_for_tx_in_wallet	2018-03-28 15:53:49 -04:00
Jack Robison	ebe5dd0e68	better ping test	2018-03-28 15:53:49 -04:00
Jack Robison	1db44d5fb6	rename variable	2018-03-28 15:53:49 -04:00
Jack Robison	fd7a771f66	add sanity check to CreateEncryptedFileTest	2018-03-28 15:53:49 -04:00
Jack Robison	5628d0825b	add CallLaterManager	2018-03-28 15:53:49 -04:00
Jack Robison	88970cb0a8	move peer manager class to lbrynet.core	2018-03-28 15:53:49 -04:00
Jack Robison	d2a6dd3ed3	add dht functional tests	2018-03-28 15:53:49 -04:00
Jack Robison	1eff35ce76	update dht unit tests to use task.Clock	2018-03-28 15:53:49 -04:00
Jack Robison	0ab5dd28bc	update tests	2018-03-28 15:53:48 -04:00
Jack Robison	2e30ce9ae5	add mock udp transport layer	2018-03-28 15:53:48 -04:00
Jack Robison	87c69742cd	log packet encoding errors and warn if the transport is not connected	2018-03-28 15:53:48 -04:00
Jack Robison	b4bc5e2110	cancel callLater on error or timeout	2018-03-28 15:53:48 -04:00
Jack Robison	df78f7ff9f	add response assertion to announce_to_peer	2018-03-28 15:53:48 -04:00
Jack Robison	bdba263224	catch TimeoutError in _IterativeFindHelper	2018-03-28 15:53:48 -04:00
Jack Robison	16fcc3f5c1	findValue inlinecallbacks refactor	2018-03-28 15:53:48 -04:00
Jack Robison	43896c8d17	refactor joinNetwork into smaller functions ... -try to re-join network if no contacts are known	2018-03-28 15:53:47 -04:00
Jack Robison	04e76443c6	move dht node component setup from Session into Node	2018-03-28 15:53:47 -04:00
Jack Robison	e6caedac91	remove DHTHashSupplier class, move former functions into DHTHashAnnouncer	2018-03-28 15:53:47 -04:00
Jack Robison	6666468640	add reactor arguments to Node ... -adds reactor (clock) and reactor functions listenUDP, callLater, and resolve as arguments to Node.__init__ -set the reactor clock on LoopingCalls to make them easily testable -convert callLater manage loops to LoopingCalls	2018-03-28 15:53:47 -04:00
Jack Robison	efaa97216f	move dht node setup back into node class	2018-03-28 15:53:47 -04:00
Jack Robison	e30ea50ef4	more	2018-03-28 15:53:47 -04:00
Jack Robison	3296c0fb3d	move dht related classes to lbrynet.dht	2018-03-28 15:53:47 -04:00
Jack Robison	54a152fa8e	fix merge conflict in dht tests	2018-03-28 15:53:46 -04:00
Kay Kurokawa	9088d152b5	better to keey track of retry count in function instead of unbounded dictionary	2018-03-28 15:53:46 -04:00
Kay Kurokawa	4cb461601e	result must be set here, otherwise it will not be defined when used later. Add test for it	2018-03-28 15:53:46 -04:00
Kay Kurokawa	0425c95b68	No need for clock now in test for DHTHashAnnouncer	2018-03-28 15:53:46 -04:00
Kay Kurokawa	75b977dff9	we just have one supplier not a list of suppliers	2018-03-28 15:53:46 -04:00
Kay Kurokawa	60c7261871	add single_hash_announce_duration as a field that gets return for API call status for dht status	2018-03-28 15:53:46 -04:00
Kay Kurokawa	0f3385e4dc	make the single hash announce duration adjustable in DHTHashSupplier	2018-03-28 15:53:46 -04:00
Jack Robison	ad6a2bef7f	handle error from old clients with a broken ping command	2018-03-28 15:53:45 -04:00
Jack Robison	446c3a88dc	refactor DHTHashAnnouncer and iterativeAnnounceHaveBlob ... -use looping call for running manage function rather than a scheduled callLater -track announce speed -retry store requests that failed up to 3 times -return a dict of {blob_hash: [storing_node_id]} results from _announce_hashes _refreshRoutingTable inline cb refactor -add and use DeferredLockContextManager -don't trap errback from iterativeFindNode in iterativeAnnounceHaveBlob	2018-03-28 15:53:45 -04:00
Jack Robison	67ef8be7b7	convert node manage function to a looping call	2018-03-28 15:53:45 -04:00
Jack Robison	ecbe4113ce	move Distance to own file	2018-03-28 15:53:45 -04:00
Jack Robison	b75c8d96ce	Bump version 0.19.2rc3 --> 0.19.2 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-03-28 15:35:46 -04:00
Jack Robison	cb83531d05	Bump version 0.19.2rc2 --> 0.19.2rc3 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-03-28 15:15:47 -04:00
Jack Robison	dc65fd148e	Bump version 0.19.2rc1 --> 0.19.2rc2 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-03-26 13:36:51 -04:00
Jack Robison	439a0f8778	fix docstrings ... -add docopt unit test	2018-03-26 13:20:33 -04:00
hackrush	aa7b440989	Fixed regression in stream_availablity command	2018-03-26 19:43:06 +05:30
Jack Robison	f0742675b8	Merge branch 'master' into no-short-flags	2018-03-23 14:59:53 -04:00
Alex Grintsvayg	9ee5a3511d	missed this in dht-compat merge	2018-03-23 12:50:18 -04:00
Jack Robison	69657750b8	Bump version 0.19.1 --> 0.19.2rc1 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-03-22 17:04:12 -04:00
Jack Robison	cb069ca002	add blob_reflect	2018-03-22 16:54:29 -04:00
Jack Robison	3085e28490	don't try to resend failed blobs to reflector ... -fixes infinite loop where client keeps trying to send failing blobs, which may be failing because they are invalid -return list of reflected blob hashes from BlobReflectorClient	2018-03-22 16:53:16 -04:00
Jack Robison	679c2f403f	fix incorrectly raised DownloadCanceledError for already verified blobs ... -make InvalidDataError message clearer -fix BlobReflectorClient result	2018-03-22 13:23:12 -04:00
Jack Robison	de280b5ebf	Bump version 0.19.1rc7 --> 0.19.1 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-03-20 10:15:50 -04:00
Jack Robison	113cc8bb15	Bump version 0.19.1rc6 --> 0.19.1rc7 ... Signed-off-by: Jack Robison <jackrobison@lbry.io>	2018-03-19 14:31:17 -04:00
Jack Robison	b28bdbd752	rename existing reupload.reflect_stream --> reupload.reflect_file, add a reupload.reflect_stream function	2018-03-19 13:55:11 -04:00
Jack Robison	f94a9e8729	start lbry files in parallel	2018-03-19 13:46:27 -04:00
Jack Robison	43c73b9abf	fix slow sqlite query	2018-03-19 13:31:05 -04:00
hackrush	3724fa1810	Removed last flag decorator	2018-03-18 16:11:19 +05:30
hackrush	f7f6770120	Removed flags decorator as short flags are no longer used.	2018-03-18 16:11:19 +05:30
hackrush	1d9c996217	Merge pull request #1148 from lbryio/channel-bid ... Update channel balance checking to match claim balance checking	2018-03-17 09:05:08 +05:30