168 commits

Author	SHA1	Message	Date
Jack Robison	929a0cc5af	exclude self and querying node from closest contacts	2018-07-02 14:54:03 -04:00
Jack Robison	b6289d101d	fix improper sorting when getting the closest peers to a hash	2018-07-02 14:54:03 -04:00
Jack Robison	7fe92d2df0	load all finished blobs into the node datastore	2018-07-02 14:31:09 -04:00
Jack Robison	03769b94b8	accept invalid store tokens for the first expire-time after startup ... this is to better handle nodes storing to us after we've restarted our node	2018-07-02 13:26:38 -04:00
Jack Robison	e6df378e9e	fix token validation error when the dht node has just been started (https://github.com/lbryio/lbry/issues/1248)	2018-06-14 15:07:10 -04:00
Jack Robison	7f3ead67bf	disable forced bucket refresh during join	2018-06-07 15:02:47 -04:00
Jack Robison	b0e4fc4faa	fix iterative find lockup	2018-06-07 15:02:47 -04:00
Jack Robison	ae631f05c3	fix teardown error	2018-06-07 15:02:47 -04:00
Jack Robison	bc0da5e2d1	only use seeds in iterative bootstrap if no contacts are known yet	2018-06-07 15:02:47 -04:00
Jack Robison	44644673d7	add profiler	2018-06-07 15:02:47 -04:00
Jack Robison	e8b402f998	remove deferredLock from iterativeFind ... -fire the first iteration right away	2018-06-07 15:02:47 -04:00
Jack Robison	4fbaaac3f3	default new contacts to protocol version 0	2018-06-07 15:02:47 -04:00
Jack Robison	db06191c33	reduce default concurrent announcers to 10 ... -lower rpc timeout to what it originally was	2018-06-07 15:02:47 -04:00
Jack Robison	b0a741b1f4	fix hash announcer semaphore	2018-06-07 15:02:47 -04:00
Jack Robison	537df6c8ad	log socket errors	2018-06-07 15:02:47 -04:00
Jack Robison	42eb172638	refactor announceHaveBlob ... -add cached `token` to Contact objects to minimize findValue requests -remove self_store, always store to remote contacts even if we're the closest known node to the hash -move the store call and error handling from announceHaveBlob to a smaller function of its own	2018-06-07 15:02:47 -04:00
Jack Robison	9a63db4ec6	add protocol version to the dht and migrate old arg format for store	2018-06-07 15:02:47 -04:00
Jack Robison	7d21cc5822	pylint and more tests	2018-06-07 15:02:47 -04:00
Jack Robison	cce3c8c7b5	increase kademlia rpc timeout to 8 seconds	2018-06-07 15:02:47 -04:00
Jack Robison	0e80123615	use 12 minutes instead of 15 as delay in contact_is_good	2018-06-07 15:02:47 -04:00
Jack Robison	659632b66c	fix and update tests	2018-06-07 15:02:47 -04:00
Jack Robison	9582b7fcf5	use maybe_ping for refreshing stale buckets and storing peers ... -move store refresh to its own looping call	2018-06-07 15:02:47 -04:00
Jack Robison	945da5985e	fix age used in datastore to determine if a value is expired	2018-06-07 15:02:47 -04:00
Jack Robison	921ee3c4c1	use refreshTimeout in getRefreshList	2018-06-07 15:02:47 -04:00
Jack Robison	8efede6ad6	maybe_ping bad and unknown contacts instead of only unknown	2018-06-07 15:02:47 -04:00
Jack Robison	fb3aac15fa	add optional delay argument to enqueue_maybe_ping, fix default value	2018-06-07 15:02:47 -04:00
Jack Robison	73e813f9ec	verify key size in Distance	2018-06-07 15:02:47 -04:00
Jack Robison	0d23c68797	raise attribute error for non-rpc functions in Contact	2018-06-07 15:02:47 -04:00
Jack Robison	ec1b6b2387	comments, cleaner key_bits constant	2018-06-07 15:02:47 -04:00
Jack Robison	29d5750371	pylint	2018-06-07 15:02:47 -04:00
Jack Robison	07f92014d7	omit bad contacts from getPeersForBlob ... -refresh stored contacts to detect when they go offline or come back	2018-06-07 15:02:47 -04:00
Jack Robison	c521120b17	update and fix hash announcer test	2018-06-07 15:02:47 -04:00
Jack Robison	d02ed29e50	add kademlia store and expiration test	2018-06-07 15:02:47 -04:00
Jack Robison	877da78505	ping contacts right away during refresh instead of using PingQueue ... -fixes contact expiration test	2018-06-07 15:02:47 -04:00
Jack Robison	a952d2d2c8	reset _listeningPort and _listening Deferred on teardown	2018-06-07 15:02:47 -04:00
Jack Robison	3dfc6bd2cc	update CallLaterManager to be an object	2018-06-07 15:02:47 -04:00
Jack Robison	760417ff3a	pylint	2018-06-07 15:02:47 -04:00
Jack Robison	4f72098cad	use PingQueue to try refresh all contacts	2018-06-07 15:02:47 -04:00
Jack Robison	9920ff59d4	force KBucket refreshes	2018-06-07 15:02:47 -04:00
Jack Robison	aee7a3aa38	simplify announceHaveBlob, remove unused getPeersForBlob	2018-06-07 15:02:47 -04:00
Jack Robison	372fb45e06	refactor dht bootstrap ... after finding the closest nodes try to populate the buckets out by looking up random ids in their key ranges	2018-06-07 15:02:47 -04:00
Jack Robison	c65274e9e5	add PingQueue to KademliaProtocol	2018-06-07 15:02:47 -04:00
Jack Robison	1adf4f7818	fix constant used to check if a bucket is fresh	2018-06-07 15:02:47 -04:00
Jack Robison	05241012a2	update contact replacement in KBucket to follow BEP0005 ... http://www.bittorrent.org/beps/bep_0005.html	2018-06-07 15:02:47 -04:00
Jack Robison	cf3359044d	fix conditions for when a kbucket should be split ... https://stackoverflow.com/a/32187456	2018-06-07 15:02:47 -04:00
Jack Robison	5631a24881	improve findCloseNodes, choose closest contacts from higher and lower buckets	2018-06-07 15:02:47 -04:00
Jack Robison	c654bfe296	use reactor clock in TreeRoutingTable instead of time module	2018-06-07 15:02:47 -04:00
Jack Robison	d4e28216a0	sort KBucket.getContacts	2018-06-07 15:02:47 -04:00
Jack Robison	95ed1e044b	raise TransportNotConnected instead of logging a warning ... -add a _listening Deferred to KademliaProtocol which is called when the protocol is started	2018-06-07 15:02:47 -04:00
Jack Robison	f1e0a784d9	refactor iterativeFind, move to own file	2018-06-07 15:02:47 -04:00