Commit graph

8909 commits

Author SHA1 Message Date
Victor Shyba
f4fa217b71 Merge remote-tracking branch 'origin/dht_bug' into temp_dht_supermerge 2022-02-22 22:38:51 -03:00
Victor Shyba
f68ea01056 simplify, genaralize to any size and fix tests 2022-02-22 22:38:04 -03:00
Victor Shyba
6fb1443e63 stop after finding what to download 2022-02-22 16:00:13 -03:00
Victor Shyba
af7574dc9d replace duplicated code 2022-02-22 16:00:13 -03:00
Victor Shyba
af9cc457ec add get_colliding_prefix_bits, docs and tests 2022-02-22 15:59:59 -03:00
Victor Shyba
2a1e1d542f extract method and avoid using hash builtin name 2022-02-22 14:25:52 -03:00
Victor Shyba
f5b3e9bacd implement announcer as a consumer task on gather 2022-02-21 10:55:41 -03:00
Victor Shyba
d00b5befbf make active an explicit ordered dict 2022-02-21 10:52:06 -03:00
Victor Shyba
c1e64df528 remove unused search rounds 2022-02-21 10:52:06 -03:00
Victor Shyba
3e79dcd179 timeout is now supported on dht tests 2022-02-21 10:52:06 -03:00
Victor Shyba
cc104369cb fix and enable test_blob_announcer 2022-02-21 10:52:06 -03:00
Victor Shyba
586b09c1bc simplify dht mock and restore clock after accelerating 2022-02-21 10:52:06 -03:00
Victor Shyba
b574fb7771 better representation of kademliapeer on debug logs 2022-02-21 10:52:06 -03:00
Victor Shyba
51be734a08 add a way to wait announcements to finish so tests are reliable 2022-02-21 10:52:06 -03:00
Victor Shyba
0120d989d8 make timeout handler immune to asyncio time tricks 2022-02-21 10:52:06 -03:00
Victor Shyba
12f156257e allow running some extra probes for k replacements 2022-02-21 10:52:06 -03:00
Victor Shyba
dcde0e78e3 remove all references to bottoming out 2022-02-21 10:52:06 -03:00
Victor Shyba
dc1c0e6851 no stop condition, let it exhaust 2022-02-21 10:52:06 -03:00
Victor Shyba
c45f27d5cc bottoming out is now warning and no results for peer search 2022-02-21 10:52:06 -03:00
Victor Shyba
6335590b65 don't probe peers too far from the top closest 2022-02-21 10:52:06 -03:00
Victor Shyba
b7b8831109 use a dict for the active queue 2022-02-21 10:52:06 -03:00
Victor Shyba
2ed23fbc4b log bottom out of peer search in debug, show short key id for find value 2022-02-21 10:52:06 -03:00
Victor Shyba
023cfb593a bump bottom out limit of peer search so people can use 100 concurrent announcers 2022-02-21 10:52:06 -03:00
Victor Shyba
2884dba52d wait until k peers are ready. do not double add peers 2022-02-21 10:52:06 -03:00
Victor Shyba
44c4b03d44 only return good (contacted) peers 2022-02-21 10:52:06 -03:00
Victor Shyba
6ba8f96511 reset closest peer on failure 2022-02-21 10:52:06 -03:00
Victor Shyba
4987f57944 add peers from shortlist regardless, but check from other nodes 2022-02-21 10:52:06 -03:00
Victor Shyba
f5bf8b8684 bump split index to 2 2022-02-21 10:52:06 -03:00
Victor Shyba
809a8c1226 fix distance sorting and improve logging 2022-02-21 10:52:06 -03:00
Victor Shyba
e319b55db5 closest peer is only ready when it was contacted and isn't known to be bad 2022-02-21 10:52:06 -03:00
Victor Shyba
f274562c92 dont probe and ignore bad peers 2022-02-21 10:52:06 -03:00
Victor Shyba
d1bc981b11 extract min_prefix_colliding_bits to a contanst 2022-02-20 22:34:53 -03:00
Victor Shyba
53d78e9194 check that the stored blob is at least 1 prefix byte close to peer id 2022-02-20 22:34:53 -03:00
Victor Shyba
dd5b9ca81b add migrator to set head blobs should_announce=0 2022-02-20 22:33:57 -03:00
Victor Shyba
89ed04f8a7 fix test_announces 2022-02-20 22:33:57 -03:00
Victor Shyba
ec0d9f06c5 do not search for the head blob 2022-02-20 22:33:57 -03:00
Victor Shyba
03b59ac6fc dont set head blob to announce on save 2022-02-20 22:33:57 -03:00
Victor Shyba
43ac3336d7 break tie by length 2022-02-20 22:24:04 -03:00
Victor Shyba
d12c78db74 fix and test case for blob_clean after disabling network storage 2022-02-20 22:24:04 -03:00
Jack Robison
bfaf1b0957
Merge pull request #3564 from lbryio/fix_downloader_losing_peers
fix handling re-adding lost peers during download
2022-02-16 11:55:22 -05:00
Victor Shyba
bb60c385d5 put back all the peers, get rid of re_add 2022-02-08 21:41:52 -03:00
Alex Grin
c96d1d9c32
Merge pull request #3537 from lbryio/repost_update 2022-02-08 12:20:20 -05:00
Alex Grintsvayg
7c7a0d4bdf
let stream_update work on non-stream claims 2022-02-08 09:28:17 -05:00
Lex Berezhny
cc829a7bf4
Merge pull request #3558 from lbryio/jeffreypicard-patch-1
Update __init__.py
2022-02-04 12:36:01 -05:00
Jeffrey Picard
e0ea6383e2
Update __init__.py
Update go hub binary to fix es sync test.
2022-02-04 12:17:19 -05:00
Lex Berezhny
bcec5dc2ae
Merge pull request #3556 from lbryio/txo_dust_prevention
prevent creation of change which is below the dust threshold of 1000 dewies
2022-02-04 12:08:16 -05:00
Lex Berezhny
cba9c16a06 fix 2022-02-04 12:07:41 -05:00
Lex Berezhny
dd68fb077b prevent creation of change which is below the dust threshold of 1000 dewies 2022-02-04 12:07:41 -05:00
Jack Robison
c2294e97db
Merge pull request #3552 from lbryio/bump_dht_cache
Increase DHT peer manager cache size to 16384
2022-02-04 11:59:19 -05:00
Victor Shyba
c0f512ace7 bump DHT peer manager cache to 16384 2022-02-02 16:54:42 -03:00