Commit graph

8837 commits

Author SHA1 Message Date
Victor Shyba
aa7a17b112 stop after finding what to download 2022-03-15 15:36:00 -03:00
Victor Shyba
838fd71538 replace duplicated code 2022-03-15 15:36:00 -03:00
Victor Shyba
0146044b90 add get_colliding_prefix_bits, docs and tests 2022-03-15 15:36:00 -03:00
Victor Shyba
f8f73ed4a6 extract method and avoid using hash builtin name 2022-03-15 15:36:00 -03:00
Victor Shyba
74bf8c551b extract min_prefix_colliding_bits to a contanst 2022-03-15 15:36:00 -03:00
Victor Shyba
4be346d0bb check that the stored blob is at least 1 prefix byte close to peer id 2022-03-15 15:36:00 -03:00
Victor Shyba
4fd1fe0046 add migrator to set head blobs should_announce=0 2022-03-15 15:36:00 -03:00
Victor Shyba
9524f03eac fix test_announces 2022-03-15 15:36:00 -03:00
Victor Shyba
90c8a8bea3 do not search for the head blob 2022-03-15 15:36:00 -03:00
Victor Shyba
154c41bd8d dont set head blob to announce on save 2022-03-15 15:36:00 -03:00
Victor Shyba
f271511484 break tie by length 2022-03-15 15:36:00 -03:00
Victor Shyba
dde4a5b495 fix and test case for blob_clean after disabling network storage 2022-03-15 15:36:00 -03:00
Victor Shyba
68a940f3a6 put back all the peers, get rid of re_add 2022-03-15 15:36:00 -03:00
Alex Grintsvayg
8c773151a3 let stream_update work on non-stream claims 2022-03-15 15:36:00 -03:00
Jeffrey Picard
f1f5276a04 Update __init__.py
Update go hub binary to fix es sync test.
2022-03-15 15:36:00 -03:00
Lex Berezhny
51490b36e6 fix 2022-03-15 15:36:00 -03:00
Lex Berezhny
e00dc78e1f prevent creation of change which is below the dust threshold of 1000 dewies 2022-03-15 15:36:00 -03:00
Victor Shyba
72beb02ec1 bump DHT peer manager cache to 16384 2022-03-15 15:36:00 -03:00
Victor Shyba
b13c346418 add gauge for queue size 2022-03-15 15:36:00 -03:00
Victor Shyba
2520465fc1 count announcements and how many peers we were able to announce to 2022-03-15 15:36:00 -03:00
Eugene Dubinin
dd868d5148 adds tests for guess_media_type
removes unnecessary comments
2022-03-15 15:36:00 -03:00
Eugene Dubinin
e90fb9a28f adjusts code style 2022-03-15 15:36:00 -03:00
Eugene Dubinin
96d1745232 fixes KeyError on missing synonyms 2022-03-15 15:36:00 -03:00
Eugene Dubinin
cab5f9188f detect media_type from the file contents 2022-03-15 15:36:00 -03:00
Victor Shyba
44e647d85d remove request_flight metric 2022-03-15 15:36:00 -03:00
Victor Shyba
5686c2ade9 disable CSV endpoints by default 2022-03-15 15:36:00 -03:00
Victor Shyba
1cc321e9cd remove estimation endpoints as that is done over prometheus metrics now 2022-03-15 15:36:00 -03:00
Victor Shyba
b4d144da21 add granular metric for stored blob prefix, for network announcements calculation 2022-03-15 15:36:00 -03:00
Victor Shyba
39c2c0b922 change colliding bits metric to gauge 2022-03-15 15:36:00 -03:00
Victor Shyba
dbf11fe750 count bit collisions between 8 and 16 2022-03-15 15:36:00 -03:00
Victor Shyba
cc391324e4 add counter for peers with colliding bytes 2022-03-15 15:36:00 -03:00
Victor Shyba
273b4f6d3b add requests in flight and error 2022-03-15 15:36:00 -03:00
Victor Shyba
d359d25935 add request received 2022-03-15 15:36:00 -03:00
Victor Shyba
645a81cec2 add request_sent and request_time metric on dht 2022-03-15 15:36:00 -03:00
Victor Shyba
06da53ef09 add storing_peers and peer_manager_keys 2022-03-15 15:36:00 -03:00
Victor Shyba
692af0cc55 prometheus: move blobs_stored and peers to SDK. add buckets_in_routing_table 2022-03-15 15:36:00 -03:00
Victor Shyba
32b95fa04a add passive estimation to prometheus 2022-03-15 15:36:00 -03:00
Victor Shyba
5ebcbc6370 fix missing async 2022-03-15 15:36:00 -03:00
Victor Shyba
3978d64056 keep same node id between runs 2022-03-15 15:35:59 -03:00
Victor Shyba
d35f7a5ed5 add semaphore on active estimation to avoid abuse 2022-03-15 15:35:59 -03:00
Victor Shyba
2f84c38f6a same api across different estimation methods 2022-03-15 15:35:59 -03:00
Victor Shyba
b656759e0e be explicit about ignoring params 2022-03-15 15:35:59 -03:00
Victor Shyba
15ac365463 better endpoint names, small docs 2022-03-15 15:35:59 -03:00
Victor Shyba
2ab78a92ca add prefix_neighbors_count to routing table debug api 2022-03-15 15:35:59 -03:00
Jack Robison
71b5c4c6ad improve script 2022-03-15 15:35:59 -03:00
Victor Shyba
eae1a0912b first attempt at crawling 2022-03-15 15:35:59 -03:00
Lex Berezhny
d5ec647f46 added integration test 2022-03-15 15:35:59 -03:00
vertbyqb
e066b2a9da jsonrpc_channel_sign - Convert hexdata to a string before signing
Fixes #3533
2022-03-15 15:35:59 -03:00
Victor Shyba
8adec9d0ad extract cache values, increase peer cache to 2048 2022-03-15 15:35:59 -03:00
Victor Shyba
030e407584 DHT bugfix: failures tracking should be bound to 2048 LRU cache size 2022-03-15 15:35:59 -03:00