Commit graph

8762 commits

Author SHA1 Message Date
Jack Robison
78b559b274 update json docs 2022-03-15 15:34:09 -03:00
Jack Robison
974b933612 update header checkpoints 2022-03-15 15:34:09 -03:00
Victor Shyba
3aac113d45 test case for stream_type search on claims missing source + fix 2022-03-15 15:34:09 -03:00
Lex Berezhny
a04d50a3bc fee per name env var 2022-03-15 15:34:09 -03:00
Victor Shyba
6ec30798ca fix typo from arg name 2022-03-15 15:34:09 -03:00
Jack Robison
b4d47e423d keep touched_or_deleted records 2022-03-15 15:34:09 -03:00
Victor Shyba
bf86e7658e add blob endpoint for listing announced blobs 2022-03-15 15:34:09 -03:00
Victor Shyba
98c0200c53 add /peers.csv to monitoring endpoint 2022-03-15 15:34:09 -03:00
Brendon J. Brewer
a850fb64c8 Rename trending 2022-03-15 15:34:09 -03:00
Jack Robison
02b0f3e9f2 fix missing es notification for support amount changing 2022-03-15 15:34:09 -03:00
Jack Robison
948a58f628 improve tests 2022-03-15 15:34:09 -03:00
Jack Robison
21a2076f26 improve resolve tests 2022-03-15 15:34:09 -03:00
Jack Robison
efd8fd81ed fix duplicate trending notification to ES 2022-03-15 15:34:09 -03:00
Jack Robison
5e73f82c23 fix effective amount for resolve/ES being off while claims/supports are unactivated 2022-03-15 15:34:09 -03:00
Jack Robison
01691dd92a fix test_colliding_short_id 2022-03-15 15:34:09 -03:00
Jack Robison
5fe339c53b update default tcp/blob port to be the same as the default udp/dht port (4444) 2022-03-15 15:34:09 -03:00
Victor Shyba
c4b86454b5 log unexpected errors, rename task/loop 2022-03-15 15:34:09 -03:00
Victor Shyba
60969e4817 clear cache on test assertions 2022-03-15 15:34:09 -03:00
Victor Shyba
48bb84fc1e make sure the downloader always stops gracefully 2022-03-15 15:34:09 -03:00
Victor Shyba
b055c25156 cache space stats from running components so status is instant 2022-03-15 15:34:09 -03:00
Victor Shyba
35905b99ff add index for blob table so size summaries are faster 2022-03-15 15:34:09 -03:00
Victor Shyba
806857c066 download from stored announcements and dont reannounce 2022-03-15 15:34:09 -03:00
Victor Shyba
ba8a7fc351 improve disk space manager status, include more info and unify space queries 2022-03-15 15:34:09 -03:00
Victor Shyba
a36fd76eb1 normal_blobs->stream_blobs, proactive->background 2022-03-15 15:34:09 -03:00
Victor Shyba
02994164be fix free space calculation, test it and give a margin of 10mb before starting so it doesnt insist when full 2022-03-15 15:34:09 -03:00
Victor Shyba
c3b89a896b move more logic out of the downloader component 2022-03-15 15:34:09 -03:00
Victor Shyba
b0bf6eff16 extract background downloader to its own class 2022-03-15 15:34:09 -03:00
Victor Shyba
47c4cb800d add analytics event for network disk space 2022-03-15 15:34:09 -03:00
Victor Shyba
c5f6a4ca1c announce orphan blobs manually, as that was done when save stream 2022-03-15 15:34:09 -03:00
Victor Shyba
813108b9d8 cleanup background downloader blobs from conf 2022-03-15 15:34:09 -03:00
Victor Shyba
95703b3af5 separated network seeding space metrics 2022-03-15 15:34:09 -03:00
Victor Shyba
2ceec7c3d4 don't save streams for network blobs and bypass disk space manager 2022-03-15 15:34:09 -03:00
Victor Shyba
3985f1578e add conf for network seeding space limit 2022-03-15 15:34:09 -03:00
Victor Shyba
355ccb1e32 schedule the download task instead 2022-03-15 15:34:09 -03:00
Victor Shyba
04d2c6f013 fix unit tests from component dependency chain changes 2022-03-15 15:34:09 -03:00
Victor Shyba
8d6a7101f6 download from DHT 2022-03-15 15:34:09 -03:00
Victor Shyba
abbd8473bb drop channel support, prepare to hook into DHT 2022-03-15 15:34:09 -03:00
Victor Shyba
02b2103d94 handle case where something that isn't a sd blob gets hit 2022-03-15 15:34:09 -03:00
Victor Shyba
85474ae381 no api yet 2022-03-15 15:34:09 -03:00
Victor Shyba
9d3c401abb download only blobs 2022-03-15 15:34:09 -03:00
Victor Shyba
32a7d1a4a0 fix tests 2022-03-15 15:34:09 -03:00
Victor Shyba
602cd5bd2e fix exception arguments 2022-03-15 15:34:09 -03:00
Victor Shyba
4b88b191e7 test add/remove/list subscriptions 2022-03-15 15:34:09 -03:00
Victor Shyba
e449cd01ba fix and test main api 2022-03-15 15:34:08 -03:00
Victor Shyba
b1db42acf4 download all blobs and check that on tests 2022-03-15 15:34:08 -03:00
Victor Shyba
fcbe8cf00b create downloader component and initial tests 2022-03-15 15:34:08 -03:00
Victor Shyba
a1866c40f5 with the fix we no longer need to restart the stream 2022-03-15 15:34:08 -03:00
Victor Shyba
d78540f3cc fix tests by checking there are actual blobs being deleted 2022-03-15 15:34:08 -03:00
Victor Shyba
7c1c04674c dont lose results on duplicates, just warn 2022-03-15 15:34:08 -03:00
Victor Shyba
694aeab75c remove tried_for_this_blob so banned peers are retried for same blob 2022-03-15 15:34:08 -03:00