Victor Shyba
fa2ad88cc4
clear cache on test assertions
2021-11-09 14:27:06 -05:00
Victor Shyba
63cbcd0956
make sure the downloader always stops gracefully
2021-11-09 14:27:06 -05:00
Victor Shyba
d6d0ebf8f4
cache space stats from running components so status is instant
2021-11-09 14:27:06 -05:00
Victor Shyba
0d810d92ca
add index for blob table so size summaries are faster
2021-11-09 14:27:06 -05:00
Victor Shyba
1ff914a6f4
download from stored announcements and dont reannounce
2021-11-09 14:27:06 -05:00
Victor Shyba
5959b1be72
improve disk space manager status, include more info and unify space queries
2021-11-09 14:27:06 -05:00
Victor Shyba
d12a214c05
normal_blobs->stream_blobs, proactive->background
2021-11-09 14:27:06 -05:00
Victor Shyba
3a83052f2e
fix free space calculation, test it and give a margin of 10mb before starting so it doesnt insist when full
2021-11-09 14:27:06 -05:00
Victor Shyba
510b44ca92
move more logic out of the downloader component
2021-11-09 14:27:06 -05:00
Victor Shyba
15edb6756d
extract background downloader to its own class
2021-11-09 14:27:06 -05:00
Victor Shyba
fbfd02b08b
add analytics event for network disk space
2021-11-09 14:27:06 -05:00
Victor Shyba
b39c26fc86
announce orphan blobs manually, as that was done when save stream
2021-11-09 14:27:06 -05:00
Victor Shyba
95b2c8d175
cleanup background downloader blobs from conf
2021-11-09 14:27:06 -05:00
Victor Shyba
d52748b09f
separated network seeding space metrics
2021-11-09 14:27:06 -05:00
Victor Shyba
34d18a3a9a
don't save streams for network blobs and bypass disk space manager
2021-11-09 14:27:06 -05:00
Victor Shyba
3b27d6a9b5
add conf for network seeding space limit
2021-11-09 14:27:06 -05:00
Victor Shyba
703c391f99
schedule the download task instead
2021-11-09 14:27:06 -05:00
Victor Shyba
13667df374
download from DHT
2021-11-09 14:27:06 -05:00
Victor Shyba
8800d6985f
drop channel support, prepare to hook into DHT
2021-11-09 14:27:06 -05:00
Victor Shyba
364b8f2605
handle case where something that isn't a sd blob gets hit
2021-11-09 14:27:06 -05:00
Victor Shyba
67b9ea9deb
no api yet
2021-11-09 14:27:06 -05:00
Victor Shyba
b78f2336a7
download only blobs
2021-11-09 14:27:06 -05:00
Victor Shyba
23a5ce3df7
fix exception arguments
2021-11-09 14:27:06 -05:00
Victor Shyba
8f88e28e50
test add/remove/list subscriptions
2021-11-09 14:27:06 -05:00
Victor Shyba
9cf6139557
fix and test main api
2021-11-09 14:27:06 -05:00
Victor Shyba
d556065a8b
download all blobs and check that on tests
2021-11-09 14:27:06 -05:00
Victor Shyba
951716f7dc
create downloader component and initial tests
2021-11-09 14:27:06 -05:00
Victor Shyba
c42b76dcb8
dont lose results on duplicates, just warn
2021-11-08 10:50:47 -05:00
Victor Shyba
a73582d9ae
remove tried_for_this_blob so banned peers are retried for same blob
2021-11-08 10:50:47 -05:00
Cristian Vicas
42c4fc7557
Bug [ #2070 ] where blob_get RPC timed out.
...
Both stream.downloader and blob_exchange.downloader paths are adding the fixed_peers list to the DHT node.
Tested jsonrpc_blob_get daemon call.
Bug [#2070 ] where blob_get RPC timed out.
Both stream.downloader and blob_exchange.downloader paths are adding the fixed_peers list to the DHT node.
Tested jsonrpc_blob_get daemon call.
2021-11-08 10:49:48 -05:00
Jack Robison
ddbbb6f1dd
use mempool cache in transaction_get_batch
2021-10-27 20:19:08 -04:00
Lex Berezhny
ff21a92330
Merge pull request #3457 from FemtosecondLaser/feature/3270-check-default-download-dir-writable
...
Modified ensure_directory_exists() to check if the directory is writable by the process.
2021-10-27 11:00:13 -04:00
Jack Robison
1e391d211b
fix attempting to update trending on abandoned claims
2021-10-23 18:39:04 -04:00
Jack Robison
1a74d6604d
skip loading tx/claim caches in the elastic sync script when not needed
2021-10-22 15:10:35 -04:00
Jack Robison
48505c2968
update trending with help from @eggplantbren
2021-10-21 00:17:12 -04:00
Jack Robison
a98ea1e66a
update sync script to handle ES falling behind leveldb on shutdown
2021-10-20 23:41:11 -04:00
Jack Robison
3dec697816
logging
2021-10-20 23:41:11 -04:00
Jack Robison
b05d071a1c
update Env to accept parameters from cli args
2021-10-20 23:41:11 -04:00
Jack Robison
a27d3b9689
set default CACHE_MB to 1024mb and the default QUERY_TIMEOUT_MS to 10s
2021-10-20 23:41:11 -04:00
Jack Robison
1facc0cd01
remove unused hub env settings
2021-10-20 23:41:11 -04:00
FemtosecondLaser
6b8d4a444b
Modified ensure_directory_exists() to check if the directory is writable by the process.
2021-10-20 15:26:16 +01:00
Jack Robison
6bef09a3b1
update lbry-hub-elastic-sync to support resyncing recent blocks
2021-10-19 15:53:20 -04:00
Jack Robison
e35319e5a2
add CACHE_ALL_CLAIM_TXOS hub setting
2021-10-19 15:53:20 -04:00
Jack Robison
0e548b3812
remove dead code
2021-10-19 15:53:20 -04:00
Jack Robison
bfac02ccab
add CACHE_ALL_TX_HASHES setting to optionally use more memory to save i/o
2021-10-19 15:53:20 -04:00
Jack Robison
7ea1a2b361
sleeps
2021-10-19 15:53:20 -04:00
Jack Robison
99df418f1d
improve resolve caching
2021-10-19 15:53:20 -04:00
Jack Robison
6416d8ce9c
threadpools for block processor and es sync reader
2021-10-19 15:53:20 -04:00
Jack Robison
22b43a2b01
doc strings
2021-10-19 15:53:20 -04:00
Jack Robison
05e5d24c5e
improve claims_producer performance
2021-10-19 15:53:20 -04:00
