Victor Shyba
951716f7dc
create downloader component and initial tests
2021-11-09 14:27:06 -05:00
Victor Shyba
1ddc7ddda3
with the fix we no longer need to restart the stream
2021-11-08 10:50:47 -05:00
Victor Shyba
903ed9f3dc
fix tests by checking there are actual blobs being deleted
2021-11-08 10:50:47 -05:00
Victor Shyba
c42b76dcb8
dont lose results on duplicates, just warn
2021-11-08 10:50:47 -05:00
Victor Shyba
a73582d9ae
remove tried_for_this_blob so banned peers are retried for same blob
2021-11-08 10:50:47 -05:00
Cristian Vicas
42c4fc7557
Bug [ #2070 ] where blob_get RPC timed out.
...
Both stream.downloader and blob_exchange.downloader paths are adding the fixed_peers list to the DHT node.
Tested jsonrpc_blob_get daemon call.
Bug [#2070 ] where blob_get RPC timed out.
Both stream.downloader and blob_exchange.downloader paths are adding the fixed_peers list to the DHT node.
Tested jsonrpc_blob_get daemon call.
2021-11-08 10:49:48 -05:00
Jack Robison
ddbbb6f1dd
use mempool cache in transaction_get_batch
2021-10-27 20:19:08 -04:00
Lex Berezhny
ff21a92330
Merge pull request #3457 from FemtosecondLaser/feature/3270-check-default-download-dir-writable
...
Modified ensure_directory_exists() to check if the directory is writable by the process.
2021-10-27 11:00:13 -04:00
FemtosecondLaser
07f76f7ad1
Added an integration test covering the following scenario:
...
On start, if download dir is non-writable - daemon terminates with a helpful message.
2021-10-26 11:17:52 +01:00
Jack Robison
c90ccffd7b
Update docker-compose-wallet-server.yml
2021-10-25 14:20:39 -04:00
Jack Robison
a00d5f18af
add script to setup docker volumes from snapshots
2021-10-24 16:25:34 -04:00
Jack Robison
1e391d211b
fix attempting to update trending on abandoned claims
2021-10-23 18:39:04 -04:00
FemtosecondLaser
d87f9672fa
Improved the readability of the tests.
2021-10-23 13:12:49 +01:00
FemtosecondLaser
2b5838aa01
Changed the tests to execute against a real file system instead of a fake one.
2021-10-23 02:52:58 +01:00
Jack Robison
e10486d6ec
update docs
2021-10-22 16:51:59 -04:00
Jack Robison
1a74d6604d
skip loading tx/claim caches in the elastic sync script when not needed
2021-10-22 15:10:35 -04:00
Alex Grin
6d118536b6
Merge pull request #3460 from lbryio/dht_seed_script_metrics
2021-10-22 12:44:16 -04:00
Alex Grin
ca4d758db9
Merge branch 'master' into dht_seed_script_metrics
2021-10-22 11:54:19 -04:00
Victor Shyba
dc18c26aa4
add optional prometheus to dht_node script
2021-10-22 03:39:46 -03:00
Jack Robison
48505c2968
update trending with help from @eggplantbren
2021-10-21 00:17:12 -04:00
Jack Robison
a98ea1e66a
update sync script to handle ES falling behind leveldb on shutdown
2021-10-20 23:41:11 -04:00
Jack Robison
3dec697816
logging
2021-10-20 23:41:11 -04:00
Jack Robison
88fd41e597
update docker
2021-10-20 23:41:11 -04:00
Jack Robison
b05d071a1c
update Env to accept parameters from cli args
2021-10-20 23:41:11 -04:00
Jack Robison
a27d3b9689
set default CACHE_MB to 1024mb and the default QUERY_TIMEOUT_MS to 10s
2021-10-20 23:41:11 -04:00
Jack Robison
1facc0cd01
remove unused hub env settings
2021-10-20 23:41:11 -04:00
FemtosecondLaser
837f91d830
renamed the test class to be more specific about the sut
2021-10-21 00:31:02 +01:00
FemtosecondLaser
9c5f5aefb0
removed redundant tests
...
renamed a test to be more specific about the kind of the precondition
2021-10-21 00:27:31 +01:00
FemtosecondLaser
6b8d4a444b
Modified ensure_directory_exists() to check if the directory is writable by the process.
2021-10-20 15:26:16 +01:00
Jack Robison
6bef09a3b1
update lbry-hub-elastic-sync to support resyncing recent blocks
2021-10-19 15:53:20 -04:00
Jack Robison
e35319e5a2
add CACHE_ALL_CLAIM_TXOS hub setting
2021-10-19 15:53:20 -04:00
Jack Robison
0e548b3812
remove dead code
2021-10-19 15:53:20 -04:00
Jack Robison
bfac02ccab
add CACHE_ALL_TX_HASHES setting to optionally use more memory to save i/o
2021-10-19 15:53:20 -04:00
Jack Robison
7ea1a2b361
sleeps
2021-10-19 15:53:20 -04:00
Jack Robison
99df418f1d
improve resolve caching
2021-10-19 15:53:20 -04:00
Jack Robison
6416d8ce9c
threadpools for block processor and es sync reader
2021-10-19 15:53:20 -04:00
Jack Robison
22b43a2b01
doc strings
2021-10-19 15:53:20 -04:00
Jack Robison
05e5d24c5e
improve claims_producer performance
2021-10-19 15:53:20 -04:00
Jack Robison
eabcc30367
resolve lru cache
2021-10-19 15:53:20 -04:00
Jack Robison
f5e0ef5223
add block_txs index
2021-10-19 15:53:20 -04:00
Jack Robison
f46d9330b0
smaller caches
2021-10-19 15:53:20 -04:00
Jack Robison
b62a0b4607
Update daemon.py
...
docstring
2021-10-15 09:40:15 -04:00
Cristian Vicas
1f044321fb
Updated documentation for RPC calls: status, blob_list.
2021-10-15 09:40:15 -04:00
Jack Robison
a841d49483
Merge branch 'belikor-fix-wrong-url'
2021-10-15 09:00:59 -04:00
belikor
9509acc490
file_manager: raise new InvalidStreamURLError if the URL is invalid
...
When using `lbrynet get URL`, if the URL is not a valid URL
the function `url.URL.parse` will raise a `ValueError` exception
which will produce a whole backtrace.
For example, this is the case if we provide a channel name
with a forward slash but without a stream name.
```
lbrynet get @Non-existing/
```
```
Traceback (most recent call last):
File "/opt/git/lbry-sdk/lbry/file/file_manager.py", line 84, in download_from_uri
if not URL.parse(uri).has_stream:
File "/opt/git/lbry-sdk/lbry/schema/url.py", line 114, in parse
raise ValueError('Invalid LBRY URL')
ValueError: Invalid LBRY URL
WARNING lbry.extras.daemon.daemon:1110: Error downloading Non-existing/: Invalid LBRY URL
```
Now we raise a new `InvalidStreamURLError` which can be trapped in the upper functions
that use `url.URL.parse` such as `FileManager.download_from_uri`.
If we do this the traceback won't be shown.
```
WARNING lbry.file.file_manager:252:
Failed to download Non-existing/: Invalid LBRY stream URL: '@Non-existing/'
WARNING lbry.extras.daemon.daemon:1110:
Error downloading Non-existing/: Invalid LBRY stream URL: '@Non-existing/'
```
This handles the case when trying to download only "channel" parts
without the claim part.
```
lbrynet get @Non-existing
lbrynet get @Non-existing/
lbrynet get Non-existing/
```
2021-10-15 08:59:37 -04:00
Jack Robison
02d356ef12
Merge pull request #3443 from lbryio/fix-resolve-reposted-channel
...
Fix including channels for reposted claims when resolving a repost
2021-10-08 16:51:40 -04:00
Jack Robison
d3516f299e
clear es attributes during initial sync
2021-10-08 16:34:48 -04:00
Jack Robison
79630767c2
fix setting references on txos in extra_txos
2021-10-08 16:34:15 -04:00
Jack Robison
084a76d075
fix reposted channel being missing from resolve result
...
-improve names of the resolve related methods in `LevelDB`
2021-10-07 15:09:13 -04:00
Jack Robison
bc6822e397
Merge pull request #3205 from lbryio/leveldb-resolve
...
drop sqlite in the hub and make resolve handle reorgs
2021-10-07 02:07:48 -04:00
