LBRYCommunity/lbry-sdk
1
0
Fork 1
Code Issues Pull requests Projects Releases 282 Packages Wiki Activity
5203 commits 110 branches 641 tags 31 MiB
Commit graph

3593 commits

Author SHA1 Message Date
Jack Robison
f22b5da170
fix raised error for a peer address mismatch 2019-02-06 12:11:22 -05:00
Jack Robison
c1c6d5bc99
fix deleting partial downloads when stopped and previous streams when updating a publish 2019-02-06 11:43:05 -05:00
Jack Robison
0e972ec2ae
refactor BlobFile.close to be non async 2019-02-06 11:00:57 -05:00
Victor Shyba
8b5803c945 format error dict on get 2019-02-06 11:55:12 -03:00
Jack Robison
76c8447a56
add stream descriptor tests 2019-02-05 21:25:31 -05:00
Jack Robison
7c8ad0fe30
fix deleting incomplete downloads upon stop 
fix deleting previous streams (not assembled/published files) for a claim being updated
 2019-02-05 15:33:08 -05:00
Jack Robison
073ffdd049
proto and type args 2019-02-05 13:36:25 -05:00
Jack Robison
7fe211d134
fix resolve_host 2019-02-05 13:31:57 -05:00
Victor Shyba
a4ced4dbd2 set verified after callback 2019-02-05 13:17:00 -03:00
Victor Shyba
c6b910a5f3 use time_getter on storage 2019-02-05 13:14:59 -03:00
Victor Shyba
63d1ec3c28 fixes from jack comments 2019-02-05 13:01:12 -03:00
Victor Shyba
7b8f42e6d0 remove dead set_should_announce code 2019-02-05 13:01:12 -03:00
Victor Shyba
2c275efa48 remove redundant calls to should announce 2019-02-05 13:01:12 -03:00
Victor Shyba
6ead932ccb announces naturally, removes redundant calls 2019-02-05 13:01:12 -03:00
Victor Shyba
f766dbefe0 announce and set completed after inserts 2019-02-05 13:01:12 -03:00
Jack Robison
0685bc5689
include torba in log file 2019-02-04 18:25:47 -05:00
Jack Robison
8cda3143f2
fix setting should_announce and blob status 2019-02-04 18:22:44 -05:00
Jack Robison
5af351a234
reflector logging 2019-02-04 17:33:25 -05:00
Victor Shyba
b82d2c3120 handle and log if downloading from bad sendfile implementations 2019-02-04 19:13:31 -03:00
Jack Robison
2bce7cecfa
fix sendfile on windows 2019-02-04 16:48:48 -05:00
Jack Robison
8883587cc7
logging 2019-02-04 16:19:27 -05:00
Jack Robison
c85991704d
catch invalid data error 2019-02-04 16:19:27 -05:00
Jack Robison
377442d9f0
fix request_blob cancellation 2019-02-04 16:19:24 -05:00
Jack Robison
f0b49fc153
always return close peers from findValue 2019-02-04 15:07:42 -05:00
Jack Robison
ae1162f5b0
don't try downloading from oneself 
-don't return the querying peer in results for findValue
 2019-02-04 14:50:53 -05:00
Victor Shyba
ad71a9a89d refactor reflect to close protocol 2019-02-04 13:34:18 -03:00
Jack Robison
13b3e4ba8e v0.31.0rc5 2019-02-04 10:22:43 -05:00
Victor Shyba
736a949cb5 resume streams on startup 2019-02-03 20:49:09 -03:00
Victor Shyba
11bb1cc7ee use with clause to avoid leaking fds 2019-02-03 20:41:47 -03:00
Jack Robison
dcd78bd86e
always delete file from downloads if download was not complete 2019-02-03 16:43:40 -05:00
Jack Robison
e5af041627
fix connection status message 2019-02-03 16:20:52 -05:00
Jack Robison
0a027cf2de
logging 2019-02-03 15:47:19 -05:00
Jack Robison
3f98b16800
fix blob announce time, use time.time instead of loop.time 2019-02-03 15:47:15 -05:00
Jack Robison
8f5a8ab8ba
fix peer_ping 2019-02-02 02:02:19 -05:00
Jack Robison
91e581422c v0.31.0rc4 2019-02-02 00:30:57 -05:00
Jack Robison
f2968aab22
add re-reflect task to stream manager, add concurrent_reflector_uploads to config 2019-02-01 22:59:41 -05:00
Jack Robison
ccbe8aa0eb
create data. download, and wallet directories if they don't exist on startup 2019-02-01 22:45:28 -05:00
Jack Robison
478f79353a
fix bytes error 2019-02-01 22:20:11 -05:00
Jack Robison
c3b0151943
fix dht status error during startup 2019-02-01 22:12:07 -05:00
Jack Robison
e96b75a0d0
fix file/download paths 
move download-from-uri logic into stream manager
 2019-02-01 21:40:35 -05:00
Jack Robison
efe4afd09e
fix blob announce time 2019-02-01 21:28:59 -05:00
Jack Robison
c7cb6822cc
logging 2019-02-01 21:28:59 -05:00
Jack Robison
c75665d3f0
update file_list docs, add blobs_remaining to file list args and to file dict result 2019-02-01 21:28:59 -05:00
Jack Robison
744375b2c0
re-assemble file / resume downloads 2019-02-01 21:28:59 -05:00
Victor Shyba
40da5b6cb6 rework data parser 2019-02-01 20:09:14 -03:00
Victor Shyba
b36cf3e36c remove closing peers from active connections 2019-02-01 20:09:14 -03:00
Jack Robison
0a08f445a4
close blob server transport on sendfile failing 2019-02-01 15:11:37 -05:00
Victor Shyba
f5bf1463af fixes from review 2019-02-01 17:09:37 -03:00
Victor Shyba
ca4a55ef28 set verified event earlier and remove stop awaits 2019-02-01 16:05:14 -03:00
Victor Shyba
832be0758b let cancel propagate 2019-02-01 16:05:14 -03:00
Victor Shyba
25050fdeeb fixes for writers (check inside lock and dont hold verified bytes) 2019-02-01 16:05:14 -03:00
Jack Robison
dabd9cbe1e
faster stream manager startup 2019-02-01 13:53:03 -05:00
Jack Robison
2336015f9a
fix publish 
fixes https://github.com/lbryio/lbry/issues/1826
- remove `sources` argument from `publish`
- only add/update files we have
- delete existing stream if updating with a new one
 2019-02-01 13:35:18 -05:00
Jack Robison
31445c7797
remove lock from PeerManager 2019-01-31 20:57:48 -05:00
Jack Robison
87f5d1bd4a
fix updating claim with existing stream 2019-01-31 20:49:19 -05:00
Jack Robison
2e9acd1baa
remove blob request asyncio.Lock 2019-01-31 20:19:50 -05:00
Jack Robison
df86937f4e
fix deleting a file mid download 2019-01-31 17:59:42 -05:00
Jack Robison
957d0290df
add torba logging 2019-01-31 16:53:54 -05:00
Jack Robison
40b90ce79b
fix hanging download 2019-01-31 16:53:27 -05:00
Jack Robison
aa7f0845cc
catch sendfile errors 2019-01-31 16:10:27 -05:00
Jack Robison
6e69d306de
tests 2019-01-31 15:39:23 -05:00
Jack Robison
d85d3dfaa4
increase default max_connections_per_download 2019-01-31 15:39:20 -05:00
Jack Robison
2b035009ef
handle both urls and ip addresses for fixed nodes and reflector servers 2019-01-31 15:39:20 -05:00
Jack Robison
f9fd62c214
add fixed peers immediately if the dht has no peers 2019-01-31 15:39:20 -05:00
Jack Robison
e8a1953815
add fixed peers immediately if dht is skipped 2019-01-31 15:39:20 -05:00
Jack Robison
34776e7eb9
fix test 2019-01-31 15:39:20 -05:00
Jack Robison
a4419f562f
pylint 2019-01-31 15:39:20 -05:00
Jack Robison
e60e5b3919
fix updating content claim for a file 
-fix file name and download dir not being hex encoded during publish, add repair script
 2019-01-31 15:39:20 -05:00
Jack Robison
3589cc9977
call update_reflected_stream upon reflector finishing 2019-01-31 15:39:20 -05:00
Jack Robison
2e978c00b2
prioritize peers to download from 2019-01-31 15:39:20 -05:00
Jack Robison
2335243de9
pylint 2019-01-31 15:39:20 -05:00
Jack Robison
6ad68eabd9
tests 2019-01-31 15:39:20 -05:00
Jack Robison
262b9a624b
update file_reflect 2019-01-31 15:39:20 -05:00
Jack Robison
05915c540a
set fully reflected if the server indicates it had all of the stream 2019-01-31 15:39:20 -05:00
Jack Robison
6aef6a80b7
refactor downloader 
split peer accumulation out, use Queues instead of locks
 2019-01-31 15:39:20 -05:00
Jack Robison
16efe9ba95
add fixed_peer_delay setting 2019-01-31 15:39:20 -05:00
Jack Robison
fcda9500fe
add accumulate_peers to Node 
simplifies collecting peers during a download by giving a queue of hashes to search for and a queue or peers as they are found
 2019-01-31 15:39:20 -05:00
Victor Shyba
5ee4b2173a fix probes bugs, partial DHT refactor 2019-01-31 01:49:52 -03:00
Victor Shyba
3e1c3d1e4b use node_id parameter instead of your own 2019-01-31 01:11:09 -03:00
Victor Shyba
21f2b2dcd7 cast timestamp to integer before querying 2019-01-31 01:09:57 -03:00
Jack Robison
ffc7fc0793
fix uncaught exception in BlobServerProtocol when client disconnects during a blob transfer 2019-01-30 12:03:05 -05:00
Victor Shyba
2e633c0ee6 fix chunked requests for server 2019-01-30 12:11:05 -03:00
Jack Robison
933d58d49b
logging 2019-01-29 20:47:02 -05:00
Jack Robison
8f7cf0b38f
verbose logging 2019-01-29 13:08:11 -05:00
Jack Robison
418def56ac
fix log 2019-01-28 22:38:17 -05:00
Jack Robison
cefe3eb520
fix file_delete 2019-01-28 22:01:43 -05:00
Jack Robison
64dffa306f
logging, cleanup 2019-01-28 22:01:43 -05:00
Jack Robison
7d33b4f1f3
fix unawaited task 2019-01-28 22:01:43 -05:00
Jack Robison
f507d95198
always add fixed peers if configured after 2s 2019-01-28 22:01:43 -05:00
Jack Robison
2a7d80f8b4
logging 2019-01-28 22:01:43 -05:00
Jack Robison
bfaebf0085
fix timeout error 2019-01-28 17:20:14 -05:00
Jack Robison
71f9f8ae9c
fix race condition in reflector server 2019-01-28 16:51:11 -05:00
Jack Robison
330862e487
fix https://github.com/lbryio/lbry/issues/1297 2019-01-28 16:00:37 -05:00
Jack Robison
778d3826ab
clean up settings and use them 2019-01-28 15:51:27 -05:00
Jack Robison
4a11cf007f
remove unused settings and constants 2019-01-27 19:51:44 -05:00
Jack Robison
573285a5bb
fix error encoding find value response 2019-01-26 17:04:11 -05:00
Lex Berezhny
60ed4e503f refactored settings_set to support all settings 2019-01-26 00:04:36 -05:00
Lex Berezhny
aa1405887e use float instead of decimal for now 2019-01-25 23:20:43 -05:00
Lex Berezhny
cced217e43 update doc format for max_key_fee 2019-01-25 23:20:43 -05:00
Lex Berezhny
8a3b8d2df1 max_key_fee in yaml as null 2019-01-25 23:20:43 -05:00
Lex Berezhny
be0bd3bdea refactored --max-key-fee to be more ergonomic 2019-01-25 23:20:43 -05:00
Lex Berezhny
e01c73a7f8 pylint 2019-01-25 21:00:20 -05:00
Lex Berezhny
134338db4b dropped help, commands and resolve_name commands 2019-01-25 21:00:20 -05:00
Lex Berezhny
f47a685734 help message for start command 2019-01-25 20:28:47 -05:00
Lex Berezhny
6e29f7e99b user is shown help when typing lbrynet help 2019-01-25 20:28:47 -05:00
Lex Berezhny
a55802c1de v0.31.0rc3 2019-01-25 17:05:38 -05:00
Jack Robison
a7610e3d34
async reflector 2019-01-25 16:10:17 -05:00
Jack Robison
69bcb052de
fix blob server protocol factory 2019-01-25 13:10:40 -05:00
Lex Berezhny
b7d62ca084 v0.31.0rc2 2019-01-25 10:46:20 -05:00
Jack Robison
fa97f7bd38 fix written_bytes error 2019-01-25 10:23:03 -05:00
Lex Berezhny
4a35247016 fixes for toggle config, passing servers as list, etc 2019-01-25 10:19:24 -05:00
Lex Berezhny
d0526ad7d5 bring --config back to start command 2019-01-25 10:19:24 -05:00
Lex Berezhny
19b529cf38 removed unused import 2019-01-25 10:19:24 -05:00
Lex Berezhny
0373196707 max_key_fee is plain YAML now 2019-01-25 10:19:24 -05:00
Lex Berezhny
7a601db23f cli fixup 2019-01-25 10:19:24 -05:00
Jack Robison
77ece96356
fix config error if $HOME is None 
-not seen on travis due to HOME being manually set to /tmp
 2019-01-24 12:42:55 -05:00
Lex Berezhny
80440fd6bd v0.31.0rc1 2019-01-24 00:13:55 -05:00
Lex Berezhny
79e4767f69 unused imports 2019-01-24 00:13:15 -05:00
Lex Berezhny
0ee279bfd7 fix startup/shutdown and file_list --full-status argument 2019-01-24 00:13:15 -05:00
Lex Berezhny
5249d2a3ca removed unused methods 2019-01-24 00:13:15 -05:00
Lex Berezhny
4d5823f473 distro package is in setup.py, does not make sense to wrap it in try/except ModuleNotFoundError 2019-01-24 00:13:15 -05:00
Lex Berezhny
2dcd187d69 fixed component manager tests 2019-01-24 00:13:15 -05:00
Lex Berezhny
3d9ea92118 remove unnecessary logger configuration for BitcoinRPC 2019-01-24 00:13:15 -05:00
Lex Berezhny
3b61222e5a pylint 2019-01-24 00:13:15 -05:00
Lex Berezhny
2ca438c36e passing integration tests 2019-01-24 00:13:15 -05:00
Jack Robison
8948d5be86 don't shut down immediately after startup 2019-01-24 00:13:15 -05:00
Jack Robison
a3e64f9cef remove dht requirement from stream manager component 2019-01-24 00:13:15 -05:00
Jack Robison
09afec1961 import 2019-01-24 00:13:15 -05:00
Jack Robison
f9c465a636 f string 2019-01-24 00:13:15 -05:00
Jack Robison
89efe3d1b9 minimal changes to cli.py 2019-01-24 00:13:15 -05:00
Jack Robison
94cec1b86d fix 2019-01-24 00:13:15 -05:00
Jack Robison
d62ac0b608 KeyboardInterrupt 2019-01-24 00:13:15 -05:00
Jack Robison
5596eac930 merge conflicts 2019-01-24 00:13:15 -05:00
Jack Robison
5bb94d744e storage 2019-01-24 00:13:15 -05:00
Jack Robison
494917158c update daemon and components 2019-01-24 00:13:15 -05:00
Jack Robison
34a409ade5 delete log_support, looping_call_manager, and compat 2019-01-24 00:13:15 -05:00
Jack Robison
273e614715 delete old reflector code 2019-01-24 00:13:15 -05:00
Jack Robison
db75f0baef update SQLiteStorage 2019-01-24 00:13:15 -05:00
Jack Robison
30689bbf8d update/add config 
remove the following settings:
  peer_search_timeout
  sd_download_timeout
  run_reflector_server
  download_mirrors
  pointtrader_server

add the following settings:
  blob_download_timeout
  peer_connect_timeout
  node_rpc_timeout
 2019-01-24 00:13:15 -05:00
Jack Robison
4bf7742c19 async lbrynet.stream 2019-01-24 00:13:15 -05:00
Jack Robison
69b259c285 async lbrynet.blob_exchange 2019-01-24 00:13:15 -05:00
Jack Robison
2fa5233796 async lbrynet.dht 2019-01-24 00:13:15 -05:00
Jack Robison
a5524d490c async lbrynet.blob 2019-01-24 00:13:15 -05:00
Jack Robison
c713fac2d9 lbrynet.error 2019-01-24 00:13:15 -05:00
Lex Berezhny
7a038bbb98 cli bug fixes 2019-01-23 13:25:10 -05:00
Victor Shyba
eba88c1df7 fix resolve for undecodeable claims 2019-01-23 13:22:23 -05:00
Victor Shyba
881e5aba68 simplify claim_list 2019-01-23 13:22:23 -05:00
Victor Shyba
368f0683ec fix claim_list for channels 2019-01-23 09:36:27 -05:00
Lex Berezhny
8593cd362a check darwin before windows because darwin has win, face plam! 2019-01-22 18:04:17 -05:00
Lex Berezhny
83c7797187 pylint 2019-01-22 18:04:17 -05:00
Lex Berezhny
6606deafa5 fixed after testing with desktop app 2019-01-22 18:04:17 -05:00
Lex Berezhny
19b0d59159 config options api_host and api_port changed to just api 2019-01-22 18:04:17 -05:00
Lex Berezhny
9ccb3fa2a3 unit/test_cli tests 2019-01-22 18:04:17 -05:00
Lex Berezhny
48533df523 fix integration tests 2019-01-22 18:04:17 -05:00
Lex Berezhny
d5f2832b2f pylint 2019-01-22 18:04:17 -05:00
Lex Berezhny
d0230b4893 command line fixes 2019-01-22 18:04:17 -05:00
Lex Berezhny
7a28171a72 conf no longer global 2019-01-22 18:04:17 -05:00
Lex Berezhny
150bcb1116 new configuration manager, first pass 2019-01-22 18:04:17 -05:00
Jack Robison
3a86fc6680
refactor exchange rate manager to use asyncio 2019-01-22 11:34:49 -05:00
Jack Robison
2805cbb331 refactor loggly handler to use asyncio 2019-01-22 10:52:50 -05:00
Lex Berezhny
bf8e32ebd2 remove custom logging 2019-01-19 16:30:19 -05:00
Lex Berezhny
5971be5bef v0.30.5 2019-01-18 16:14:48 -05:00
Lex Berezhny
677d76a3e4 v0.30.5rc4 2019-01-17 23:26:12 -05:00
Victor Shyba
6ed3207cb7 phase1: legacy claim format, ability to decode new format 2019-01-17 23:24:58 -05:00
Victor Shyba
be6448b74f fix str/bytes confusion from resolve/claimdict on certificate_id 2019-01-17 23:24:58 -05:00
Victor Shyba
b707ee4844 encode and decode detached signatures from claim dict 2019-01-17 23:24:58 -05:00
Victor Shyba
0e9888be3b fixes from review 2019-01-17 23:24:58 -05:00
Victor Shyba
3c54b2bcd7 activate detached sigs 2019-01-17 23:24:58 -05:00
Victor Shyba
899b182811 fix getclaimsfortx in server 2019-01-17 23:24:58 -05:00
Victor Shyba
abf94357eb tests and fixes for sig validation on undecode-able claims 2019-01-17 23:24:58 -05:00
Victor Shyba
36aded3830 store original payload for signing and verifying 2019-01-17 23:24:58 -05:00
Victor Shyba
d7ebf50602 detached as a parameter instead of class attribute 2019-01-17 23:24:58 -05:00
Victor Shyba
523c4c86a9 change default curve to SECP256k1, pass name parameter 2019-01-17 23:24:58 -05:00
Victor Shyba
74cccdbfc7 simplify detached signing and verifying 2019-01-17 23:24:58 -05:00
Victor Shyba
70471eebfa wallet server and resolve working, functional test 2019-01-17 23:24:58 -05:00
Victor Shyba
fe97f7a119 adds a detached signature attribute to ClaimDict 2019-01-17 23:24:58 -05:00
Victor Shyba
f8ed605da2 adds a way to verify detached signatures 2019-01-17 23:24:58 -05:00
Victor Shyba
e38ef2af1f adds a way to sign detached 2019-01-17 23:24:58 -05:00
Victor Shyba
5d8e627d02 adds a separate representation for a detached signature 2019-01-17 23:24:58 -05:00
Lex Berezhny
c9d4ad5450 pylint unused import 2019-01-17 19:04:52 -05:00
Lex Berezhny
31586bf588 error out when user tries --http-auth 2019-01-17 19:04:52 -05:00
Lex Berezhny
974d3c83e3 keep wallet_balance to test deprecation with, until we find better way to do this 2019-01-17 17:35:15 -05:00
Lex Berezhny
8dc8ca382b removed previously deprecated commands 2019-01-17 17:35:15 -05:00
Lex Berezhny
1dbb250413 fix bytes vs str error in migrate5to6 script 2019-01-15 21:44:16 -05:00
Thomas Zarebczan
2c1b54c76c Add note about wallet needing to be unlocked (grin was confused about this) 2019-01-15 15:59:45 -05:00
Thomas Zarebczan
7314494fb9 add m4v 
It's a container type very similar to mp4. Someone recently added one in the community top bids section.
 2019-01-15 15:55:59 -05:00
hackrush
833261801f Profile downloading of sd blobs 2019-01-11 16:36:55 -05:00
hackrush
6c8cbc1b9e added additional fields to uri parser 2019-01-11 15:10:22 -05:00
Lex Berezhny
6ae4e68d1c looping_call shouldnt need to mess with cancellation 2019-01-11 14:33:45 -05:00
Oleg Silkin
d22a2dee33 Removes await from shutdown call 2019-01-11 14:33:45 -05:00
Oleg Silkin
b032e99dd1 Removes the twisted dependency from the analytics file and replaces it 
with `asyncio` and `aiohttp`. Also removes the calling loop from the
analytics in favor of a `dict` that stores the names of the methods
and their coroutines that are wrapped inside a looping task. The tasks
are canceled when the analytics manager is asked to shutdown

Signed-off-by: Oleg Silkin <o.silkin98@gmail.com>
 2019-01-11 14:33:45 -05:00
Lex Berezhny
fd7811f38d v0.30.5rc3 2019-01-11 01:17:43 -05:00
Lex Berezhny
950c122850 fix blob announce command argument constraints 2019-01-11 00:54:15 -05:00
Thomas Zarebczan
6c3eee0f0e Update conf.py 2019-01-10 23:50:59 -05:00
Thomas Zarebczan
4c23add193 fix unavailable download directory 
If an uploaded file had a directory that was removed, or if the old download directory doesn't exist, use the default.
 2019-01-10 23:05:43 -05:00
Lex Berezhny
248d1a18c7 pylint 2019-01-10 22:38:27 -05:00
Lex Berezhny
b0deb63129 blob_reflect fix 2019-01-10 22:38:27 -05:00
Lex Berezhny
ebdb33bd11 blob_availability fix 2019-01-10 22:38:27 -05:00
Lex Berezhny
69ccbda168 fixed error handling when calling commands 2019-01-10 22:38:27 -05:00
Lex Berezhny
a38643cca6 remove d2f from storage function call 2019-01-10 22:38:27 -05:00