Commit graph

3558 commits

Author SHA1 Message Date
Jack Robison
f2968aab22
add re-reflect task to stream manager, add concurrent_reflector_uploads to config 2019-02-01 22:59:41 -05:00
Jack Robison
ccbe8aa0eb
create data. download, and wallet directories if they don't exist on startup 2019-02-01 22:45:28 -05:00
Jack Robison
478f79353a
fix bytes error 2019-02-01 22:20:11 -05:00
Jack Robison
c3b0151943
fix dht status error during startup 2019-02-01 22:12:07 -05:00
Jack Robison
e96b75a0d0
fix file/download paths
move download-from-uri logic into stream manager
2019-02-01 21:40:35 -05:00
Jack Robison
efe4afd09e
fix blob announce time 2019-02-01 21:28:59 -05:00
Jack Robison
c7cb6822cc
logging 2019-02-01 21:28:59 -05:00
Jack Robison
c75665d3f0
update file_list docs, add blobs_remaining to file list args and to file dict result 2019-02-01 21:28:59 -05:00
Jack Robison
744375b2c0
re-assemble file / resume downloads 2019-02-01 21:28:59 -05:00
Victor Shyba
40da5b6cb6 rework data parser 2019-02-01 20:09:14 -03:00
Victor Shyba
b36cf3e36c remove closing peers from active connections 2019-02-01 20:09:14 -03:00
Jack Robison
0a08f445a4
close blob server transport on sendfile failing 2019-02-01 15:11:37 -05:00
Victor Shyba
f5bf1463af fixes from review 2019-02-01 17:09:37 -03:00
Victor Shyba
ca4a55ef28 set verified event earlier and remove stop awaits 2019-02-01 16:05:14 -03:00
Victor Shyba
832be0758b let cancel propagate 2019-02-01 16:05:14 -03:00
Victor Shyba
25050fdeeb fixes for writers (check inside lock and dont hold verified bytes) 2019-02-01 16:05:14 -03:00
Jack Robison
dabd9cbe1e
faster stream manager startup 2019-02-01 13:53:03 -05:00
Jack Robison
2336015f9a
fix publish
fixes https://github.com/lbryio/lbry/issues/1826
- remove `sources` argument from `publish`
- only add/update files we have
- delete existing stream if updating with a new one
2019-02-01 13:35:18 -05:00
Jack Robison
31445c7797
remove lock from PeerManager 2019-01-31 20:57:48 -05:00
Jack Robison
87f5d1bd4a
fix updating claim with existing stream 2019-01-31 20:49:19 -05:00
Jack Robison
2e9acd1baa
remove blob request asyncio.Lock 2019-01-31 20:19:50 -05:00
Jack Robison
df86937f4e
fix deleting a file mid download 2019-01-31 17:59:42 -05:00
Jack Robison
957d0290df
add torba logging 2019-01-31 16:53:54 -05:00
Jack Robison
40b90ce79b
fix hanging download 2019-01-31 16:53:27 -05:00
Jack Robison
aa7f0845cc
catch sendfile errors 2019-01-31 16:10:27 -05:00
Jack Robison
6e69d306de
tests 2019-01-31 15:39:23 -05:00
Jack Robison
d85d3dfaa4
increase default max_connections_per_download 2019-01-31 15:39:20 -05:00
Jack Robison
2b035009ef
handle both urls and ip addresses for fixed nodes and reflector servers 2019-01-31 15:39:20 -05:00
Jack Robison
f9fd62c214
add fixed peers immediately if the dht has no peers 2019-01-31 15:39:20 -05:00
Jack Robison
e8a1953815
add fixed peers immediately if dht is skipped 2019-01-31 15:39:20 -05:00
Jack Robison
34776e7eb9
fix test 2019-01-31 15:39:20 -05:00
Jack Robison
a4419f562f
pylint 2019-01-31 15:39:20 -05:00
Jack Robison
e60e5b3919
fix updating content claim for a file
-fix file name and download dir not being hex encoded during publish, add repair script
2019-01-31 15:39:20 -05:00
Jack Robison
3589cc9977
call update_reflected_stream upon reflector finishing 2019-01-31 15:39:20 -05:00
Jack Robison
2e978c00b2
prioritize peers to download from 2019-01-31 15:39:20 -05:00
Jack Robison
2335243de9
pylint 2019-01-31 15:39:20 -05:00
Jack Robison
6ad68eabd9
tests 2019-01-31 15:39:20 -05:00
Jack Robison
262b9a624b
update file_reflect 2019-01-31 15:39:20 -05:00
Jack Robison
05915c540a
set fully reflected if the server indicates it had all of the stream 2019-01-31 15:39:20 -05:00
Jack Robison
6aef6a80b7
refactor downloader
split peer accumulation out, use Queues instead of locks
2019-01-31 15:39:20 -05:00
Jack Robison
16efe9ba95
add fixed_peer_delay setting 2019-01-31 15:39:20 -05:00
Jack Robison
fcda9500fe
add accumulate_peers to Node
simplifies collecting peers during a download by giving a queue of hashes to search for and a queue or peers as they are found
2019-01-31 15:39:20 -05:00
Victor Shyba
5ee4b2173a fix probes bugs, partial DHT refactor 2019-01-31 01:49:52 -03:00
Victor Shyba
3e1c3d1e4b use node_id parameter instead of your own 2019-01-31 01:11:09 -03:00
Victor Shyba
21f2b2dcd7 cast timestamp to integer before querying 2019-01-31 01:09:57 -03:00
Jack Robison
ffc7fc0793
fix uncaught exception in BlobServerProtocol when client disconnects during a blob transfer 2019-01-30 12:03:05 -05:00
Victor Shyba
2e633c0ee6 fix chunked requests for server 2019-01-30 12:11:05 -03:00
Jack Robison
933d58d49b
logging 2019-01-29 20:47:02 -05:00
Jack Robison
8f7cf0b38f
verbose logging 2019-01-29 13:08:11 -05:00
Jack Robison
418def56ac
fix log 2019-01-28 22:38:17 -05:00
Jack Robison
cefe3eb520
fix file_delete 2019-01-28 22:01:43 -05:00
Jack Robison
64dffa306f
logging, cleanup 2019-01-28 22:01:43 -05:00
Jack Robison
7d33b4f1f3
fix unawaited task 2019-01-28 22:01:43 -05:00
Jack Robison
f507d95198
always add fixed peers if configured after 2s 2019-01-28 22:01:43 -05:00
Jack Robison
2a7d80f8b4
logging 2019-01-28 22:01:43 -05:00
Jack Robison
bfaebf0085
fix timeout error 2019-01-28 17:20:14 -05:00
Jack Robison
71f9f8ae9c
fix race condition in reflector server 2019-01-28 16:51:11 -05:00
Jack Robison
330862e487
fix https://github.com/lbryio/lbry/issues/1297 2019-01-28 16:00:37 -05:00
Jack Robison
778d3826ab
clean up settings and use them 2019-01-28 15:51:27 -05:00
Jack Robison
4a11cf007f
remove unused settings and constants 2019-01-27 19:51:44 -05:00
Jack Robison
573285a5bb
fix error encoding find value response 2019-01-26 17:04:11 -05:00
Lex Berezhny
60ed4e503f refactored settings_set to support all settings 2019-01-26 00:04:36 -05:00
Lex Berezhny
aa1405887e use float instead of decimal for now 2019-01-25 23:20:43 -05:00
Lex Berezhny
cced217e43 update doc format for max_key_fee 2019-01-25 23:20:43 -05:00
Lex Berezhny
8a3b8d2df1 max_key_fee in yaml as null 2019-01-25 23:20:43 -05:00
Lex Berezhny
be0bd3bdea refactored --max-key-fee to be more ergonomic 2019-01-25 23:20:43 -05:00
Lex Berezhny
e01c73a7f8 pylint 2019-01-25 21:00:20 -05:00
Lex Berezhny
134338db4b dropped help, commands and resolve_name commands 2019-01-25 21:00:20 -05:00
Lex Berezhny
f47a685734 help message for start command 2019-01-25 20:28:47 -05:00
Lex Berezhny
6e29f7e99b user is shown help when typing lbrynet help 2019-01-25 20:28:47 -05:00
Lex Berezhny
a55802c1de v0.31.0rc3 2019-01-25 17:05:38 -05:00
Jack Robison
a7610e3d34
async reflector 2019-01-25 16:10:17 -05:00
Jack Robison
69bcb052de
fix blob server protocol factory 2019-01-25 13:10:40 -05:00
Lex Berezhny
b7d62ca084 v0.31.0rc2 2019-01-25 10:46:20 -05:00
Jack Robison
fa97f7bd38 fix written_bytes error 2019-01-25 10:23:03 -05:00
Lex Berezhny
4a35247016 fixes for toggle config, passing servers as list, etc 2019-01-25 10:19:24 -05:00
Lex Berezhny
d0526ad7d5 bring --config back to start command 2019-01-25 10:19:24 -05:00
Lex Berezhny
19b529cf38 removed unused import 2019-01-25 10:19:24 -05:00
Lex Berezhny
0373196707 max_key_fee is plain YAML now 2019-01-25 10:19:24 -05:00
Lex Berezhny
7a601db23f cli fixup 2019-01-25 10:19:24 -05:00
Jack Robison
77ece96356
fix config error if $HOME is None
-not seen on travis due to HOME being manually set to /tmp
2019-01-24 12:42:55 -05:00
Lex Berezhny
80440fd6bd v0.31.0rc1 2019-01-24 00:13:55 -05:00
Lex Berezhny
79e4767f69 unused imports 2019-01-24 00:13:15 -05:00
Lex Berezhny
0ee279bfd7 fix startup/shutdown and file_list --full-status argument 2019-01-24 00:13:15 -05:00
Lex Berezhny
5249d2a3ca removed unused methods 2019-01-24 00:13:15 -05:00
Lex Berezhny
4d5823f473 distro package is in setup.py, does not make sense to wrap it in try/except ModuleNotFoundError 2019-01-24 00:13:15 -05:00
Lex Berezhny
2dcd187d69 fixed component manager tests 2019-01-24 00:13:15 -05:00
Lex Berezhny
3d9ea92118 remove unnecessary logger configuration for BitcoinRPC 2019-01-24 00:13:15 -05:00
Lex Berezhny
3b61222e5a pylint 2019-01-24 00:13:15 -05:00
Lex Berezhny
2ca438c36e passing integration tests 2019-01-24 00:13:15 -05:00
Jack Robison
8948d5be86 don't shut down immediately after startup 2019-01-24 00:13:15 -05:00
Jack Robison
a3e64f9cef remove dht requirement from stream manager component 2019-01-24 00:13:15 -05:00
Jack Robison
09afec1961 import 2019-01-24 00:13:15 -05:00
Jack Robison
f9c465a636 f string 2019-01-24 00:13:15 -05:00
Jack Robison
89efe3d1b9 minimal changes to cli.py 2019-01-24 00:13:15 -05:00
Jack Robison
94cec1b86d fix 2019-01-24 00:13:15 -05:00
Jack Robison
d62ac0b608 KeyboardInterrupt 2019-01-24 00:13:15 -05:00
Jack Robison
5596eac930 merge conflicts 2019-01-24 00:13:15 -05:00
Jack Robison
5bb94d744e storage 2019-01-24 00:13:15 -05:00
Jack Robison
494917158c update daemon and components 2019-01-24 00:13:15 -05:00
Jack Robison
34a409ade5 delete log_support, looping_call_manager, and compat 2019-01-24 00:13:15 -05:00
Jack Robison
273e614715 delete old reflector code 2019-01-24 00:13:15 -05:00
Jack Robison
db75f0baef update SQLiteStorage 2019-01-24 00:13:15 -05:00
Jack Robison
30689bbf8d update/add config
remove the following settings:
  peer_search_timeout
  sd_download_timeout
  run_reflector_server
  download_mirrors
  pointtrader_server

add the following settings:
  blob_download_timeout
  peer_connect_timeout
  node_rpc_timeout
2019-01-24 00:13:15 -05:00
Jack Robison
4bf7742c19 async lbrynet.stream 2019-01-24 00:13:15 -05:00
Jack Robison
69b259c285 async lbrynet.blob_exchange 2019-01-24 00:13:15 -05:00
Jack Robison
2fa5233796 async lbrynet.dht 2019-01-24 00:13:15 -05:00
Jack Robison
a5524d490c async lbrynet.blob 2019-01-24 00:13:15 -05:00
Jack Robison
c713fac2d9 lbrynet.error 2019-01-24 00:13:15 -05:00
Lex Berezhny
7a038bbb98 cli bug fixes 2019-01-23 13:25:10 -05:00
Victor Shyba
eba88c1df7 fix resolve for undecodeable claims 2019-01-23 13:22:23 -05:00
Victor Shyba
881e5aba68 simplify claim_list 2019-01-23 13:22:23 -05:00
Victor Shyba
368f0683ec fix claim_list for channels 2019-01-23 09:36:27 -05:00
Lex Berezhny
8593cd362a check darwin before windows because darwin has win, face plam! 2019-01-22 18:04:17 -05:00
Lex Berezhny
83c7797187 pylint 2019-01-22 18:04:17 -05:00
Lex Berezhny
6606deafa5 fixed after testing with desktop app 2019-01-22 18:04:17 -05:00
Lex Berezhny
19b0d59159 config options api_host and api_port changed to just api 2019-01-22 18:04:17 -05:00
Lex Berezhny
9ccb3fa2a3 unit/test_cli tests 2019-01-22 18:04:17 -05:00
Lex Berezhny
48533df523 fix integration tests 2019-01-22 18:04:17 -05:00
Lex Berezhny
d5f2832b2f pylint 2019-01-22 18:04:17 -05:00
Lex Berezhny
d0230b4893 command line fixes 2019-01-22 18:04:17 -05:00
Lex Berezhny
7a28171a72 conf no longer global 2019-01-22 18:04:17 -05:00
Lex Berezhny
150bcb1116 new configuration manager, first pass 2019-01-22 18:04:17 -05:00
Jack Robison
3a86fc6680
refactor exchange rate manager to use asyncio 2019-01-22 11:34:49 -05:00
Jack Robison
2805cbb331 refactor loggly handler to use asyncio 2019-01-22 10:52:50 -05:00
Lex Berezhny
bf8e32ebd2 remove custom logging 2019-01-19 16:30:19 -05:00
Lex Berezhny
5971be5bef v0.30.5 2019-01-18 16:14:48 -05:00
Lex Berezhny
677d76a3e4 v0.30.5rc4 2019-01-17 23:26:12 -05:00
Victor Shyba
6ed3207cb7 phase1: legacy claim format, ability to decode new format 2019-01-17 23:24:58 -05:00
Victor Shyba
be6448b74f fix str/bytes confusion from resolve/claimdict on certificate_id 2019-01-17 23:24:58 -05:00
Victor Shyba
b707ee4844 encode and decode detached signatures from claim dict 2019-01-17 23:24:58 -05:00
Victor Shyba
0e9888be3b fixes from review 2019-01-17 23:24:58 -05:00
Victor Shyba
3c54b2bcd7 activate detached sigs 2019-01-17 23:24:58 -05:00
Victor Shyba
899b182811 fix getclaimsfortx in server 2019-01-17 23:24:58 -05:00
Victor Shyba
abf94357eb tests and fixes for sig validation on undecode-able claims 2019-01-17 23:24:58 -05:00
Victor Shyba
36aded3830 store original payload for signing and verifying 2019-01-17 23:24:58 -05:00
Victor Shyba
d7ebf50602 detached as a parameter instead of class attribute 2019-01-17 23:24:58 -05:00
Victor Shyba
523c4c86a9 change default curve to SECP256k1, pass name parameter 2019-01-17 23:24:58 -05:00
Victor Shyba
74cccdbfc7 simplify detached signing and verifying 2019-01-17 23:24:58 -05:00
Victor Shyba
70471eebfa wallet server and resolve working, functional test 2019-01-17 23:24:58 -05:00
Victor Shyba
fe97f7a119 adds a detached signature attribute to ClaimDict 2019-01-17 23:24:58 -05:00
Victor Shyba
f8ed605da2 adds a way to verify detached signatures 2019-01-17 23:24:58 -05:00
Victor Shyba
e38ef2af1f adds a way to sign detached 2019-01-17 23:24:58 -05:00
Victor Shyba
5d8e627d02 adds a separate representation for a detached signature 2019-01-17 23:24:58 -05:00
Lex Berezhny
c9d4ad5450 pylint unused import 2019-01-17 19:04:52 -05:00
Lex Berezhny
31586bf588 error out when user tries --http-auth 2019-01-17 19:04:52 -05:00
Lex Berezhny
974d3c83e3 keep wallet_balance to test deprecation with, until we find better way to do this 2019-01-17 17:35:15 -05:00
Lex Berezhny
8dc8ca382b removed previously deprecated commands 2019-01-17 17:35:15 -05:00
Lex Berezhny
1dbb250413 fix bytes vs str error in migrate5to6 script 2019-01-15 21:44:16 -05:00
Thomas Zarebczan
2c1b54c76c Add note about wallet needing to be unlocked (grin was confused about this) 2019-01-15 15:59:45 -05:00
Thomas Zarebczan
7314494fb9 add m4v
It's a container type very similar to mp4. Someone recently added one in the community top bids section.
2019-01-15 15:55:59 -05:00
hackrush
833261801f Profile downloading of sd blobs 2019-01-11 16:36:55 -05:00
hackrush
6c8cbc1b9e added additional fields to uri parser 2019-01-11 15:10:22 -05:00
Lex Berezhny
6ae4e68d1c looping_call shouldnt need to mess with cancellation 2019-01-11 14:33:45 -05:00
Oleg Silkin
d22a2dee33 Removes await from shutdown call 2019-01-11 14:33:45 -05:00
Oleg Silkin
b032e99dd1 Removes the twisted dependency from the analytics file and replaces it
with `asyncio` and `aiohttp`. Also removes the calling loop from the
analytics in favor of a `dict` that stores the names of the methods
and their coroutines that are wrapped inside a looping task. The tasks
are canceled when the analytics manager is asked to shutdown

Signed-off-by: Oleg Silkin <o.silkin98@gmail.com>
2019-01-11 14:33:45 -05:00
Lex Berezhny
fd7811f38d v0.30.5rc3 2019-01-11 01:17:43 -05:00
Lex Berezhny
950c122850 fix blob announce command argument constraints 2019-01-11 00:54:15 -05:00
Thomas Zarebczan
6c3eee0f0e Update conf.py 2019-01-10 23:50:59 -05:00
Thomas Zarebczan
4c23add193 fix unavailable download directory
If an uploaded file had a directory that was removed, or if the old download directory doesn't exist, use the default.
2019-01-10 23:05:43 -05:00
Lex Berezhny
248d1a18c7 pylint 2019-01-10 22:38:27 -05:00
Lex Berezhny
b0deb63129 blob_reflect fix 2019-01-10 22:38:27 -05:00
Lex Berezhny
ebdb33bd11 blob_availability fix 2019-01-10 22:38:27 -05:00
Lex Berezhny
69ccbda168 fixed error handling when calling commands 2019-01-10 22:38:27 -05:00
Lex Berezhny
a38643cca6 remove d2f from storage function call 2019-01-10 22:38:27 -05:00
Alex Grintsvayg
8a5f3842fc fix media type for files without extension 2019-01-10 10:22:37 -05:00
Lex Berezhny
db3e578bcd v0.30.5rc2 2019-01-08 23:56:07 -05:00
Lex Berezhny
76fbaac658 do not log aiohttp.access 2019-01-08 23:54:32 -05:00
hackrush
c4fac29ecb actually get the certificate_id 2019-01-08 23:45:20 -05:00
Lex Berezhny
33392b3351 migration fix 2019-01-08 23:15:25 -05:00
Alex Grintsvayg
a930ca0631 if media type is not listed, default to a type that includes the file extension 2019-01-08 16:06:44 -05:00
Lex Berezhny
63a7271008 v0.30.5rc1 2019-01-07 22:15:37 -05:00
Lex Berezhny
5ca0ebcbb2 store loop on storage 2019-01-07 21:56:05 -05:00
Lex Berezhny
2c84b7a7dd get_running_loop() -> get_event_loop() 2019-01-07 21:56:05 -05:00
Lex Berezhny
71a0c704bd storage.clock.seconds() -> asyncio.get_running_loop().time() 2019-01-07 21:56:05 -05:00
Lex Berezhny
d30e7cd29e use loop.time() instead of reactor.seconds() in SQLite storage 2019-01-07 21:56:05 -05:00
Lex Berezhny
aeb7c6fe76 pylint, removed unused import 2019-01-07 21:56:05 -05:00
Lex Berezhny
134c20da93 stream cost estimate command refactor 2019-01-07 21:56:05 -05:00
Lex Berezhny
893b4fc3ca fixes 2019-01-07 21:56:05 -05:00
Lex Berezhny
9b27e81940 fix logging 2019-01-07 21:56:05 -05:00
Lex Berezhny
7be53ad692 more bug fixes 2019-01-07 21:56:05 -05:00
Lex Berezhny
16e596ec87 lots o bugs fixed discovered while using desktop app 2019-01-07 21:56:05 -05:00
Lex Berezhny
3fdcb80960 minor test fixes 2019-01-07 21:56:05 -05:00
Lex Berezhny
26a3221bac hash announcer fix 2019-01-07 21:56:05 -05:00
Lex Berezhny
b5340505e5 fix blobmanager tests and dont run conf tests 2019-01-07 21:56:05 -05:00
Lex Berezhny
4bb8129bb7 fixing tests to work with asyncio daemon 2019-01-07 21:56:05 -05:00
Lex Berezhny
86fb99a37c fully asyncio daemon api 2019-01-07 21:56:05 -05:00
Lex Berezhny
6c52450858 temporary module providing d2f and f2d for converting between twisted and asyncio 2019-01-07 21:56:05 -05:00
Lex Berezhny
fb4e94b04a asyncifying minimal amount of the old blob/p2p code 2019-01-07 21:56:05 -05:00
Lex Berezhny
248baf58b4 asyncio daemon 2019-01-07 21:56:05 -05:00
Lex Berezhny
0845d65f4e rebase master 2019-01-07 21:56:05 -05:00
Lex Berezhny
dcc5415648 v0.30.4 2019-01-04 22:03:39 -05:00
Lex Berezhny
3c38a88b22 v0.30.4rc2 2019-01-04 11:53:54 -05:00
Victor Shyba
049c17ff08 adds testenet to wallet server 2019-01-04 11:10:52 -05:00
Thomas Zarebczan
8de97bb441 Add lbrynet4 dht seed node (#1734)
added `lbrynet4.lbry.io` to list of default DHT nodes
2019-01-04 11:07:02 -05:00
Lex Berezhny
97c0092923 v0.30.4rc1 2019-01-04 03:14:56 -05:00
Lex Berezhny
e65e1fb5a2 added utxo_release command 2019-01-04 03:14:37 -05:00
Victor Shyba
20dd1e55f5 fix data_dir parameter parsing 2019-01-04 01:25:35 -05:00
Lex Berezhny
6aa709e34e v0.30.3 2018-12-21 18:45:34 -05:00
Lex Berezhny
e73f121c08 v0.30.3rc1 2018-12-19 09:12:56 -05:00