LBRYCommunity/lbry-sdk
1
0
Fork 1
Code Issues Pull requests Projects Releases 282 Packages Wiki Activity
5733 commits 110 branches 641 tags 31 MiB
Commit graph

3979 commits

Author SHA1 Message Date
Victor Shyba
e1a6b4e3d6 fix dict handling mistake 2019-04-20 01:19:40 -04:00
Victor Shyba
911ca8c37e cache and share txs fetches while validating concurrently on batches 2019-04-20 01:19:40 -04:00
ポール ウェッブ
a63442f843 Fixes and updated gitignore 2019-04-12 11:53:37 -04:00
Oleg Silkin
b6a4589da5 Adds comment group to lbrynet with commands list and create 2019-04-07 15:27:59 -04:00
Oleg Silkin
fbbb0a9931 Adds server URL to configuration settings 2019-04-07 15:27:59 -04:00
Oleg Silkin
a94d65d522 Adds utility functions for making batch jsonrpc requests to comment server 2019-04-07 15:27:59 -04:00
Lex Berezhny
9af625e627 test fixes 2019-04-06 17:08:15 -04:00
Lex Berezhny
93220c3874 daemon json rpc return type docs 2019-04-06 17:08:15 -04:00
Lex Berezhny
362ed3f1c8 remove unused import 2019-04-06 17:08:15 -04:00
Lex Berezhny
6f76d9e24a moved integration testcase.py into lbrynet so that it can be used from scripts 2019-04-06 17:08:15 -04:00
Victor Shyba
fd56dc68cd fix depth on resolve, add tests 2019-04-05 09:40:26 -04:00
Victor Shyba
a0a810edc3 make permanent url name#claim_id on torba too 2019-04-05 09:40:26 -04:00
Victor Shyba
c1d3b5984d fix old hash reverse confusion 2019-04-05 09:40:26 -04:00
Victor Shyba
1fb719dd61 fix valid_at_height not being shown for name resolutions, which fixes tests 2019-04-05 09:40:26 -04:00
Victor Shyba
b87316fb02 make permanent url name#id only for now 2019-04-05 09:40:26 -04:00
Victor Shyba
65f3d78084 fix invalid signatures for missing certificates 2019-04-05 09:40:26 -04:00
Victor Shyba
3acabec4bb fixes from review 2019-04-03 00:51:05 -04:00
Victor Shyba
2e22473ce3 pylint and smaller fixes 2019-04-03 00:51:05 -04:00
Victor Shyba
0b0fd64642 further refactor resolve.py 2019-04-03 00:51:05 -04:00
Victor Shyba
ca17d8597d move resolve from ledger to resolve.py 2019-04-03 00:51:05 -04:00
Victor Shyba
d16e2716c8 handle invalid data 2019-04-03 00:51:05 -04:00
Thomas Zarebczan
021e30ffde fix: extension check 
disregard the first period, otherwise the `filename.` test fails.
 2019-04-01 22:56:40 -04:00
Thomas Zarebczan
eb2cd8fec1 stream type mapping 
Mapping extensions to stream types. I went with document / model / binary for the ones we were missing. This can be adjusted later on if not correct, but at least we'll have the main ones. Added extensions for lbry, cbz, cbr also.
 2019-04-01 22:56:40 -04:00
Lex Berezhny
ef7bd00f22 round USD fees to nearest penny 2019-03-31 18:14:13 -04:00
Lex Berezhny
3c1fdb5114 v0.35.0 2019-03-29 21:51:05 -04:00
Lex Berezhny
83411acfbd split claim_abandon into stream_abandon and channel_abandon 2019-03-29 21:48:55 -04:00
Lex Berezhny
7b57ba96dd fix docopt parsing and stream manager tests 2019-03-29 21:14:20 -04:00
Lex Berezhny
668840921f typo fix 2019-03-29 21:14:20 -04:00
Lex Berezhny
a3bd335f7f --languages, --locations fully support all attributes, add BTC 2019-03-29 21:14:20 -04:00
Lex Berezhny
4e6bca1389 support_abandon sends new --keep support to same address as the first support being abandoned 2019-03-29 21:14:20 -04:00
Lex Berezhny
c4b15920ff dont show supports to foreign address if the inputs are also foreign 2019-03-29 21:14:20 -04:00
Lex Berezhny
2a55e583e7 added to docstring that a channel_id is a channel claim id 2019-03-29 21:14:20 -04:00
Lex Berezhny
2c4fde06c5 --new-signing-key -> --new_signing_key 2019-03-29 21:14:20 -04:00
Lex Berezhny
eca83d7f47 --clear-tags -> --clear_tags 2019-03-29 21:14:20 -04:00
Lex Berezhny
87e818ac39 v0.35.0rc2 2019-03-27 22:20:09 -04:00
Lex Berezhny
5f8482bdb7 hash -> sd_hash, encoding fixes, update to new protobufs 2019-03-27 21:57:22 -04:00
Lex Berezhny
cd266477fb stop regenerating v1 protobufs 2019-03-27 21:57:22 -04:00
Lex Berezhny
7860b956ff fixes and tests for publish command 2019-03-27 21:57:22 -04:00
Thomas Zarebczan
148481a5ca doh 2019-03-27 21:54:19 -04:00
Thomas Zarebczan
93faa276a5 update BIP32 2019-03-27 21:54:19 -04:00
Victor Shyba
53e67a6e81 fixes from rebase 2019-03-27 10:31:37 -04:00
Victor Shyba
3ad6808d87 remove unused claim_id_hash 2019-03-27 10:31:37 -04:00
Victor Shyba
071ab32ab7 fix hash references 2019-03-27 10:31:37 -04:00
Victor Shyba
ab87588250 use torba parsing for addresses too, erase old code 2019-03-27 10:31:37 -04:00
Victor Shyba
22db29ee1d use torba tx parsing on wallet server 2019-03-27 10:31:37 -04:00
Lex Berezhny
66bf6c61f0 v0.35.0rc1 2019-03-25 23:57:59 -04:00
Lex Berezhny
9abf40d21f stream_type fix 2019-03-25 23:45:10 -04:00
Lex Berezhny
51bb8fd283 pylint 2019-03-25 22:54:08 -04:00
Lex Berezhny
183e3ac1c7 claim search 2019-03-25 22:54:08 -04:00
Lex Berezhny
8087b457c6 reorganized commands and finished support_abandon with --keep 2019-03-25 22:54:08 -04:00
Lex Berezhny
fedb7c23d0 bring back blocks_behind in wallet status 2019-03-25 22:54:08 -04:00
Lex Berezhny
c708c1db07 audio/video/image stream types 2019-03-25 22:54:08 -04:00
Lex Berezhny
2007c48af3 fixed tests for setting claim values 2019-03-25 22:54:08 -04:00
Lex Berezhny
0592cee567 claim integration test fixes 2019-03-25 22:54:08 -04:00
Lex Berezhny
814eaca524 cli tests fixed 2019-03-25 22:54:08 -04:00
Lex Berezhny
25436893bc pylint and a few other fixes 2019-03-25 22:54:08 -04:00
Lex Berezhny
5b9d41fd5c regeneate script after modifying protobufs 2019-03-25 22:54:08 -04:00
Victor Shyba
b1720d1659 fix setting sd hash 2019-03-25 22:54:08 -04:00
Lex Berezhny
4b3a6ab875 big support tests passes 2019-03-25 22:54:08 -04:00
Lex Berezhny
67dcede2d8 lots of stuff deleted 2019-03-25 22:54:08 -04:00
Lex Berezhny
af73e1a2f5 chris45 passing again 2019-03-25 22:54:08 -04:00
Lex Berezhny
c1fbb02bfe dont validate inputs in json_response_encoder 2019-03-25 22:54:08 -04:00
Lex Berezhny
d47575e8e0 progress 2019-03-25 22:54:08 -04:00
Victor Shyba
fe9aa666e9 fix name is not part of old sigs 2019-03-25 22:54:08 -04:00
Victor Shyba
a9e0eeba7e add tests and fix verification of old signatures 2019-03-25 22:54:08 -04:00
Victor Shyba
f2236eb7a4 resolve: check if there is a cert before fetching a tx 2019-03-25 22:54:08 -04:00
Lex Berezhny
df649341cd json output formatting fix for Claim 2019-03-25 22:54:08 -04:00
Lex Berezhny
ea09aca175 pylint fixes and ClaimDict->Claim 2019-03-25 22:54:08 -04:00
Lex Berezhny
ca92fddecf pylint 2019-03-25 22:54:08 -04:00
Lex Berezhny
8259d7c680 txo.claim_hash and other fixes related to proto3 refactor 2019-03-25 22:54:08 -04:00
Victor Shyba
6653da2973 all 2019-03-25 22:54:08 -04:00
Lex Berezhny
e74998209d for victor 2019-03-25 22:54:08 -04:00
Lex Berezhny
2bea0f697a pylint 2019-03-25 22:54:08 -04:00
Lex Berezhny
1d68bef6f2 client side pretty much done 2019-03-25 22:54:08 -04:00
Lex Berezhny
cd2b535afb moved claim signing to TXO 2019-03-25 22:54:08 -04:00
Lex Berezhny
9dfe7bbcf6 imports updated after moving lbrynet.extras.wallet to lbrynet.wallet 2019-03-25 22:54:08 -04:00
Lex Berezhny
120618ffd5 updated imports due to lbrynet.extras.wallet -> lbrynet.wallet move 2019-03-25 22:54:08 -04:00
Lex Berezhny
e8abcbb06e moved lbrynet.extras.wallet -> lbrynet.wallet 2019-03-25 22:54:08 -04:00
Lex Berezhny
1ec8f0b0b4 wip 2019-03-25 22:54:08 -04:00
Lex Berezhny
323694fb12 removed address.py 2019-03-25 22:54:08 -04:00
Lex Berezhny
d5e37acd8f minor Fee changes 2019-03-25 22:54:08 -04:00
Lex Berezhny
129a886f2b + fee.amount 2019-03-25 22:54:08 -04:00
Lex Berezhny
cd15230a92 getting close to a nice model 2019-03-25 22:54:08 -04:00
Lex Berezhny
c1b7fdc68e deleted bunch of stuff 2019-03-25 22:54:08 -04:00
Lex Berezhny
9fd67aaad6 removed legacy_schema_v1 2019-03-25 22:54:08 -04:00
Lex Berezhny
ce9dc1836e moved schema/current_schema/claim.py into schema/claim.py 2019-03-25 22:54:08 -04:00
Lex Berezhny
2e557d3a36 converted everyting in schema/legacy/* into schema/jsonschema.py 2019-03-25 22:54:08 -04:00
Lex Berezhny
5df05cb37e make schema.types a module 2019-03-25 22:54:08 -04:00
Lex Berezhny
326b62dc57 moved proto2/proto3 to types/v1 and types/v2 respectively 2019-03-25 22:54:08 -04:00
Lex Berezhny
25cc7ba284 updated schema to latest types: Claim uses oneof type for Channel/Stream 2019-03-25 22:54:08 -04:00
Victor Shyba
550f064302 baseschema 2019-03-25 22:54:08 -04:00
Victor Shyba
11086b93f1 migrate other fields 2019-03-25 22:54:08 -04:00
Victor Shyba
df5662136d migrate cert + adapt to latest types repo 2019-03-25 22:54:08 -04:00
Victor Shyba
291d65070d move common schema values to constants.py 2019-03-25 22:54:08 -04:00
Victor Shyba
9b64ee33dc fix imports: schema.schema -> schema.legacy_schema_v1 2019-03-25 22:54:08 -04:00
Victor Shyba
5404d26f2f schema.schema -> schema.legacy_schema_v1 2019-03-25 22:54:08 -04:00
Victor Shyba
26ade1f228 bump merged proto3 2019-03-25 22:54:08 -04:00
Victor Shyba
b49f1f1b54 fix imports 2019-03-25 22:54:08 -04:00
Victor Shyba
3bafa2ad22 regenerate protos 2019-03-25 22:54:08 -04:00
Victor Shyba
378ec44f3c update make to generate proto2 and proto3 2019-03-25 22:54:08 -04:00
Victor Shyba
9d0d17b422 rename proto proto2 2019-03-25 22:54:08 -04:00
Lex Berezhny
0de17730ca v0.34.0 2019-03-15 16:21:29 -04:00
Jack Robison
664f91bfab
add lbrynet.dht.protocol.distance unit tests 2019-03-15 12:44:41 -04:00
Jack Robison
6565ca8558
improve lbrynet.dht.serialization unit tests 2019-03-14 18:45:56 -04:00
Jack Robison
3b0ba3e534 v0.34.0rc2 2019-03-14 16:03:39 -04:00
Jack Robison
c9b2829227
fix/test fixed_peer_delay and added_fixed_peers 2019-03-14 15:08:26 -04:00
Jack Robison
4f2f8b16f3
fix pending downloads not being removed 2019-03-14 13:52:00 -04:00
Jack Robison
2ab2b846b1
fix default download timeout not being set 2019-03-14 13:07:11 -04:00
Jack Robison
ab5d71ff61
fix the time to the head blob including the time to the sd blob in analytics 2019-03-13 16:24:23 -04:00
Lex Berezhny
99b289f135 v0.34.0rc1 2019-03-12 20:29:10 -04:00
Lex Berezhny
98d8b7d463 sync uses new apply APIs in torba 2019-03-12 20:22:41 -04:00
Lex Berezhny
96f1883fc4 check modified_on 2019-03-12 20:22:41 -04:00
Lex Berezhny
a914de155a working sync 2019-03-12 20:22:41 -04:00
Lex Berezhny
2dee0ff0bf wip account manifest command 2019-03-12 20:22:41 -04:00
Jack Robison
993cb43e5b fix tests 
-fix cleanup of a failed download
 2019-03-12 20:22:01 -04:00
Jack Robison
5d212a0f82 time to first bytes analytics 2019-03-12 20:22:01 -04:00
Victor Shyba
f390ff144d
handle sigint 2019-03-12 13:43:12 -04:00
Jack Robison
4cbde1b08f
use _batched_select to populate channel names when initializing files 2019-03-12 09:58:19 -04:00
Lex Berezhny
c6740d8d70 v0.33.0 2019-03-08 20:00:45 -05:00
Lex Berezhny
46358142ed v0.33.0rc1 2019-03-06 22:18:04 -05:00
Brannon King
c326a9382c changed to pull down the newer lbrycrd 2019-03-05 09:32:43 -05:00
Brannon King
5bdd87c904 removed name-to-claim lookup table 
added unit test for Greek and made it work


pylint: revert bad move


revert claim_sequence changes


fixed broken test
 2019-03-05 09:32:43 -05:00
Jack Robison
ad134fe8bb v0.32.4 2019-03-01 17:24:55 -05:00
Jack Robison
2f3c616acd v0.32.4rc1 2019-03-01 16:33:59 -05:00
Jack Robison
e38a0f7a95
logging 2019-03-01 15:26:45 -05:00
Jack Robison
9de3f3ff09
don't block on sending download analytics events 2019-03-01 15:22:19 -05:00
Jack Robison
df8934d472
restore old download analytics and update tests 2019-03-01 14:50:06 -05:00
Jack Robison
d97d978961
use certifi for all operating systems 2019-02-28 12:45:56 -05:00
Jack Robison
f52e44b56a
typing 2019-02-28 12:42:23 -05:00
Jack Robison
10d73fe480
use certifi 2019-02-28 12:40:11 -05:00
Jack Robison
d95903d219
update aiohttp and pylint 2019-02-28 12:04:07 -05:00
Victor Shyba
e047748961
log dropped api request instead of stack trace 2019-02-26 17:42:45 -05:00
Victor Shyba
9f071bbe36
pylint 2019-02-26 17:42:45 -05:00
Victor Shyba
2d8ebe25ed
refactor so we can stop trapping CancelledError everywhere 2019-02-26 17:42:45 -05:00
Victor Shyba
7a96e742f2
stop trapping CancelledError 2019-02-26 17:42:45 -05:00
Victor Shyba
e8c9abb944
add LRU to KademliaPeer creation 2019-02-26 09:42:32 -05:00
Thomas Zarebczan
2a82ff7cc5
Update mime_types.py 2019-02-22 11:11:10 -05:00
Jack Robison
673b958020 v0.32.3 2019-02-21 19:38:14 -05:00
Victor Shyba
b834f29634 nullify length on blob delete 2019-02-21 21:00:28 -03:00
Victor Shyba
fcdd9295b4 delete upon failing to decode JSON from sd blob 2019-02-21 20:53:21 -03:00
Victor Shyba
4e7d88311f raise proper exception on undecode-able blobs 2019-02-21 20:42:51 -03:00
Jack Robison
690e2e7e0c v0.32.3rc1 2019-02-21 18:37:19 -05:00
Jack Robison
fc64d8d1a8
fix slow ping queue shutdown 2019-02-21 17:44:02 -05:00
Jack Robison
7fe9513857 v0.32.2 2019-02-21 14:46:36 -05:00
Jack Robison
e76107c318 v0.32.2rc3 2019-02-21 14:28:13 -05:00
Jack Robison
3868dea819
don't join buckets if there is only one 2019-02-21 14:18:48 -05:00
Jack Robison
03cd6b7200
fix cases where buckets could be unjoined after removing a peer 2019-02-21 13:53:35 -05:00
Jack Robison
6915a7a553 v0.32.2rc2 2019-02-21 13:16:32 -05:00
Jack Robison
4294bf742d
simplify/fix ping queue 2019-02-21 13:00:23 -05:00
Jack Robison
e260de59f1
fix updating/setting contact triple 2019-02-21 10:50:11 -05:00
Jack Robison
154702e6dd
fix KBucket.add_peer 2019-02-21 10:50:11 -05:00
Victor Shyba
59325ad8c1 fix delete log 2019-02-20 17:04:08 -03:00
Jack Robison
ee12985135
dont ping outselves 2019-02-20 14:15:31 -05:00
Jack Robison
4c7f357441 v0.32.2rc1 2019-02-20 12:12:04 -05:00
Jack Robison
cb5d428d12
add split_buckets_under_index config setting for seed nodes 2019-02-20 11:25:50 -05:00
Victor Shyba
38ed212c01 refactor, dont call storage from blob_manager + missing await 2019-02-19 21:45:14 -03:00
Victor Shyba
d035c13883 file_path can be None, add helper to check if stream output file exists instead 2019-02-19 21:45:14 -03:00
Jack Robison
82ce2ccee6
update docs 2019-02-19 17:27:31 -05:00
Jack Robison
fcbdaa336f
fix KBucket.key_in_range 
The range_min and range_max of a KBucket where mistakenly bounding the node id of a peer to be added rather than the distance from the local node id to the peer node id
 2019-02-19 13:57:11 -05:00
Lex Berezhny
3ae6137edb v0.32.1 2019-02-18 22:56:35 -05:00
Lex Berezhny
0fdd2ae178 added tx to JSON response from get 2019-02-18 22:53:11 -05:00
Victor Shyba
d2150cf142 fix balance check 2019-02-18 22:53:11 -05:00
Lex Berezhny
c2dc1f3c1d v0.32.1rc1 2019-02-18 17:17:20 -05:00
Victor Shyba
b36c22e2f4 unban after 10 seconds, give up after 60 2019-02-18 17:16:10 -05:00
Lex Berezhny
461c3c8408 downloading header from S3 correctly tracks progress 2019-02-18 17:15:40 -05:00
Jack Robison
3f7e466c97
return failure message for invalid blob hash in blob_delete 2019-02-18 12:18:56 -05:00
Jack Robison
4483380352
fix terminator blob hash (None) being included when running blob_list for an sd hash 2019-02-18 12:12:14 -05:00
Lex Berezhny
4a0a6b0243 v0.32.0 2019-02-16 20:17:41 -05:00
Thomas Zarebczan
a003e794ba listen on internal port instead of upnp redirect 2019-02-16 18:55:58 -05:00
Lex Berezhny
051fabc180 v0.32.0rc3 2019-02-16 15:07:07 -05:00
Jack Robison
fc450eb164
add TestMimeTypes, pylint 2019-02-15 20:42:55 -05:00
Thomas Zarebczan
652d7cbd24
consider . extension 2019-02-15 20:40:55 -05:00
Thomas Zarebczan
43b372c0fe
fix extension - remove dot 
The rest of our extensions don't have a dot. Also, strip off any characters and lowercase it to be safe.
 2019-02-15 20:40:55 -05:00
Victor Shyba
576da1bc30 do not keep trying when blob is being written 2019-02-15 21:20:06 -03:00
Victor Shyba
5c217f1544 resovle reflector IP before adding it 2019-02-15 21:20:06 -03:00
Jack Robison
fd081496c0
fix blocking on data being written for resumed streams 2019-02-15 17:35:46 -05:00
Jack Robison
32b4405a4c
logging 
fix https://github.com/lbryio/lbry/issues/1881
 2019-02-15 17:26:28 -05:00
Jack Robison
0d558bd552
fix default file list sorting 2019-02-15 17:26:24 -05:00
Jack Robison
ca835f3f80
fix 1883 2019-02-15 16:26:13 -05:00
Jack Robison
dbb6ba6241
recover streams with missing sd blobs, handle previous sd blob bugs 
-test download and recover stream with old key sorting
 2019-02-15 15:21:29 -05:00
Jack Robison
a228d20137
move store_stream and store_file to standalone functions 2019-02-15 15:21:07 -05:00
Jack Robison
f1b60e3ef2
fix get_blobs_for_stream 2019-02-15 15:21:07 -05:00
Jack Robison
39737c790f
sync blob files in database with those in directory on startup 2019-02-15 15:21:07 -05:00
Victor Shyba
918122e7cf supress invalid token error to debug 2019-02-15 16:31:47 -03:00
Victor Shyba
a49f479a5f move wait to where its needed on assembler 2019-02-15 10:26:05 -05:00
Jack Robison
9d89f9b834
use executemany instead of batched_operation 2019-02-14 15:57:24 -05:00
Jack Robison
56c41b2fea
fix integration test 
-cancel running reflector uploads from publishes upon shutdown
-refactor blob.delete to be non-async
-delete blobs synchronously
 2019-02-14 15:43:26 -05:00
Jack Robison
9c8593d88e
fix file_delete being slow 2019-02-14 12:33:48 -05:00
Jack Robison
85f41887fd
don't create BlobFile object when deleting if it doesn't already exist 2019-02-14 12:28:42 -05:00
Lex Berezhny
d2ba3fdcfb v0.32.0rc2 2019-02-14 00:18:21 -05:00
Victor Shyba
04f70d1f31 stop when data timeout 2019-02-14 00:10:44 -05:00
Victor Shyba
dbc8cfe5ae delete incomplete files on assembler stop 2019-02-14 00:10:44 -05:00
Victor Shyba
b6df2b9d28 missing None for optional field + pylint 2019-02-13 23:33:49 -05:00
Victor Shyba
5c1ab42277 resume should put the stream into wait as done usually on get calls 2019-02-13 23:33:49 -05:00
Victor Shyba
bbdc96e762 file_name as a property of managed stream, to reflect internal changes 2019-02-13 23:33:49 -05:00
Victor Shyba
fc0c949187 properly update file name on downloader/assembler 2019-02-13 23:33:49 -05:00
Victor Shyba
37bb765a2e resume downloads if DHT disabled 2019-02-13 23:33:49 -05:00
hackrush
21ca4f60f7 Stop the daemon on calling lbrynet stop 2019-02-13 14:22:23 -05:00
Victor Shyba
0a068011d8 fix chunked response parsing 2019-02-13 13:10:27 -05:00
Lex Berezhny
76ecb5d50d renamed resolve argument url to urls 2019-02-13 11:55:12 -05:00
Lex Berezhny
dbc1164562 v0.32.0rc1 2019-02-12 21:35:41 -05:00
Victor Shyba
e2170ec83d fix download timeout types 2019-02-12 20:58:31 -05:00
Lex Berezhny
68905d82b9 pass conf instead of data_dir to migrate_db, fixes #1898 2019-02-12 18:10:34 -05:00
Lex Berezhny
5e509c9fd6 testing get 2019-02-12 11:54:00 -05:00
Lex Berezhny
8aa50aa14f cleaned up resolve command 2019-02-12 11:54:00 -05:00
Jack Robison
6732b302bb
logging 2019-02-11 15:31:31 -05:00
Jack Robison
c9d54bb049
fix max_key_fee 2019-02-11 15:26:13 -05:00
Alex Grintsvayg
f65e70df2f
better resolve description 2019-02-11 12:34:57 -05:00
Jack Robison
6386815a29
fix reflect_streams not being followed 2019-02-08 20:13:26 -05:00
Jack Robison
0c93090d2c
faster is_valid_hashcharacter 2019-02-08 19:57:26 -05:00
Jack Robison
45404b6ad4
faster is_valid_blobhash 2019-02-08 19:54:59 -05:00
Jack Robison
aeb2891baa
faster population of channel names 2019-02-08 19:51:13 -05:00
Jack Robison
8abfdc82b2
faster blob manager startup 2019-02-08 17:37:35 -05:00
Jack Robison
da9b4e317a
limit blobs to announce 2019-02-08 16:29:55 -05:00
Jack Robison
e414cc5c48
whitespace 2019-02-08 16:11:56 -05:00
Jack Robison
939edb2f18
logging 
-call loop.set_debug when using --verbose
 2019-02-08 16:06:38 -05:00
Jack Robison
868110a6f2
populate stream manager with a single batch query 2019-02-08 16:06:35 -05:00
Victor Shyba
9ecec52412 check lock acquired to prevent races 2019-02-08 04:39:28 -03:00
Victor Shyba
8b25acff6e do not wait blob to be written, log errors from races 2019-02-08 04:32:53 -03:00
Victor Shyba
e2b06677b5 defer db insert during downloads 2019-02-08 03:45:23 -03:00
Victor Shyba
af1619ebfb disable race limiting for now 2019-02-08 03:32:38 -03:00
Victor Shyba
3352e0e4f4 score peers by speed 2019-02-08 03:08:08 -03:00
Victor Shyba
141d68a2cd fix write race condition 2019-02-08 02:39:29 -03:00
Victor Shyba
c06ec6cd69 manage connections, reusing them when possible 2019-02-08 02:27:58 -03:00
Victor Shyba
1be5dce30e stop racing during long streams 2019-02-08 01:28:03 -03:00
Victor Shyba
73da223ae1 conf: give up first contact earlier, but let the transfer go longer 2019-02-08 01:05:58 -03:00
Victor Shyba
2d7eb83518 change score calculation, wait for active peers too, simplify peer sorting/keeping 2019-02-08 01:04:38 -03:00
Victor Shyba
ad03f91d24 let cancelled errors flow 2019-02-08 01:03:13 -03:00
Victor Shyba
5586a226c2 bypass parser during download 2019-02-07 21:19:31 -03:00
Victor Shyba
a616582733 wait on connection tasks 2019-02-07 20:11:57 -03:00
Victor Shyba
43ac928f0b remove dht locks 2019-02-07 20:11:57 -03:00
Lex Berezhny
a121110743 v0.31.0 2019-02-06 14:28:40 -05:00
Victor Shyba
3a15ff4bcd test incomplete streams, respect real length, delete on incomplete assembly 2019-02-06 15:56:06 -03:00
Jack Robison
dfdc8eda00
improve test, fix stream_finished_event 2019-02-06 13:32:50 -05:00
Jack Robison
58f6cb71c6
test stream manager 2019-02-06 13:08:57 -05:00
Jack Robison
ae11c5bb4b
fix setting finished event 2019-02-06 12:18:24 -05:00
Jack Robison
f22b5da170
fix raised error for a peer address mismatch 2019-02-06 12:11:22 -05:00
Jack Robison
c1c6d5bc99
fix deleting partial downloads when stopped and previous streams when updating a publish 2019-02-06 11:43:05 -05:00
Jack Robison
0e972ec2ae
refactor BlobFile.close to be non async 2019-02-06 11:00:57 -05:00
Victor Shyba
8b5803c945 format error dict on get 2019-02-06 11:55:12 -03:00
Jack Robison
76c8447a56
add stream descriptor tests 2019-02-05 21:25:31 -05:00
Jack Robison
7c8ad0fe30
fix deleting incomplete downloads upon stop 
fix deleting previous streams (not assembled/published files) for a claim being updated
 2019-02-05 15:33:08 -05:00
Jack Robison
073ffdd049
proto and type args 2019-02-05 13:36:25 -05:00
Jack Robison
7fe211d134
fix resolve_host 2019-02-05 13:31:57 -05:00
Victor Shyba
a4ced4dbd2 set verified after callback 2019-02-05 13:17:00 -03:00
Victor Shyba
c6b910a5f3 use time_getter on storage 2019-02-05 13:14:59 -03:00
Victor Shyba
63d1ec3c28 fixes from jack comments 2019-02-05 13:01:12 -03:00
Victor Shyba
7b8f42e6d0 remove dead set_should_announce code 2019-02-05 13:01:12 -03:00
Victor Shyba
2c275efa48 remove redundant calls to should announce 2019-02-05 13:01:12 -03:00
Victor Shyba
6ead932ccb announces naturally, removes redundant calls 2019-02-05 13:01:12 -03:00
Victor Shyba
f766dbefe0 announce and set completed after inserts 2019-02-05 13:01:12 -03:00
Jack Robison
0685bc5689
include torba in log file 2019-02-04 18:25:47 -05:00
Jack Robison
8cda3143f2
fix setting should_announce and blob status 2019-02-04 18:22:44 -05:00
Jack Robison
5af351a234
reflector logging 2019-02-04 17:33:25 -05:00
Victor Shyba
b82d2c3120 handle and log if downloading from bad sendfile implementations 2019-02-04 19:13:31 -03:00
Jack Robison
2bce7cecfa
fix sendfile on windows 2019-02-04 16:48:48 -05:00
Jack Robison
8883587cc7
logging 2019-02-04 16:19:27 -05:00
Jack Robison
c85991704d
catch invalid data error 2019-02-04 16:19:27 -05:00
Jack Robison
377442d9f0
fix request_blob cancellation 2019-02-04 16:19:24 -05:00
Jack Robison
f0b49fc153
always return close peers from findValue 2019-02-04 15:07:42 -05:00
Jack Robison
ae1162f5b0
don't try downloading from oneself 
-don't return the querying peer in results for findValue
 2019-02-04 14:50:53 -05:00
Victor Shyba
ad71a9a89d refactor reflect to close protocol 2019-02-04 13:34:18 -03:00
Jack Robison
13b3e4ba8e v0.31.0rc5 2019-02-04 10:22:43 -05:00
Victor Shyba
736a949cb5 resume streams on startup 2019-02-03 20:49:09 -03:00
Victor Shyba
11bb1cc7ee use with clause to avoid leaking fds 2019-02-03 20:41:47 -03:00
Jack Robison
dcd78bd86e
always delete file from downloads if download was not complete 2019-02-03 16:43:40 -05:00
Jack Robison
e5af041627
fix connection status message 2019-02-03 16:20:52 -05:00
Jack Robison
0a027cf2de
logging 2019-02-03 15:47:19 -05:00
Jack Robison
3f98b16800
fix blob announce time, use time.time instead of loop.time 2019-02-03 15:47:15 -05:00
Jack Robison
8f5a8ab8ba
fix peer_ping 2019-02-02 02:02:19 -05:00
Jack Robison
91e581422c v0.31.0rc4 2019-02-02 00:30:57 -05:00
Jack Robison
f2968aab22
add re-reflect task to stream manager, add concurrent_reflector_uploads to config 2019-02-01 22:59:41 -05:00
Jack Robison
ccbe8aa0eb
create data. download, and wallet directories if they don't exist on startup 2019-02-01 22:45:28 -05:00
Jack Robison
478f79353a
fix bytes error 2019-02-01 22:20:11 -05:00
Jack Robison
c3b0151943
fix dht status error during startup 2019-02-01 22:12:07 -05:00
Jack Robison
e96b75a0d0
fix file/download paths 
move download-from-uri logic into stream manager
 2019-02-01 21:40:35 -05:00
Jack Robison
efe4afd09e
fix blob announce time 2019-02-01 21:28:59 -05:00
Jack Robison
c7cb6822cc
logging 2019-02-01 21:28:59 -05:00
Jack Robison
c75665d3f0
update file_list docs, add blobs_remaining to file list args and to file dict result 2019-02-01 21:28:59 -05:00
Jack Robison
744375b2c0
re-assemble file / resume downloads 2019-02-01 21:28:59 -05:00
Victor Shyba
40da5b6cb6 rework data parser 2019-02-01 20:09:14 -03:00
Victor Shyba
b36cf3e36c remove closing peers from active connections 2019-02-01 20:09:14 -03:00
Jack Robison
0a08f445a4
close blob server transport on sendfile failing 2019-02-01 15:11:37 -05:00
Victor Shyba
f5bf1463af fixes from review 2019-02-01 17:09:37 -03:00
Victor Shyba
ca4a55ef28 set verified event earlier and remove stop awaits 2019-02-01 16:05:14 -03:00
Victor Shyba
832be0758b let cancel propagate 2019-02-01 16:05:14 -03:00
Victor Shyba
25050fdeeb fixes for writers (check inside lock and dont hold verified bytes) 2019-02-01 16:05:14 -03:00
Jack Robison
dabd9cbe1e
faster stream manager startup 2019-02-01 13:53:03 -05:00
Jack Robison
2336015f9a
fix publish 
fixes https://github.com/lbryio/lbry/issues/1826
- remove `sources` argument from `publish`
- only add/update files we have
- delete existing stream if updating with a new one
 2019-02-01 13:35:18 -05:00
Jack Robison
31445c7797
remove lock from PeerManager 2019-01-31 20:57:48 -05:00
Jack Robison
87f5d1bd4a
fix updating claim with existing stream 2019-01-31 20:49:19 -05:00
Jack Robison
2e9acd1baa
remove blob request asyncio.Lock 2019-01-31 20:19:50 -05:00
Jack Robison
df86937f4e
fix deleting a file mid download 2019-01-31 17:59:42 -05:00
Jack Robison
957d0290df
add torba logging 2019-01-31 16:53:54 -05:00
Jack Robison
40b90ce79b
fix hanging download 2019-01-31 16:53:27 -05:00
Jack Robison
aa7f0845cc
catch sendfile errors 2019-01-31 16:10:27 -05:00
Jack Robison
6e69d306de
tests 2019-01-31 15:39:23 -05:00
Jack Robison
d85d3dfaa4
increase default max_connections_per_download 2019-01-31 15:39:20 -05:00
Jack Robison
2b035009ef
handle both urls and ip addresses for fixed nodes and reflector servers 2019-01-31 15:39:20 -05:00
Jack Robison
f9fd62c214
add fixed peers immediately if the dht has no peers 2019-01-31 15:39:20 -05:00
Jack Robison
e8a1953815
add fixed peers immediately if dht is skipped 2019-01-31 15:39:20 -05:00
Jack Robison
34776e7eb9
fix test 2019-01-31 15:39:20 -05:00
Jack Robison
a4419f562f
pylint 2019-01-31 15:39:20 -05:00
Jack Robison
e60e5b3919
fix updating content claim for a file 
-fix file name and download dir not being hex encoded during publish, add repair script
 2019-01-31 15:39:20 -05:00
Jack Robison
3589cc9977
call update_reflected_stream upon reflector finishing 2019-01-31 15:39:20 -05:00
Jack Robison
2e978c00b2
prioritize peers to download from 2019-01-31 15:39:20 -05:00
Jack Robison
2335243de9
pylint 2019-01-31 15:39:20 -05:00
Jack Robison
6ad68eabd9
tests 2019-01-31 15:39:20 -05:00
Jack Robison
262b9a624b
update file_reflect 2019-01-31 15:39:20 -05:00
Jack Robison
05915c540a
set fully reflected if the server indicates it had all of the stream 2019-01-31 15:39:20 -05:00
Jack Robison
6aef6a80b7
refactor downloader 
split peer accumulation out, use Queues instead of locks
 2019-01-31 15:39:20 -05:00
Jack Robison
16efe9ba95
add fixed_peer_delay setting 2019-01-31 15:39:20 -05:00
Jack Robison
fcda9500fe
add accumulate_peers to Node 
simplifies collecting peers during a download by giving a queue of hashes to search for and a queue or peers as they are found
 2019-01-31 15:39:20 -05:00
Victor Shyba
5ee4b2173a fix probes bugs, partial DHT refactor 2019-01-31 01:49:52 -03:00
Victor Shyba
3e1c3d1e4b use node_id parameter instead of your own 2019-01-31 01:11:09 -03:00
Victor Shyba
21f2b2dcd7 cast timestamp to integer before querying 2019-01-31 01:09:57 -03:00
Jack Robison
ffc7fc0793
fix uncaught exception in BlobServerProtocol when client disconnects during a blob transfer 2019-01-30 12:03:05 -05:00
Victor Shyba
2e633c0ee6 fix chunked requests for server 2019-01-30 12:11:05 -03:00
Jack Robison
933d58d49b
logging 2019-01-29 20:47:02 -05:00
Jack Robison
8f7cf0b38f
verbose logging 2019-01-29 13:08:11 -05:00
Jack Robison
418def56ac
fix log 2019-01-28 22:38:17 -05:00
Jack Robison
cefe3eb520
fix file_delete 2019-01-28 22:01:43 -05:00
Jack Robison
64dffa306f
logging, cleanup 2019-01-28 22:01:43 -05:00
Jack Robison
7d33b4f1f3
fix unawaited task 2019-01-28 22:01:43 -05:00
Jack Robison
f507d95198
always add fixed peers if configured after 2s 2019-01-28 22:01:43 -05:00
Jack Robison
2a7d80f8b4
logging 2019-01-28 22:01:43 -05:00
Jack Robison
bfaebf0085
fix timeout error 2019-01-28 17:20:14 -05:00
Jack Robison
71f9f8ae9c
fix race condition in reflector server 2019-01-28 16:51:11 -05:00
Jack Robison
330862e487
fix https://github.com/lbryio/lbry/issues/1297 2019-01-28 16:00:37 -05:00
Jack Robison
778d3826ab
clean up settings and use them 2019-01-28 15:51:27 -05:00
Jack Robison
4a11cf007f
remove unused settings and constants 2019-01-27 19:51:44 -05:00
Jack Robison
573285a5bb
fix error encoding find value response 2019-01-26 17:04:11 -05:00
Lex Berezhny
60ed4e503f refactored settings_set to support all settings 2019-01-26 00:04:36 -05:00
Lex Berezhny
aa1405887e use float instead of decimal for now 2019-01-25 23:20:43 -05:00
Lex Berezhny
cced217e43 update doc format for max_key_fee 2019-01-25 23:20:43 -05:00
Lex Berezhny
8a3b8d2df1 max_key_fee in yaml as null 2019-01-25 23:20:43 -05:00
Lex Berezhny
be0bd3bdea refactored --max-key-fee to be more ergonomic 2019-01-25 23:20:43 -05:00
Lex Berezhny
e01c73a7f8 pylint 2019-01-25 21:00:20 -05:00
Lex Berezhny
134338db4b dropped help, commands and resolve_name commands 2019-01-25 21:00:20 -05:00
Lex Berezhny
f47a685734 help message for start command 2019-01-25 20:28:47 -05:00
Lex Berezhny
6e29f7e99b user is shown help when typing lbrynet help 2019-01-25 20:28:47 -05:00
Lex Berezhny
a55802c1de v0.31.0rc3 2019-01-25 17:05:38 -05:00
Jack Robison
a7610e3d34
async reflector 2019-01-25 16:10:17 -05:00
Jack Robison
69bcb052de
fix blob server protocol factory 2019-01-25 13:10:40 -05:00
Lex Berezhny
b7d62ca084 v0.31.0rc2 2019-01-25 10:46:20 -05:00
Jack Robison
fa97f7bd38 fix written_bytes error 2019-01-25 10:23:03 -05:00
Lex Berezhny
4a35247016 fixes for toggle config, passing servers as list, etc 2019-01-25 10:19:24 -05:00
Lex Berezhny
d0526ad7d5 bring --config back to start command 2019-01-25 10:19:24 -05:00
Lex Berezhny
19b529cf38 removed unused import 2019-01-25 10:19:24 -05:00
Lex Berezhny
0373196707 max_key_fee is plain YAML now 2019-01-25 10:19:24 -05:00