Madiator2011/lbry-sdk
1
0
Fork 0
forked from LBRYCommunity/lbry-sdk
Code Pull requests Activity
4687 commits 111 branches 641 tags 30 MiB
Commit graph

3252 commits

Author SHA1 Message Date
Victor Shyba
5b35c4e8f0
port dht.distance ~> py3 2018-08-24 11:37:53 -04:00
Victor Shyba
9967857a57
port dht.encoding ~> py3 2018-08-24 11:37:53 -04:00
Victor Shyba
78c560a3be
general incomplete porting of daemon booting ~> py3 2018-08-24 11:37:53 -04:00
Victor Shyba
07a12b66e8
port dht.contacts ~> py3 2018-08-24 11:37:53 -04:00
Lex Berezhny
a28c9d09c8
- fix and improvements related to the two balance command account_balance and wallet_balance 
- working CommonWorkflowTests integration test
- pylint, unit and integration test fixes
- switch integration tests to use async/await
 2018-08-24 11:37:53 -04:00
Victor Shyba
b2ab13187f
fix get_certificates 2018-08-24 11:37:53 -04:00
Victor Shyba
5ec696fbfd
fix lookup helper by not calling hexlify twice 2018-08-24 11:37:53 -04:00
Victor Shyba
44bd0ae847
fix another forgotten claim id nbo conversion 2018-08-24 11:37:53 -04:00
Victor Shyba
5809ba093d
convert amount on channel_new 2018-08-24 11:37:53 -04:00
Lex Berezhny
17aee92dc9
wallet_balance --include-unconfirmed works now 2018-08-24 11:37:53 -04:00
Victor Shyba
6f1d2e7690
fix RPC publish claim serialization 2018-08-24 11:37:53 -04:00
Victor Shyba
75f57fc517
fix claim id handling during publish from the latest changes 2018-08-24 11:37:53 -04:00
Lex Berezhny
f589410496
tests 2018-08-24 11:37:53 -04:00
Lex Berezhny
aecc7c6643
resolve works in py3!!!!!11111oneoneone 2018-08-24 11:37:53 -04:00
Victor Shyba
c5c1b62939
fix resolve from tx.id rename 2018-08-24 11:37:53 -04:00
Lex Berezhny
adc92a2b52
fix for daemon.get_est_cost 2018-08-24 11:37:53 -04:00
Lex Berezhny
0442770c9d
pylint fixes 2018-08-24 11:37:53 -04:00
Lex Berezhny
3b6a879fc9
add is_hd=true for default migrated wallet 2018-08-24 11:37:53 -04:00
Lex Berezhny
a1b4c9acd6
claim_id is hexlified before saving to sqlite 2018-08-24 11:37:53 -04:00
Lex Berezhny
159e84468c
py3 support in resolve 2018-08-24 11:37:53 -04:00
Lex Berezhny
59e4ac30c2
fixing py2 stuff that broke during py3 fixes 2018-08-24 11:37:53 -04:00
Lex Berezhny
b5ce948bc1
convert buffer to string 2018-08-24 11:37:53 -04:00
Lex Berezhny
076af7ef43
py3 compatibility updates 2018-08-24 11:37:53 -04:00
Lex Berezhny
43bef9447c
progress on publish command: py3 porting and integration tests 2018-08-24 11:37:53 -04:00
Victor Shyba
b1c5fe0b4d
cryptblob write needs bytes on py3 2018-08-24 11:37:53 -04:00
Lex Berezhny
315661208d
integration test publishes actual file instead of just sources 2018-08-24 11:37:53 -04:00
Lex Berezhny
e175e43082
.decode() string for sqlite 2018-08-24 11:37:53 -04:00
Lex Berezhny
cb9b320ed7
dropped make_claim in favor of wallet.claim_name 2018-08-24 11:37:53 -04:00
Lex Berezhny
1d906fb0c7
create_and_publish_stream fix 2018-08-24 11:37:53 -04:00
Lex Berezhny
c544e26206
publish integration test works 2018-08-24 11:37:53 -04:00
Lex Berezhny
1eaac35a3e
claim_name does not take change_address anymore 2018-08-24 11:37:53 -04:00
Lex Berezhny
cc7962fc2e
stringify address from sqlite 2018-08-24 11:37:53 -04:00
Lex Berezhny
3638984d67
fixed getting unused address 2018-08-24 11:37:53 -04:00
Lex Berezhny
774d813576
fixed encoding issue on saving wallet 2018-08-24 11:37:53 -04:00
Lex Berezhny
688caf4453
+ save wallet after creating a channel 2018-08-24 11:37:53 -04:00
Lex Berezhny
eeb5b3c139
publishing 2018-08-24 11:37:53 -04:00
Lex Berezhny
b5e6dd1060
+ maybe_migrate_certificates 2018-08-24 11:37:53 -04:00
Lex Berezhny
272d818050
saving txo bug fix 2018-08-24 11:37:53 -04:00
Lex Berezhny
0fc1bd7a8c
store claim_id 2018-08-24 11:37:53 -04:00
Lex Berezhny
2b234e0713
fix syntax error 2018-08-24 11:37:53 -04:00
Victor Shyba
9e8cb17ecb
insane working version of paged resolve, to be refactored 2018-08-24 11:37:53 -04:00
Victor Shyba
e0230864ce
creates a Resolve class for moving resolve methods out of ledger 2018-08-24 11:37:53 -04:00
Victor Shyba
9e89b3e40e
start a new module for isolating resolve related code before we can refactor it 2018-08-24 11:37:53 -04:00
Victor Shyba
036663ae62
adds get_claims_by_ids and fix a test name 2018-08-24 11:37:53 -04:00
Victor Shyba
bdd271e78f
adds resolve 2018-08-24 11:37:53 -04:00
Lex Berezhny
4a56d38782
certificate.py 2018-08-24 11:37:53 -04:00
Lex Berezhny
70a7ca95fe
wip 2018-08-24 11:37:53 -04:00
Lex Berezhny
d81502e191
unit test fixes, balance/utxos filters out claims, abandoning claims 2018-08-24 11:37:53 -04:00
Lex Berezhny
8c35d355e5
added is_claim,is_support,is_update and claim_name attributes to txo able 2018-08-24 11:37:53 -04:00
Lex Berezhny
72b004664f
config fix 2018-08-24 11:37:53 -04:00
Lex Berezhny
17738ad248
import fixes due to tests directory moving 2018-08-24 11:37:53 -04:00
Lex Berezhny
edfc2c6124
fix to make sd_hash more deterministic 2018-08-24 11:37:53 -04:00
Lex Berezhny
545451a829
moved ./lbry/tests to ./tests 2018-08-24 11:37:53 -04:00
Lex Berezhny
12ff7015cd
wallet tests and py3 compatibility 2018-08-24 11:37:53 -04:00
Lex Berezhny
f2f212edba
switch component wallet to use the new wallet 2018-08-24 11:37:53 -04:00
Lex Berezhny
69446491b8
pylint and unit test fixes 2018-08-24 11:37:50 -04:00
Lex Berezhny
d5beaa0937
jsonrpc_channel_new uses new wallet 2018-08-24 11:37:25 -04:00
Lex Berezhny
cc970c499b
daemon/auth py3 conversion, this breaks the client for now 2018-08-24 11:37:25 -04:00
Lex Berezhny
0087b16912
deleted old broken test 2018-08-24 11:37:25 -04:00
Lex Berezhny
5520d518b5
DHT py3 compatibility, mostly commenting out implements() and fixing imports 
cryptstream py3 support, mostly commenting out implements()
lbry_file py3 support, mostly commenting out implements()
file_manager py3 support, mostly commenting out implements()
core py3 support, mostly commenting out implements() and fixing imports
 2018-08-24 11:37:25 -04:00
Lex Berezhny
b3e9240aa8
wip, valuesforuris 2018-08-24 11:37:25 -04:00
Lex Berezhny
137a270488
* channel certificate creation and taking advantage of is_reserved feature on txos to exclude output from being used in new transactions 2018-08-24 11:37:25 -04:00
Lex Berezhny
e36610d63c
fix resolve 2018-08-24 11:37:25 -04:00
Lex Berezhny
c4273fbef0
claim test 2018-08-24 11:37:25 -04:00
Lex Berezhny
a4e9f3100f
updating wallet tests 2018-08-24 11:37:25 -04:00
Lex Berezhny
2668ceac0e
updated to newer torba 2018-08-24 11:37:25 -04:00
Lex Berezhny
fb2fb5c38c
recovered an old stash 2018-08-24 11:37:25 -04:00
Lex Berezhny
56175df121
wip 2018-08-24 11:37:25 -04:00
Lex Berezhny
7d3daa9fe6
set the lbryschema BLOCKCHAIN_NAME global variable 2018-08-24 11:37:25 -04:00
Lex Berezhny
1d2de27536
import fix 2018-08-24 11:37:25 -04:00
Lex Berezhny
aab42e56bd
removing lbryum 2018-08-24 11:37:25 -04:00
Lex Berezhny
1368a6e074
wallet manager refactoring 
test uses manager.send_amount_to_address instead of manually creating tx
 2018-08-24 11:37:25 -04:00
Lex Berezhny
80990b959c
moved files around 2018-08-24 11:37:25 -04:00
Lex Berezhny
053b6d1c80
removing lbryum from requirements 2018-08-24 11:37:25 -04:00
Lex Berezhny
692d8e8e1a
new wallet becoming drop-in replacement for old lbryum wallet 2018-08-24 11:37:25 -04:00
Lex Berezhny
5e71dcbaf0
wip: implementation is now generic and supports multiple currencies 2018-08-24 11:37:25 -04:00
Lex Berezhny
83958604d5
finally generating fully signed tx submittable to lbrycrd 2018-08-24 11:37:25 -04:00
Lex Berezhny
dcd8a6bb0e
branch and bound based coin selection with random draw fallback 2018-08-24 11:37:25 -04:00
Lex Berezhny
7161a0edb9
new bitcoin script parser 2018-08-24 11:37:25 -04:00
Lex Berezhny
0fd160e6e6
a lot more stuff 2018-08-24 11:37:25 -04:00
Lex Berezhny
ca8b2dd83e
wip: initial import of twisted based wallet 2018-08-24 11:37:25 -04:00
Jack Robison
79d1da5ff8
Bump version 0.21.2rc3 --> 0.21.2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-23 23:43:35 -04:00
Jack Robison
d73252b11a
Bump version 0.21.2rc2 --> 0.21.2rc3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-23 22:40:16 -04:00
Jack Robison
a7a53f9381
fix mirror downloader looping call 2018-08-23 22:36:30 -04:00
Jack Robison
f4b2a05fff
fix a typo 2018-08-23 18:35:47 -04:00
Jack Robison
cdd2b6bfc1
Bump version 0.21.2rc1 --> 0.21.2rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-23 11:57:49 -04:00
Jack Robison
26bd27cd32
Bump version 0.21.1 --> 0.21.2rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-23 11:45:07 -04:00
Jack Robison
37ddaeca12
fix ping queue bug 2018-08-23 11:18:28 -04:00
Jack Robison
2c546b2cde
retry mirror downloads 2018-08-23 11:18:28 -04:00
Alex Grintsvayg
149fa625e0 back to reflector 1 2018-08-15 16:11:34 -04:00
Jack Robison
16cda60f31
fix test 2018-08-13 17:16:48 -04:00
Jack Robison
0d54f6215f
Bump version 0.21.1rc2 --> 0.21.1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-13 16:20:16 -04:00
Jack Robison
a9774a293f
docs 2018-08-13 16:18:31 -04:00
Jack Robison
ee8cf08c0e
Bump version 0.21.1rc1 --> 0.21.1rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-13 14:04:39 -04:00
Jack Robison
ea481e6c5a
fix download_progress in blockchain_headers status 
-use a 0-100 range for percentage regardless of how much we have to download (if we're resuming or starting fresh)
-prevent negative blocks or blocks_behind counts
 2018-08-13 14:03:15 -04:00
Jack Robison
36df9e8283
Bump version 0.21.0 --> 0.21.1rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-12 22:16:00 -04:00
Jack Robison
68f1dda7b0
initialize headers download progress 2018-08-12 22:05:07 -04:00
Jack Robison
5b7f7c87bf
fix stop_lbry_files 2018-08-12 22:04:55 -04:00
Jack Robison
153022a1a7
add is_locked to status 2018-08-12 22:04:48 -04:00
Lex Berezhny
1098ca0494 + convert float to decimal for wallet_send 2018-08-09 19:14:56 -04:00
Jack Robison
d4a7dbf805
Bump version 0.21.0rc13 --> 0.21.0 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-09 13:44:28 -04:00
Jack Robison
56ee815eec
Bump version 0.21.0rc12 --> 0.21.0rc13 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-09 13:20:15 -04:00
Jack Robison
fe43764bcb
fix announcement of blobs downloaded from a http mirror 2018-08-09 13:19:59 -04:00
Jack Robison
2448d51ed5
Bump version 0.21.0rc11 --> 0.21.0rc12 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-09 12:07:35 -04:00
Jack Robison
2804fa4448
fix disabling the hash announcer 2018-08-09 12:04:14 -04:00
Jack Robison
69ae60b4bb
Bump version 0.21.0rc10 --> 0.21.0rc11 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-09 11:29:49 -04:00
Jack Robison
dca4af942f
also try/except around upnp.discover 
-catches edge case where miniupnpc fallback is used and a device is found but selectigd fails
 2018-08-09 11:28:07 -04:00
Jack Robison
2b7e135839
fix error in blob_delete 2018-08-09 11:26:57 -04:00
Jack Robison
d565aa0b3f
Bump version 0.21.0rc9 --> 0.21.0rc10 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-09 09:24:39 -04:00
Jack Robison
8b53140581
set downloading_headers to False after the download finishes or fails 2018-08-09 09:24:04 -04:00
Jack Robison
917bae568d
fix disabling blob announcement by setting concurrent announcers to 0 2018-08-09 09:22:55 -04:00
Jack Robison
efb6af4d51
Bump version 0.21.0rc8 --> 0.21.0rc9 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-09 09:01:57 -04:00
Jack Robison
5fe8022b15
don't attempt to announce blobs until we we have contacts in routing 2018-08-09 09:00:36 -04:00
Jack Robison
7931397595
Bump version 0.21.0rc7 --> 0.21.0rc8 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-09 08:44:23 -04:00
Jack Robison
0501f52805
fix upnp edge case 
-fixes https://github.com/lbryio/lbry/issues/1352
 2018-08-09 08:42:51 -04:00
Jack Robison
108d2a033b
fix attribute error when reflector component is disabled 2018-08-09 08:32:43 -04:00
Jack Robison
17a9cfd65c
Bump version 0.21.0rc6 --> 0.21.0rc7 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-08 14:12:01 -04:00
Jack Robison
8eb740cf67
Bump version 0.21.0rc5 --> 0.21.0rc6 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-08 13:58:17 -04:00
Jack Robison
b73e50e64b
Bump version 0.21.0rc4 --> 0.21.0rc5 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-07 19:27:50 -04:00
Jack Robison
c73148a1fb
Merge remote-tracking branch 'origin/fix_1346' 2018-08-07 19:27:28 -04:00
Jack Robison
65a02190dc
Merge remote-tracking branch 'origin/fix_1344' 2018-08-07 19:26:15 -04:00
Jack Robison
26e32472d5
fix upnp and peer port setup 
-bump txupnp requirement
 2018-08-07 19:04:54 -04:00
Victor Shyba
d21313e590 allow mirrors if conf is set, but clear it for tests 2018-08-07 13:55:45 -03:00
Victor Shyba
382226ff9a tells that an address is wrong earlier on publishing 2018-08-07 13:52:01 -03:00
Jack Robison
9511040d5a
fix upnp and peer port setup 2018-08-05 13:12:39 -04:00
Jack Robison
15161dd429
fix docstring 2018-08-03 13:31:51 -04:00
Jack Robison
efc5982860
Bump version 0.21.0rc3 --> 0.21.0rc4 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-03 13:22:06 -04:00
Jack Robison
f1b19f10cc
Merge branch 'master' into greedy_search 2018-08-03 13:08:31 -04:00
Jack Robison
e50ac69358
tests and pylint 2018-08-03 12:35:10 -04:00
Jack Robison
aef561d78b
refactor status results 2018-08-03 12:33:31 -04:00
Jack Robison
4ef4a4816f
update component tests 2018-08-03 11:37:10 -04:00
Jack Robison
8533bfa7c5
refactor test_misc, remove Session 
-use only the one process
 2018-08-03 11:37:10 -04:00
Jack Robison
6389e961b9
update (and refactor) tests to not use Session 2018-08-03 11:37:10 -04:00
Jack Robison
6359fc608e
set download_mirrors upon making the downloader instead in the file manager globally 2018-08-03 11:37:10 -04:00
Jack Robison
314400a1bd
move looping call to check announcement status to SQLiteStorage 2018-08-03 11:37:10 -04:00
Jack Robison
a3de065c93
use txupnp instead of miniupnpc 2018-08-03 11:37:07 -04:00
Jack Robison
99207b7221
delete Session.py 
split Session into Components
 2018-07-30 18:00:33 -04:00
Jack Robison
e3c3fafa1e
split headers download into own component 
-add component statuses
 2018-07-30 18:00:33 -04:00
Victor Shyba
9742da348b do not consume errors on DeferredList 2018-07-30 13:53:58 -03:00
Victor Shyba
94a31922f7 fix unnecessary logging tag 2018-07-30 11:22:31 -03:00
Victor Shyba
1937eb17c4 adds a test for stopping 2018-07-30 11:22:31 -03:00
Victor Shyba
f291ea515a add test for invalid content 2018-07-30 11:22:31 -03:00
Victor Shyba
ff4aba9423 refactor mirroring 2018-07-30 11:22:31 -03:00
hackrush
9ab256df30 fixed improper error handling when data is not valid JSON (#1326) 2018-07-30 09:38:36 -04:00
Lex Berezhny
88b8ca8a49 Revert "negate wallet lock check in components" 
This reverts commit 32507d7
 2018-07-25 14:59:10 -04:00
Jack Robison
09f637496c
Bump version 0.21.0rc2 --> 0.21.0rc3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-25 12:25:24 -04:00
Jack Robison
826d269e0e
Merge branch 'blobs_mirroring' 2018-07-25 12:24:37 -04:00
Victor Shyba
ab27203100 improve exception logging and add a docstring on the interaction between downloaders 2018-07-25 13:01:13 -03:00
Victor Shyba
88c2051605 set download_mirror conf from components change 2018-07-25 12:23:15 -03:00
Victor Shyba
f510c2a433 improve logging from review 2018-07-25 12:15:52 -03:00
Victor Shyba
ec140d5d8a changes from code review 2018-07-25 12:15:52 -03:00
Victor Shyba
ad96b006f9 adds http download support for blobs mirroring 2018-07-25 12:15:52 -03:00
Lex Berezhny
32507d74f7 negate wallet lock check in components 2018-07-25 01:28:19 -04:00
Jack Robison
40c5f6e3ab
Bump version 0.21.0rc1 --> 0.21.0rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-24 21:41:58 -04:00
Jack Robison
c1b05402ef
add address and port arguments to peer_ping 
allows directly pinging the peer without first doing an iterative find
 2018-07-24 21:30:54 -04:00
Jack Robison
1dd1bad9c2
Bump version 0.20.4 --> 0.21.0rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-24 21:21:52 -04:00
Jack Robison
5984ae7ce9
fix 2018-07-24 21:10:53 -04:00
Jack Robison
5d9a187659
refactor required conditions and @requires decorator 2018-07-24 20:01:38 -04:00
Jack Robison
a9c94ca22d
move setup and _shutdown to AuthJSONRPCServer 2018-07-24 20:01:38 -04:00
Jack Robison
a285db1b08
pylint 2018-07-24 20:01:38 -04:00
Jack Robison
13bf8125e3
status doc, better determination of is_first_run 
-add skipped_components to status response
-re-add run_reflector_server to settings
 2018-07-24 20:01:38 -04:00
Jack Robison
b06dcf0a0d
cancel starting components if the reactor is stopped before startup has finished 
-don't block starting the dht component on having found enough peers, only on setting up the protocol
 2018-07-24 20:01:38 -04:00
Jack Robison
a800f6ddf0
update status command 2018-07-24 20:01:38 -04:00
Jack Robison
a89306b6bf
reorganize daemon startup 
-fix loggly not using the share usage setting

-delete more
 2018-07-24 20:01:38 -04:00
Jack Robison
c3120e93cf
delete unneeded daemon attributes 2018-07-24 20:01:38 -04:00
Jack Robison
defe9506bb
set daemon attribute for each component as they start 2018-07-24 20:01:38 -04:00
Jack Robison
55d3bb0ec3
remove auto_renew 2018-07-24 20:01:38 -04:00
hackrush
005a8b3008
allow utf-8 characters in Daemon.py 
-amit really wants the shrug emoji ¯\_(ツ)_/¯
 2018-07-24 20:01:38 -04:00
hackrush
a741fdfc44
update daemon unit tests 2018-07-24 20:01:38 -04:00
hackrush
944b94aae8
update logging tests 2018-07-24 20:01:38 -04:00
hackrush
37eaf634c4
update functional tests 2018-07-24 20:01:38 -04:00
hackrush
edcb06a415
update mocks, add test_Component_Manager 2018-07-24 20:01:38 -04:00
hackrush
62b50dc0ae
move custom logger to lbrynet directory 
-import on module level __init__
 2018-07-24 20:01:38 -04:00
hackrush
e7c57dcabc
add components_to_skip setting 2018-07-24 20:01:38 -04:00
hackrush
094d9c6497
update lbrynet-cli 2018-07-24 20:01:38 -04:00
hackrush
3dc5a9de7b
whitespace 2018-07-24 20:01:38 -04:00
hackrush
4e29041291
update status command 2018-07-24 20:01:38 -04:00
hackrush
6b6a29fdb7
update settings_set 2018-07-24 20:01:38 -04:00
hackrush
2d61ba629f
add requires decorator 2018-07-24 20:01:38 -04:00
hackrush
5a2075019c
update Wallet.check_locked 2018-07-24 20:01:38 -04:00
hackrush
944200ca8c
add all the daemon components 2018-07-24 20:01:38 -04:00
hackrush
40d8e96811
remove functions and attributes in Session and Daemon that are now part of components 
-rename attributes in daemon to use components
 2018-07-24 20:01:38 -04:00
Jack Robison
7e8ca842a2
change ComponentManager to use instance methods rather than class methods 
-add get_component method to ComponentManager

-add override_components kwargs to ComponentManager

-add skip_components to ComponentManager

-change component_manager attribute to exist on the AuthJSONRPCServer instance instead of the class
 2018-07-24 20:01:38 -04:00
Jack Robison
b808d08eb3
support callbacks to component setups 2018-07-24 20:01:38 -04:00
Jack Robison
eb11da9b19
convert directory and SQLiteStorage setup to be a Component 2018-07-24 20:01:38 -04:00
Jack Robison
68b31a09b4
add daemon Component and ComponentManager classes 2018-07-24 20:01:38 -04:00
Lex Berezhny
cab8416596
api doc generator (#1290) 
script to generate docs/api.json
 2018-07-24 19:36:09 -04:00
Electron - Mark Firth
94f4e6714a A More Informative Error Message (#1309) 
Additional information added to the balance error message when editing a claim.
 2018-07-20 15:41:24 -04:00
Jack Robison
2ddd6b051d
Bump version 0.20.4rc4 --> 0.20.4 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-18 15:36:21 -04:00
Jack Robison
c506fc5c75
lower peer finder timeout message to debug from warning 2018-07-18 15:32:45 -04:00
Jack Robison
d306ece0d4
Bump version 0.20.4rc3 --> 0.20.4rc4 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-17 17:38:27 -04:00
Jack Robison
d29f103910
pylint 2018-07-17 17:38:19 -04:00
Jack Robison
2386a3a79b
Bump version 0.20.4rc2 --> 0.20.4rc3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-17 17:14:07 -04:00
Jack Robison
ec51333b56
allow node udp interface to be configured 2018-07-17 17:13:33 -04:00
Victor Shyba
4d720370b1 fix where it called the wrong score method 2018-07-17 17:48:25 -03:00
Jack Robison
7d7dd665aa
Bump version 0.20.4rc1 --> 0.20.4rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-17 13:31:37 -04:00
Victor Shyba
5492ab9081
stop requesting peers which doesnt have a blob 2018-07-17 13:22:08 -04:00
Victor Shyba
562d23df11 remove nodes that went ignored during iteration 2018-07-16 17:22:46 -03:00
Jack Robison
2c13c04f86
Bump version 0.20.3 --> 0.20.4rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-13 12:02:50 -04:00
Victor Shyba
5c7d279104 prune failures during is_ignored calls 2018-07-12 18:24:59 -03:00
Victor Shyba
cfe8e17223 filter out the bad node in results instead of punishing the node we trusted to contact 2018-07-12 18:24:18 -03:00
Victor Shyba
c589e89bf0 greedy search with exclude filtering 2018-07-05 22:03:52 -03:00
Lex Berezhny
284264962d reflector test fix 2018-07-05 19:51:15 -04:00
Lex Berezhny
6952c2c07e
Revert "refactor lbrynet-daemon into modular components" (#1286) 
* Revert "fix reflector test"

This reverts commit 6a15b51ac3.

* Revert "refactor lbrynet-daemon into modular components (#1164)"

This reverts commit 75a6ff269e.
 2018-07-05 19:05:48 -04:00
Jack Robison
6a15b51ac3
fix reflector test 2018-07-05 15:40:13 -04:00
Jack Robison
75a6ff269e refactor lbrynet-daemon into modular components (#1164) 
* add daemon Component and ComponentManager classes

* convert directory and SQLiteStorage setup to be a Component

* support callbacks to component setups

* Fixed typo in ComponentManager

* convert wallet to be Component

* Use storage from session.

* Remove create_session internal function and PEP8

* Starting to convert session to its own component. Removed ref to `self.storage` from Daemon.py

* Making DHT component(broken)

* Refactored classes to reduce redundancy in getting config setting

* DHT is now it's own component

* Fixed `test_streamify` test

* Fixed regression caused by removing `peer_manager` from session

* refactor ComponentManager and Component to use instance instead of class methods

* Hash announcer, file manager, stream identifier components

* Query Handler and server components

* Reflector Component

* Fixed test_streamify(well Jack did, but ¯\_(ツ)_/¯)

* All tests now passing

* Pylint fixes

* Oops(That's all you're gonna get :-P)

* Making decorators(WIP, commit so that I don't lose work)

* Decorator made and decorating of functions done(some other changes)

* import fixes and removed temporary test function

* Fixed new broken tests from daemon refactor

* Sanitization of modules

* Reworded errors

* wallet unlock condition checks, fixed breaking changes

* Rebased on amster and other crazy stuff

* Started writing tests

* Tests for component manager

* Fix Daemon Tests

* Fixed passing mutable args in init

* Using constants instead of strings. Added CHANGELOG.md

* Now components can be skipped by setting relevant config in file.

* P-Y-L-I-N-T #angry_emoji
 2018-07-05 15:21:52 -04:00
ocornoc
148cc96025 Changed "cliam" to "claim" and added accurate info for nsfw. (#1285) 
* Changed "cliam" to "claim" and added accurate info for nsfw.
* Update CHANGELOG.md
 2018-07-05 12:00:43 -04:00
Jack Robison
da7e7503b9
Bump version 0.20.3rc2 --> 0.20.3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-03 14:32:38 -04:00
Jack Robison
5adcc86f40
Bump version 0.20.3rc1 --> 0.20.3rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-03 13:10:35 -04:00
Victor Shyba
1cc7ce69ab set the peer search timeout as configured and raise it to 30s 2018-07-03 13:47:00 -03:00
Victor Shyba
7e0784d8e0 log a warning when peer search times out for real 2018-07-03 12:20:33 -03:00
Victor Shyba
56613a71d5 let find value run until it finds a value 2018-07-03 11:51:39 -03:00
Jack Robison
2b0d4c1603
Bump version 0.20.2 --> 0.20.3rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-02 17:24:30 -04:00
Jack Robison
929a0cc5af
exclude self and querying node from closest contacts 2018-07-02 14:54:03 -04:00
Jack Robison
b6289d101d
fix improper sorting when getting the closest peers to a hash 2018-07-02 14:54:03 -04:00
Jack Robison
7fe92d2df0
load all finished blobs into the node datastore 2018-07-02 14:31:09 -04:00
Jack Robison
03769b94b8
accept invalid store tokens for the first expire-time after startup 
this is to better handle nodes storing to us after we've restarted our node
 2018-07-02 13:26:38 -04:00
Jack Robison
c2dc872a54
fix file manager startup locking up when there are many files in a channel 2018-06-29 21:45:30 -04:00
Jack Robison
e0ceaba655
fix blob_list raising an error when blobs in a stream haven't yet been created 2018-06-25 16:47:23 -04:00
Victor Shyba
c5f4f58221 collect finished deferred before cancel call 2018-06-23 18:23:25 -03:00
Jack Robison
12d1b93b5d
Bump version 0.20.2rc3 --> 0.20.2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-23 11:53:23 -04:00
Jack Robison
34febf75f9
Bump version 0.20.2rc2 --> 0.20.2rc3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-22 19:15:46 -04:00
Jack Robison
140c45b01f
Revert "add download progress and is downloading flag to daemon status (#1266)" 
This reverts commit 2fa2269
 2018-06-22 18:54:22 -04:00
Akinwale Ariwodola
2fa2269cc7
add download progress and is downloading flag to daemon status (#1266) 2018-06-21 23:49:22 +01:00
Jack Robison
4bcf0ab7fb
Bump version 0.20.2rc1 --> 0.20.2rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-20 17:07:54 -04:00
Jack Robison
61a7fd66bf
batch insert/update claims to sqlite 2018-06-20 16:08:12 -04:00
Jack Robison
889b2facce
Bump version 0.20.1 --> 0.20.2rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-20 16:01:24 -04:00
Jack Robison
e435a9f722
Bump version 0.20.1rc5 --> 0.20.1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-19 14:05:16 -04:00
Jack Robison
ba52574091
Bump version 0.20.1rc4 --> 0.20.1rc5 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-19 13:51:12 -04:00
Jack Robison
eb660e23b7
fix download being stopped if the sd blob downloaded and data did not start within the timeout 
fixes https://github.com/lbryio/lbry/issues/1172
 2018-06-19 13:38:25 -04:00
Jack Robison
89bc26191c
fix wallet startup locking up if a lbryumx server is unavailable 2018-06-18 18:42:48 -04:00
Jack Robison
5edd8deb63
fix blob client protocol not tearing itself down properly after a failure 2018-06-18 15:30:35 -04:00
hackrush
371b27b116 Fix approximations in bid during publish 2018-06-18 10:40:33 -04:00
Jack Robison
db15169ca6
Bump version 0.20.1rc3 --> 0.20.1rc4 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-15 14:38:23 -04:00
Jack Robison
71e2c545fc
Merge branch 'fix-1165' 2018-06-15 14:38:01 -04:00
Jack Robison
3270693a8f
Bump version 0.20.1rc2 --> 0.20.1rc3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-15 14:36:31 -04:00
Jack Robison
c26816c92d
fix database error when updating a claim that we don't have a file for (https://github.com/lbryio/lbry/issues/1165) 2018-06-15 10:21:37 -04:00
Jack Robison
e83ff47722
Bump version 0.20.1rc1 --> 0.20.1rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-15 10:19:43 -04:00
Jack Robison
4c97d2af2e
fix request_needed_blobs for partially reflected streams 2018-06-15 10:10:49 -04:00
Jack Robison
42daf0fc3f
Bump version 0.20.0 --> 0.20.1rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-14 17:55:10 -04:00
Jack Robison
70355145a0
fix race condition when inserting a blob to the database 2018-06-14 15:15:16 -04:00
Jack Robison
e6df378e9e
fix token validation error when the dht node has just been started (https://github.com/lbryio/lbry/issues/1248) 2018-06-14 15:07:10 -04:00
Lex Berezhny
e11a2e6f85
publish accepts decimal string for the bid value 2018-06-13 16:52:35 -04:00
Jack Robison
7030547849
Bump version 0.20.0rc14 --> 0.20.0 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-13 15:36:49 -04:00
Jack Robison
df7a59f40a
skip test on appveyor 2018-06-13 14:04:14 -04:00
jleute
0dbd15df7b Merge remote-tracking branch 'upstream/master' 2018-06-12 00:27:08 +02:00
jleute
9735373eef remove dependency on server_list_reverse 2018-06-12 00:10:23 +02:00
jleute
acbe3b0f65 updated test to compare original and saved config file 2018-06-12 00:06:49 +02:00
jleute
ea7ef54174 remove unused import 2018-06-12 00:06:24 +02:00
jleute
cfe5eb5d56 clean up temporary conf file 2018-06-12 00:06:21 +02:00
jleute
e00238427b add assert to test_load_save_load_config_file test 2018-06-12 00:05:50 +02:00
jleute
5926b17871 Updated unittest for saving of server lists in the conf file 2018-06-12 00:05:49 +02:00
jleute
2e3ceedc17 added unit test for reversal of conversion of config file entries 2018-06-12 00:04:35 +02:00
jleute
c411d8700b fixes #1109 2018-06-12 00:04:35 +02:00
Jack Robison
0ae89f01e6 Revert "WIP: feature/1098/sorted-claim-results" 2018-06-12 00:04:32 +02:00
Sergey Rozhnov
d66bce814c refactored unit test for sort_claim_results 2018-06-12 00:03:30 +02:00
Sergey Rozhnov
c290fb5908 refactored sorting of claims and unit tests 2018-06-12 00:02:48 +02:00
Sergey Rozhnov
156b132070 implemented additional test cases for claims sorting; updated changelog 2018-06-12 00:01:36 +02:00
Sergey Rozhnov
b770b2de6a simplified claims comparison logic; refactored unit tests 2018-06-12 00:01:36 +02:00
Sergey Rozhnov
c7ba82dc07 claim_list and claim_list_mine in Daemon return sorted results 2018-06-12 00:01:32 +02:00
Jack Robison
c0c12adefa
Bump version 0.20.0rc13 --> 0.20.0rc14 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-09 11:26:41 -04:00
Jack Robison
9219e5976e
update default lbryum servers 2018-06-09 11:26:26 -04:00
Jack Robison
2619c396d9
Bump version 0.20.0rc12 --> 0.20.0rc13 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-08 13:50:35 -04:00
Jack Robison
a1218ea565
Merge remote-tracking branch 'origin/fix_prm' 2018-06-08 13:50:23 -04:00
Jack Robison
b92800158e
Bump version 0.20.0rc11 --> 0.20.0rc12 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-08 13:49:36 -04:00
Jack Robison
d87d8875f6
fix migration error caused by using a current create tables query mid migration 2018-06-08 13:28:49 -04:00
Victor Shyba
8598280654 fix base brm to prm typo 2018-06-08 11:16:21 -03:00
Jack Robison
f0c732644a
Bump version 0.20.0rc10 --> 0.20.0rc11 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-07 15:18:30 -04:00
Jack Robison
1d0106929c
move daemon test to the same folder as the others 2018-06-07 15:02:47 -04:00
Jack Robison
a821647fbc
pylint and appveyor 2018-06-07 15:02:47 -04:00
Jack Robison
7f3ead67bf
disable forced bucket refresh during join 2018-06-07 15:02:47 -04:00
Jack Robison
f3e848b2e2
work around upnp bug 
this fixes an incorrectly raised mapping conflict error which the router raises when there is a redirect for the same internal port and a different lan address.
 2018-06-07 15:02:47 -04:00
Jack Robison
b0e4fc4faa
fix iterative find lockup 2018-06-07 15:02:47 -04:00
Jack Robison
af096aee41
update test 2018-06-07 15:02:47 -04:00
Jack Robison
ae631f05c3
fix teardown error 2018-06-07 15:02:47 -04:00
Jack Robison
bc0da5e2d1
only use seeds in iterative bootstrap if no contacts are known yet 2018-06-07 15:02:47 -04:00
Jack Robison
16cb6d8657
remove Session._join_deferred 2018-06-07 15:02:47 -04:00
Jack Robison
44644673d7
add profiler 2018-06-07 15:02:47 -04:00
Jack Robison
e8b402f998
remove deferredLock from iterativeFind 
-fire the first iteration right away
 2018-06-07 15:02:47 -04:00
Jack Robison
adca5f5993
fix routing_table_get 2018-06-07 15:02:47 -04:00
Jack Robison
4fbaaac3f3
default new contacts to protocol version 0 2018-06-07 15:02:47 -04:00
Jack Robison
db06191c33
reduce default concurrent announcers to 10 
-lower rpc timeout to what it originally was
 2018-06-07 15:02:47 -04:00
Jack Robison
b0a741b1f4
fix hash announcer semaphore 2018-06-07 15:02:47 -04:00
Jack Robison
537df6c8ad
log socket errors 2018-06-07 15:02:47 -04:00
Jack Robison
42eb172638
refactor announceHaveBlob 
-add cached `token` to Contact objects to minimize findValue requests
-remove self_store, always store to remote contacts even if we're the closest known node to the hash
-move the store call and error handling from announceHaveBlob to a smaller function of its own
 2018-06-07 15:02:47 -04:00
Jack Robison
9a63db4ec6
add protocol version to the dht and migrate old arg format for store 2018-06-07 15:02:47 -04:00
Jack Robison
7d21cc5822
pylint and more tests 2018-06-07 15:02:47 -04:00
Jack Robison
cce3c8c7b5
increase kademlia rpc timeout to 8 seconds 2018-06-07 15:02:47 -04:00
Jack Robison
0e80123615
use 12 minutes instead of 15 as delay in contact_is_good 2018-06-07 15:02:47 -04:00
Jack Robison
659632b66c
fix and update tests 2018-06-07 15:02:47 -04:00
Jack Robison
545930cea4
dht test environment fixes 2018-06-07 15:02:47 -04:00
Jack Robison
9582b7fcf5
use maybe_ping for refreshing stale buckets and storing peers 
-move store refresh to its own looping call
 2018-06-07 15:02:47 -04:00
Jack Robison
945da5985e
fix age used in datastore to determine if a value is expired 2018-06-07 15:02:47 -04:00
Jack Robison
921ee3c4c1
use refreshTimeout in getRefreshList 2018-06-07 15:02:47 -04:00
Jack Robison
8efede6ad6
maybe_ping bad and unknown contacts instead of only unknown 2018-06-07 15:02:47 -04:00
Jack Robison
fb3aac15fa
add optional delay argument to enqueue_maybe_ping, fix default value 2018-06-07 15:02:47 -04:00
Jack Robison
73e813f9ec
verify key size in Distance 2018-06-07 15:02:47 -04:00
Jack Robison
0d23c68797
raise attribute error for non-rpc functions in Contact 2018-06-07 15:02:47 -04:00
Jack Robison
ec1b6b2387
comments, cleaner key_bits constant 2018-06-07 15:02:47 -04:00
Jack Robison
29d5750371
pylint 2018-06-07 15:02:47 -04:00
Jack Robison
07f92014d7
omit bad contacts from getPeersForBlob 
-refresh stored contacts to detect when they go offline or come back
 2018-06-07 15:02:47 -04:00
Jack Robison
98e21cdba0
test re-join dht 2018-06-07 15:02:47 -04:00
Jack Robison
c521120b17
update and fix hash announcer test 2018-06-07 15:02:47 -04:00
Jack Robison
d02ed29e50
add kademlia store and expiration test 2018-06-07 15:02:47 -04:00
Jack Robison
470ebe2de3
remove unnecessary CallLaterManager from test_contact_rpc 2018-06-07 15:02:47 -04:00
Jack Robison
b5f3ed5542
update contact expiration test and add re-join after expiration test 2018-06-07 15:02:47 -04:00
Jack Robison
877da78505
ping contacts right away during refresh instead of using PingQueue 
-fixes contact expiration test
 2018-06-07 15:02:47 -04:00
Jack Robison
a952d2d2c8
reset _listeningPort and _listening Deferred on teardown 2018-06-07 15:02:47 -04:00
Jack Robison
3dfc6bd2cc
update CallLaterManager to be an object 2018-06-07 15:02:47 -04:00
Jack Robison
760417ff3a
pylint 2018-06-07 15:02:47 -04:00
Jack Robison
7da70cc02d
test peer expiration 2018-06-07 15:02:47 -04:00
Jack Robison
d3f4155a2b
add unit tests for contact_is_good 2018-06-07 15:02:47 -04:00
Jack Robison
d250e4d91a
add iterative find test 2018-06-07 15:02:47 -04:00
Jack Robison
950ec5bc9a
update mocks and dht tests 
-reorganize dht tests
 2018-06-07 15:02:47 -04:00
Jack Robison
bdd6f948ca
add port to routing_table_get 2018-06-07 15:02:47 -04:00
Jack Robison
cc32d987b2
update peer_list 2018-06-07 15:02:47 -04:00
Jack Robison
4f72098cad
use PingQueue to try refresh all contacts 2018-06-07 15:02:47 -04:00
Jack Robison
9920ff59d4
force KBucket refreshes 2018-06-07 15:02:47 -04:00
Jack Robison
ae22468fec
fix CallLaterManager trying to remove pending calls multiple times 2018-06-07 15:02:47 -04:00
Jack Robison
aee7a3aa38
simplify announceHaveBlob, remove unused getPeersForBlob 2018-06-07 15:02:47 -04:00
Jack Robison
372fb45e06
refactor dht bootstrap 
after finding the closest nodes try to populate the buckets out by looking up random ids in their key ranges
 2018-06-07 15:02:47 -04:00
Jack Robison
c65274e9e5
add PingQueue to KademliaProtocol 2018-06-07 15:02:47 -04:00
Jack Robison
1adf4f7818
fix constant used to check if a bucket is fresh 2018-06-07 15:02:47 -04:00
Jack Robison
05241012a2
update contact replacement in KBucket to follow BEP0005 
http://www.bittorrent.org/beps/bep_0005.html
 2018-06-07 15:02:47 -04:00
Jack Robison
cf3359044d
fix conditions for when a kbucket should be split 
https://stackoverflow.com/a/32187456
 2018-06-07 15:02:47 -04:00
Jack Robison
5631a24881
improve findCloseNodes, choose closest contacts from higher and lower buckets 2018-06-07 15:02:47 -04:00
Jack Robison
c654bfe296
use reactor clock in TreeRoutingTable instead of time module 2018-06-07 15:02:47 -04:00
Jack Robison
d4e28216a0
sort KBucket.getContacts 2018-06-07 15:02:47 -04:00
Jack Robison
95ed1e044b
raise TransportNotConnected instead of logging a warning 
-add a _listening Deferred to KademliaProtocol which is called when the protocol is started
 2018-06-07 15:02:47 -04:00
Jack Robison
f1e0a784d9
refactor iterativeFind, move to own file 2018-06-07 15:02:47 -04:00
Jack Robison
e5703833cf
prevent duplicate entries in the datastore 2018-06-07 15:02:47 -04:00
Jack Robison
23c202b5e4
refactor Contact class, DHT RPCs, and Contact addition/removal 
-track contact failures, last replied, and last requested. use this to provide a 'contact_is_good' property on Contact objects
-ensure no duplicate contact objects are created
-remove confusing conflation of node id strings with Contact objects, update docstrings
-move RPC failure tracking to a callback/errback pair in sendRPC (so the contact is only updated once)
-handle seed nodes during the join sequence by setting their node ids after they initially reply to our ping
-name all of the kademlia RPC keyword args, remove confusing **kwargs and dictionary parsing
-add host ip/port to DHT send/receive logging to make the results comprehensible when running many nodes at once
 2018-06-07 15:02:47 -04:00
Jack Robison
ad2dcf0893
add the parent node id to KBucket 2018-06-07 15:02:47 -04:00
Jack Robison
406ddaa4ef
use base class to simplify Node init 
-add looping call helpers which use the same clock as the Node
 2018-06-07 15:02:47 -04:00
Jack Robison
e52689a33d
remove OptimizedTreeRoutingTable for now, use TreeRoutingTable 2018-06-07 15:02:47 -04:00
Jack Robison
d65dc0aec3
disable loading DictDataStore in Node.__init__ 
-to be re-done when the datastore uses sqlite
 2018-06-07 15:02:47 -04:00
Jack Robison
159e153393
make DataStore clock mockable 2018-06-07 15:02:47 -04:00
Jack Robison
9ed08f8fc9
remove unused constant 2018-06-07 15:02:47 -04:00
Jack Robison
a503a800ca
disable Cryptonator exchange rate feed 2018-06-07 15:02:47 -04:00
Jack Robison
b673c508cc
disable NegotiatedPaymentRateManager, use OnlyFreePaymentsManager for now 2018-06-07 15:02:47 -04:00
Jack Robison
4bd9f3bd68
remove popular hash tracking, simplify DHTPeerFinder 2018-06-07 15:02:47 -04:00
Jack Robison
e6ffd7caf8
remove hashwatcher 2018-06-07 15:02:47 -04:00
Victor Shyba
b91181e640 refactor: simplify add_completed_blob + changelog 2018-05-30 16:19:49 -03:00
Lex Berezhny
23df1d0316
Merge branch 'master' into feature/file_list_sorting 2018-05-29 22:47:09 -04:00
Lex Berezhny
3d17c92bd3 moved import certifi to run only on windows 2018-05-29 22:36:37 -04:00
Akinwale Ariwodola
c4550ef5b6 remove unused import in lbrynet.daemon.Daemon 2018-05-29 22:36:37 -04:00
Akinwale Ariwodola
97547e904e add os and sys imports 2018-05-29 22:36:37 -04:00
Victor Shyba
03968f377e change fix position to before anything else starts 2018-05-29 22:36:37 -04:00
Akinwale Ariwodola
513f5d0568 added certifi package for Twisted SSL verification on Windows 2018-05-29 22:36:37 -04:00
Jack Robison
02bcc98a6a
Bump version 0.20.0rc9 --> 0.20.0rc10 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-05-29 15:56:58 -04:00
Jack Robison
e3265714ee
Merge remote-tracking branch 'origin/1193' 2018-05-29 15:25:17 -04:00
Jack Robison
4b766eeea9
Merge remote-tracking branch 'origin/linux_analytics' 2018-05-29 15:20:46 -04:00
Lex Berezhny
6a344539a0 moved import distro into conditional statement that only runs on Linux 2018-05-29 14:49:06 -04:00
Jack Robison
9b1e687b9b
pylint 2018-05-29 14:36:00 -04:00
Sergey Rozhnov
11b882879a predictable result sorting for claim_list and claim_list_mine 2018-05-29 13:07:11 -04:00
Lex Berezhny
09e272a642 style fix 2018-05-29 12:45:42 -04:00
Lex Berezhny
d950a62200 include the new linux analytics in track events 2018-05-28 18:47:56 -04:00
Lex Berezhny
1b027fae87 add some extra linux meta data to analytics 2018-05-28 18:07:23 -04:00
Jack Robison
187f920961
disable Daemon headers check for now 2018-05-28 10:57:48 -04:00
Jack Robison
6d4b678b96
Revert "WIP: feature/1098/sorted-claim-results" 2018-05-22 17:15:34 -04:00
kafene
76a7cc4e58 refactor file list sorting per request 2018-05-21 00:24:18 -04:00
kafene
1790393273 remove unused attrgetter import 2018-05-21 00:04:27 -04:00
kafene
5069351287 refactor file_list sort to allow sorting by any field 2018-05-21 00:04:27 -04:00
kafene
72bae90e06 use range instead of xrange, list is only 10 elements and range works in python3 2018-05-21 00:04:27 -04:00
kafene
852354719f add unit test for file list sorting 2018-05-21 00:04:27 -04:00
kafene
eec3734d2f some semantic variable renaing 2018-05-21 00:04:27 -04:00
kafene
e7b22521ee remove pprint import 2018-05-21 00:04:27 -04:00
kafene
326d0cb8a3 initial naive implementation of file_list sorting 2018-05-21 00:04:21 -04:00
Sergey Rozhnov
13353bcfe4 refactored unit test for sort_claim_results 2018-05-18 18:51:28 +04:00
Sergey Rozhnov
40bcf96c3d refactored sorting of claims and unit tests 2018-05-18 12:53:32 +04:00
Victor Shyba
b48492c1d6 verify streams on a new migration instead 2018-05-17 12:29:12 -03:00
Sergey Rozhnov
3d0f74c8ce implemented additional test cases for claims sorting; updated changelog 2018-05-17 13:49:09 +04:00
Sergey Rozhnov
a7a5bb8887 simplified claims comparison logic; refactored unit tests 2018-05-17 13:36:32 +04:00
Sergey Rozhnov
208284a0f8 claim_list and claim_list_mine in Daemon return sorted results 2018-05-16 18:29:44 +04:00
Victor Shyba
b6cedfec56 batch-start the file manager 2018-05-11 12:17:55 -03:00
Victor Shyba
ca86af736e add batching support to get_supports and tests 2018-05-11 12:17:55 -03:00
Victor Shyba
d55ded78ee get claim with channel_name from a stream hash in a single query 2018-05-11 12:17:55 -03:00
Victor Shyba
acd330aa2a get claim info and channel name using a single query 2018-05-11 12:17:55 -03:00
Victor Shyba
df735252e5 verify streams only after migration 2018-05-11 12:17:55 -03:00
Jack Robison
b3bf193188
Merge remote-tracking branch 'origin/treq_and_cryptography' 2018-05-11 09:22:28 -04:00
Victor Shyba
a0a7187f7d add integrity checks after s3 download as well 2018-05-08 16:09:06 -03:00
Jack Robison
aa4240de85
track successful reflector uploads in sqlite to minimize how many streams are attempted by auto re-reflect 
-increase the default `auto_re_reflect_interval` to a day
 2018-05-08 14:41:56 -04:00
Victor Shyba
2299098884 add integrity check for the headers file 2018-05-07 15:10:19 -03:00
Victor Shyba
fd04c607b2 typos and fixes from code review 2018-05-07 13:11:31 -03:00
Victor Shyba
805bfbd18e remove point trader testing client 2018-05-07 11:49:54 -03:00
Victor Shyba
3ee0f9756d add treq as a dependency + pep8 2018-05-05 20:58:10 -03:00
Victor Shyba
c90140f701 make the exchange manager use treq instead of requests 2018-05-05 02:33:37 -03:00
Victor Shyba
e170f3db3e remove txrequests dependency 2018-05-05 02:20:21 -03:00
Victor Shyba
7f88dda0ae use treq on loggly 2018-05-05 02:18:03 -03:00
Victor Shyba
0bf65836c7 resume download from S3 instead of starting from scratch 2018-05-05 02:05:02 -03:00
Victor Shyba
3982e15091 download headers from s3 using treq 2018-05-05 01:16:26 -03:00
Victor Shyba
d03fc80eac make analytics use treq 2018-05-05 00:50:42 -03:00
Victor Shyba
fab932abb6 replace pycrypto->cryptography 2018-05-04 23:56:51 -03:00
Victor Shyba
b389e59452 replace pycrypto->cryptography on tests 2018-05-04 22:12:43 -03:00
Jack Robison
cc34c4b95f
Merge pull request #1189 from lbryio/faster-headers 
magic
 2018-05-04 11:10:43 -04:00
Thomas Zarebczan
df2339231a
magic 2018-05-04 00:47:08 -04:00
Jack Robison
6977d6944e
show local, remote, and s3 header heights in the log 2018-05-02 17:25:00 -04:00
Jack Robison
f1e3682302
socket might not have TCP_KEEPx attributes 2018-05-02 17:16:00 -04:00
Jack Robison
f42733ecba
fix tests 2018-05-02 15:00:57 -04:00
Jack Robison
129d2687b9
download headers from s3 when more than 10 chunks behind 2018-05-02 15:00:50 -04:00
Jack Robison
1f1b348638
fix handling ancient non-decodable claims 2018-04-19 17:37:23 -04:00
Jack Robison
8b7e86e046
fix appveyor? 2018-04-19 17:36:26 -04:00
Jack Robison
fe6a850fc5
appveyor 2018-04-19 17:11:27 -04:00
Jack Robison
9c25a37d4d
Bump version 0.20.0rc8 --> 0.20.0rc9 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-04-19 17:04:48 -04:00
Jack Robison
1e87767a0c
fix appveyor 2018-04-19 16:56:48 -04:00
Jack Robison
487ef6516e
fix reflector test 2018-04-19 16:35:15 -04:00
Jack Robison
4a1f3a79a5
fix mock announcer 2018-04-19 16:18:19 -04:00
Jack Robison
11aad04c31
datagram decode error logging 2018-04-19 15:47:42 -04:00
Jack Robison
b89823c968
fix blob announce locking up the daemon process 2018-04-19 15:47:19 -04:00
Jack Robison
baf55165aa
lint 2018-04-19 14:35:11 -04:00
Jack Robison
769bc2e36e
Revert "elif" 
This reverts commit c3e047a2aa.
 2018-04-19 14:34:49 -04:00
Alex Grintsvayg
c3e047a2aa elif 2018-04-19 13:47:24 -04:00
Jack Robison
1c793931ed
Bump version 0.20.0rc7 --> 0.20.0rc8 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-04-19 12:31:54 -04:00
Jack Robison
fa49b40389
fix claim_show 2018-04-19 12:31:36 -04:00
Jack Robison
89b4487eb9
Bump version 0.20.0rc6 --> 0.20.0rc7 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-04-19 11:05:42 -04:00
Jack Robison
450bed6350
fix kwargs bug 2018-04-19 11:00:44 -04:00
Alex Grintsvayg
f8e418fb44 undeprecated report_bug while app team works on a new bug reporting flow 2018-04-18 14:58:58 -04:00
Jack Robison
2655797692
move docs tests to own file 2018-04-12 14:04:22 -04:00
Niko
c089f1954a
fix documentation for blob_reflect 2018-04-12 13:27:06 -04:00
Niko
0a14d51b96
fix documentation for peer_ping command 2018-04-12 13:08:58 -04:00
Jack Robison
bb7e17e54a
Bump version 0.20.0rc5 --> 0.20.0rc6 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-04-03 13:21:17 -04:00
Jack Robison
5cea031f38
return list of dictionaries from peer_list, include peer node ids 2018-04-03 13:10:30 -04:00
Jack Robison
2903ccaeb4
add peer_ping 2018-04-03 13:10:30 -04:00
Jack Robison
eae97a8133
off by one 2018-04-03 13:08:36 -04:00
Jack Robison
bc3128ae3b
Bump version 0.20.0rc4 --> 0.20.0rc5 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-04-03 12:34:45 -04:00
Jack Robison
4e7bdafdcf
fix positional and keyword args 2018-04-03 12:27:49 -04:00
Jack Robison
12d378af13
show not connected error in lbrynet-cli when using auth 2018-04-03 12:25:18 -04:00
Jack Robison
ca73d632d3
Bump version 0.20.0rc3 --> 0.20.0rc4 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-04-02 10:13:02 -04:00
Jack Robison
743ae59d54
fix lbrynet-cli when using authentication 
-add explanation of daemon authentication to AuthJSONRPCServer docstring
-remove auth_required decorator, use auth for all api methods if use_authentication is true
-fix issues with the command line --http-auth flag to lbrynet-daemon and the use_http_auth setting in the config file
 2018-04-01 18:31:03 -04:00
Jack Robison
ea5190aa9a
Bump version 0.20.0rc2 --> 0.20.0rc3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-29 15:06:41 -04:00
Jack Robison
51662b1e5b
re-add hash_queue_size function 2018-03-29 15:06:08 -04:00
Jack Robison
789ca3693f
Bump version 0.20.0rc1 --> 0.20.0rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-29 12:20:54 -04:00
Jack Robison
8c2b626f97
fix cli kwargs 2018-03-29 12:19:41 -04:00
Jack Robison
0279d37b32
fix status docstring 2018-03-29 12:19:18 -04:00
Jack Robison
f4aca40ff9
Bump version 0.19.3rc2 --> 0.20.0rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-29 09:55:34 -04:00
Jack Robison
08e9f9ac0e
Bump version 0.19.3rc1 --> 0.19.3rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-29 09:50:14 -04:00
Jack Robison
9a9b2f47ce
pass sd_hash to reflector client factory instead of looking it up 2018-03-29 09:46:34 -04:00
Jack Robison
b9600101ae
Bump version 0.19.2 --> 0.19.3rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-28 19:36:39 -04:00
Jack Robison
492858596e
add single_announce column to blob table 
-remove deprecated blob_announce_all function
-remove announce_all parameter to blob_announce
-change blob_announce to be asynchronous
 2018-03-28 18:50:24 -04:00
Jack Robison
dff1fd3fe9
logging, raise default concurrent announcers 2018-03-28 18:50:24 -04:00
Jack Robison
eabf4a0e40
remove delay from udp write 2018-03-28 18:50:24 -04:00
Jack Robison
5bab6f7d39
remove bandwidth stats 2018-03-28 18:50:24 -04:00
Jack Robison
a41bbd5e27
pylint and tests 2018-03-28 18:50:18 -04:00
Jack Robison
43d3f7c087
add concurrent_announcers to config 2018-03-28 15:53:51 -04:00
Jack Robison
c5bf64cf0a
refactor DHTHashAnnouncer 
-remove hash_announcer from Node and DiskBlobManager
-remove announcement related functions from DiskBlobManager
-update SQLiteStorage to store announcement times and provide blob hashes needing to be announced
-use dataExpireTimeout from lbrynet.dht.constants for re-announce timing
-use DeferredSemaphore for concurrent blob announcement
 2018-03-28 15:53:51 -04:00
Jack Robison
ea0ea704a2
refactor iterativeAnnounceHaveBlob 
-change to only self_store if the number of contacts to store to is less than k and we are the closest node to the hash
 2018-03-28 15:53:51 -04:00
Jack Robison
14f9bb7b82
log EWOULDBLOCK 2018-03-28 15:53:51 -04:00
Jack Robison
a8025b02c6
log invalid vs missing token 2018-03-28 15:53:51 -04:00
Jack Robison
333d70860b
add last_announced_time to blob table 2018-03-28 15:53:50 -04:00
Lex Berezhny
267f50474b
removing more references to PTCWallet 2018-03-28 15:53:50 -04:00
Lex Berezhny
866f220d9b
removed PTCWallet 2018-03-28 15:53:50 -04:00
Jack Robison
a96d827c0f
use reactor time in Delay 2018-03-28 15:53:50 -04:00
Jack Robison
4eab77fa10
safe start_listening 2018-03-28 15:53:50 -04:00
Jack Robison
5013426e02
logging and docstring 2018-03-28 15:53:50 -04:00
Jack Robison
cb09be5336
remove unused stuff 2018-03-28 15:53:50 -04:00
Lex Berezhny
339e666f38
+ Wallet.wait_for_tx_in_wallet 2018-03-28 15:53:49 -04:00
Jack Robison
ebe5dd0e68
better ping test 2018-03-28 15:53:49 -04:00
Jack Robison
1db44d5fb6
rename variable 2018-03-28 15:53:49 -04:00
Jack Robison
fd7a771f66
add sanity check to CreateEncryptedFileTest 2018-03-28 15:53:49 -04:00
Jack Robison
5628d0825b
add CallLaterManager 2018-03-28 15:53:49 -04:00
Jack Robison
88970cb0a8
move peer manager class to lbrynet.core 2018-03-28 15:53:49 -04:00
Jack Robison
d2a6dd3ed3
add dht functional tests 2018-03-28 15:53:49 -04:00
Jack Robison
1eff35ce76
update dht unit tests to use task.Clock 2018-03-28 15:53:49 -04:00
Jack Robison
0ab5dd28bc
update tests 2018-03-28 15:53:48 -04:00
Jack Robison
2e30ce9ae5
add mock udp transport layer 2018-03-28 15:53:48 -04:00
Jack Robison
87c69742cd
log packet encoding errors and warn if the transport is not connected 2018-03-28 15:53:48 -04:00
Jack Robison
b4bc5e2110
cancel callLater on error or timeout 2018-03-28 15:53:48 -04:00
Jack Robison
df78f7ff9f
add response assertion to announce_to_peer 2018-03-28 15:53:48 -04:00
Jack Robison
bdba263224
catch TimeoutError in _IterativeFindHelper 2018-03-28 15:53:48 -04:00
Jack Robison
16fcc3f5c1
findValue inlinecallbacks refactor 2018-03-28 15:53:48 -04:00
Jack Robison
43896c8d17
refactor joinNetwork into smaller functions 
-try to re-join network if no contacts are known
 2018-03-28 15:53:47 -04:00
Jack Robison
04e76443c6
move dht node component setup from Session into Node 2018-03-28 15:53:47 -04:00
Jack Robison
e6caedac91
remove DHTHashSupplier class, move former functions into DHTHashAnnouncer 2018-03-28 15:53:47 -04:00
Jack Robison
6666468640
add reactor arguments to Node 
-adds reactor (clock) and reactor functions listenUDP, callLater, and resolve as arguments to Node.__init__
-set the reactor clock on LoopingCalls to make them easily testable
-convert callLater manage loops to LoopingCalls
 2018-03-28 15:53:47 -04:00
Jack Robison
efaa97216f
move dht node setup back into node class 2018-03-28 15:53:47 -04:00
Jack Robison
e30ea50ef4
more 2018-03-28 15:53:47 -04:00
Jack Robison
3296c0fb3d
move dht related classes to lbrynet.dht 2018-03-28 15:53:47 -04:00
Jack Robison
54a152fa8e
fix merge conflict in dht tests 2018-03-28 15:53:46 -04:00
Kay Kurokawa
9088d152b5
better to keey track of retry count in function instead of unbounded dictionary 2018-03-28 15:53:46 -04:00
Kay Kurokawa
4cb461601e
result must be set here, otherwise it will not be defined when used later. Add test for it 2018-03-28 15:53:46 -04:00
Kay Kurokawa
0425c95b68
No need for clock now in test for DHTHashAnnouncer 2018-03-28 15:53:46 -04:00
Kay Kurokawa
75b977dff9
we just have one supplier not a list of suppliers 2018-03-28 15:53:46 -04:00
Kay Kurokawa
60c7261871
add single_hash_announce_duration as a field that gets return for API call status for dht status 2018-03-28 15:53:46 -04:00
Kay Kurokawa
0f3385e4dc
make the single hash announce duration adjustable in DHTHashSupplier 2018-03-28 15:53:46 -04:00
Jack Robison
ad6a2bef7f
handle error from old clients with a broken ping command 2018-03-28 15:53:45 -04:00
Jack Robison
446c3a88dc
refactor DHTHashAnnouncer and iterativeAnnounceHaveBlob 
-use looping call for running manage function rather than a scheduled
callLater

-track announce speed

-retry store requests that failed up to 3 times

-return a dict of {blob_hash: [storing_node_id]} results from
_announce_hashes

_refreshRoutingTable inline cb refactor

-add and use DeferredLockContextManager

-don't trap errback from iterativeFindNode in iterativeAnnounceHaveBlob
 2018-03-28 15:53:45 -04:00
Jack Robison
67ef8be7b7
convert node manage function to a looping call 2018-03-28 15:53:45 -04:00
Jack Robison
ecbe4113ce
move Distance to own file 2018-03-28 15:53:45 -04:00
Jack Robison
b75c8d96ce
Bump version 0.19.2rc3 --> 0.19.2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-28 15:35:46 -04:00
Jack Robison
cb83531d05
Bump version 0.19.2rc2 --> 0.19.2rc3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-28 15:15:47 -04:00
Jack Robison
dc65fd148e
Bump version 0.19.2rc1 --> 0.19.2rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-26 13:36:51 -04:00
Jack Robison
439a0f8778
fix docstrings 
-add docopt unit test
 2018-03-26 13:20:33 -04:00
hackrush
aa7b440989 Fixed regression in stream_availablity command 2018-03-26 19:43:06 +05:30
Jack Robison
f0742675b8
Merge branch 'master' into no-short-flags 2018-03-23 14:59:53 -04:00
Alex Grintsvayg
9ee5a3511d missed this in dht-compat merge 2018-03-23 12:50:18 -04:00
Jack Robison
69657750b8
Bump version 0.19.1 --> 0.19.2rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-22 17:04:12 -04:00
Jack Robison
cb069ca002
add blob_reflect 2018-03-22 16:54:29 -04:00
Jack Robison
3085e28490
don't try to resend failed blobs to reflector 
-fixes infinite loop where client keeps trying to send failing blobs, which may be failing because they are invalid

-return list of reflected blob hashes from BlobReflectorClient
 2018-03-22 16:53:16 -04:00
Jack Robison
679c2f403f
fix incorrectly raised DownloadCanceledError for already verified blobs 
-make InvalidDataError message clearer
-fix BlobReflectorClient result
 2018-03-22 13:23:12 -04:00
Jack Robison
de280b5ebf
Bump version 0.19.1rc7 --> 0.19.1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-20 10:15:50 -04:00