LBRYCommunity/lbry-sdk
1
0
Fork 1
Code Issues Pull requests Projects Releases 282 Packages Wiki Activity
4451 commits 110 branches 641 tags 31 MiB
Commit graph

3105 commits

Author SHA1 Message Date
Victor Shyba
19211d4417
make sure bencoding works for bytes, not strings 2018-08-24 11:37:53 -04:00
Victor Shyba
c312d1b3a6
all unit/dht green on py3 2018-08-24 11:37:53 -04:00
Victor Shyba
e4ea1ccbfb
test_node green on py3 2018-08-24 11:37:53 -04:00
Victor Shyba
5b35c4e8f0
port dht.distance ~> py3 2018-08-24 11:37:53 -04:00
Victor Shyba
9967857a57
port dht.encoding ~> py3 2018-08-24 11:37:53 -04:00
Victor Shyba
78c560a3be
general incomplete porting of daemon booting ~> py3 2018-08-24 11:37:53 -04:00
Victor Shyba
07a12b66e8
port dht.contacts ~> py3 2018-08-24 11:37:53 -04:00
Lex Berezhny
a28c9d09c8
- fix and improvements related to the two balance command account_balance and wallet_balance 
- working CommonWorkflowTests integration test
- pylint, unit and integration test fixes
- switch integration tests to use async/await
 2018-08-24 11:37:53 -04:00
Victor Shyba
b2ab13187f
fix get_certificates 2018-08-24 11:37:53 -04:00
Victor Shyba
5ec696fbfd
fix lookup helper by not calling hexlify twice 2018-08-24 11:37:53 -04:00
Victor Shyba
44bd0ae847
fix another forgotten claim id nbo conversion 2018-08-24 11:37:53 -04:00
Victor Shyba
5809ba093d
convert amount on channel_new 2018-08-24 11:37:53 -04:00
Lex Berezhny
17aee92dc9
wallet_balance --include-unconfirmed works now 2018-08-24 11:37:53 -04:00
Victor Shyba
6f1d2e7690
fix RPC publish claim serialization 2018-08-24 11:37:53 -04:00
Victor Shyba
75f57fc517
fix claim id handling during publish from the latest changes 2018-08-24 11:37:53 -04:00
Lex Berezhny
f589410496
tests 2018-08-24 11:37:53 -04:00
Lex Berezhny
aecc7c6643
resolve works in py3!!!!!11111oneoneone 2018-08-24 11:37:53 -04:00
Victor Shyba
c5c1b62939
fix resolve from tx.id rename 2018-08-24 11:37:53 -04:00
Lex Berezhny
adc92a2b52
fix for daemon.get_est_cost 2018-08-24 11:37:53 -04:00
Lex Berezhny
0442770c9d
pylint fixes 2018-08-24 11:37:53 -04:00
Lex Berezhny
3b6a879fc9
add is_hd=true for default migrated wallet 2018-08-24 11:37:53 -04:00
Lex Berezhny
a1b4c9acd6
claim_id is hexlified before saving to sqlite 2018-08-24 11:37:53 -04:00
Lex Berezhny
159e84468c
py3 support in resolve 2018-08-24 11:37:53 -04:00
Lex Berezhny
59e4ac30c2
fixing py2 stuff that broke during py3 fixes 2018-08-24 11:37:53 -04:00
Lex Berezhny
b5ce948bc1
convert buffer to string 2018-08-24 11:37:53 -04:00
Lex Berezhny
076af7ef43
py3 compatibility updates 2018-08-24 11:37:53 -04:00
Lex Berezhny
43bef9447c
progress on publish command: py3 porting and integration tests 2018-08-24 11:37:53 -04:00
Victor Shyba
b1c5fe0b4d
cryptblob write needs bytes on py3 2018-08-24 11:37:53 -04:00
Lex Berezhny
315661208d
integration test publishes actual file instead of just sources 2018-08-24 11:37:53 -04:00
Lex Berezhny
e175e43082
.decode() string for sqlite 2018-08-24 11:37:53 -04:00
Lex Berezhny
cb9b320ed7
dropped make_claim in favor of wallet.claim_name 2018-08-24 11:37:53 -04:00
Lex Berezhny
1d906fb0c7
create_and_publish_stream fix 2018-08-24 11:37:53 -04:00
Lex Berezhny
c544e26206
publish integration test works 2018-08-24 11:37:53 -04:00
Lex Berezhny
1eaac35a3e
claim_name does not take change_address anymore 2018-08-24 11:37:53 -04:00
Lex Berezhny
cc7962fc2e
stringify address from sqlite 2018-08-24 11:37:53 -04:00
Lex Berezhny
3638984d67
fixed getting unused address 2018-08-24 11:37:53 -04:00
Lex Berezhny
774d813576
fixed encoding issue on saving wallet 2018-08-24 11:37:53 -04:00
Lex Berezhny
688caf4453
+ save wallet after creating a channel 2018-08-24 11:37:53 -04:00
Lex Berezhny
eeb5b3c139
publishing 2018-08-24 11:37:53 -04:00
Lex Berezhny
b5e6dd1060
+ maybe_migrate_certificates 2018-08-24 11:37:53 -04:00
Lex Berezhny
272d818050
saving txo bug fix 2018-08-24 11:37:53 -04:00
Lex Berezhny
0fc1bd7a8c
store claim_id 2018-08-24 11:37:53 -04:00
Lex Berezhny
2b234e0713
fix syntax error 2018-08-24 11:37:53 -04:00
Victor Shyba
9e8cb17ecb
insane working version of paged resolve, to be refactored 2018-08-24 11:37:53 -04:00
Victor Shyba
e0230864ce
creates a Resolve class for moving resolve methods out of ledger 2018-08-24 11:37:53 -04:00
Victor Shyba
9e89b3e40e
start a new module for isolating resolve related code before we can refactor it 2018-08-24 11:37:53 -04:00
Victor Shyba
036663ae62
adds get_claims_by_ids and fix a test name 2018-08-24 11:37:53 -04:00
Victor Shyba
bdd271e78f
adds resolve 2018-08-24 11:37:53 -04:00
Lex Berezhny
4a56d38782
certificate.py 2018-08-24 11:37:53 -04:00
Lex Berezhny
70a7ca95fe
wip 2018-08-24 11:37:53 -04:00
Lex Berezhny
d81502e191
unit test fixes, balance/utxos filters out claims, abandoning claims 2018-08-24 11:37:53 -04:00
Lex Berezhny
8c35d355e5
added is_claim,is_support,is_update and claim_name attributes to txo able 2018-08-24 11:37:53 -04:00
Lex Berezhny
72b004664f
config fix 2018-08-24 11:37:53 -04:00
Lex Berezhny
17738ad248
import fixes due to tests directory moving 2018-08-24 11:37:53 -04:00
Lex Berezhny
edfc2c6124
fix to make sd_hash more deterministic 2018-08-24 11:37:53 -04:00
Lex Berezhny
545451a829
moved ./lbry/tests to ./tests 2018-08-24 11:37:53 -04:00
Lex Berezhny
12ff7015cd
wallet tests and py3 compatibility 2018-08-24 11:37:53 -04:00
Lex Berezhny
f2f212edba
switch component wallet to use the new wallet 2018-08-24 11:37:53 -04:00
Lex Berezhny
69446491b8
pylint and unit test fixes 2018-08-24 11:37:50 -04:00
Lex Berezhny
d5beaa0937
jsonrpc_channel_new uses new wallet 2018-08-24 11:37:25 -04:00
Lex Berezhny
cc970c499b
daemon/auth py3 conversion, this breaks the client for now 2018-08-24 11:37:25 -04:00
Lex Berezhny
0087b16912
deleted old broken test 2018-08-24 11:37:25 -04:00
Lex Berezhny
5520d518b5
DHT py3 compatibility, mostly commenting out implements() and fixing imports 
cryptstream py3 support, mostly commenting out implements()
lbry_file py3 support, mostly commenting out implements()
file_manager py3 support, mostly commenting out implements()
core py3 support, mostly commenting out implements() and fixing imports
 2018-08-24 11:37:25 -04:00
Lex Berezhny
b3e9240aa8
wip, valuesforuris 2018-08-24 11:37:25 -04:00
Lex Berezhny
137a270488
* channel certificate creation and taking advantage of is_reserved feature on txos to exclude output from being used in new transactions 2018-08-24 11:37:25 -04:00
Lex Berezhny
e36610d63c
fix resolve 2018-08-24 11:37:25 -04:00
Lex Berezhny
c4273fbef0
claim test 2018-08-24 11:37:25 -04:00
Lex Berezhny
a4e9f3100f
updating wallet tests 2018-08-24 11:37:25 -04:00
Lex Berezhny
2668ceac0e
updated to newer torba 2018-08-24 11:37:25 -04:00
Lex Berezhny
fb2fb5c38c
recovered an old stash 2018-08-24 11:37:25 -04:00
Lex Berezhny
56175df121
wip 2018-08-24 11:37:25 -04:00
Lex Berezhny
7d3daa9fe6
set the lbryschema BLOCKCHAIN_NAME global variable 2018-08-24 11:37:25 -04:00
Lex Berezhny
1d2de27536
import fix 2018-08-24 11:37:25 -04:00
Lex Berezhny
aab42e56bd
removing lbryum 2018-08-24 11:37:25 -04:00
Lex Berezhny
1368a6e074
wallet manager refactoring 
test uses manager.send_amount_to_address instead of manually creating tx
 2018-08-24 11:37:25 -04:00
Lex Berezhny
80990b959c
moved files around 2018-08-24 11:37:25 -04:00
Lex Berezhny
053b6d1c80
removing lbryum from requirements 2018-08-24 11:37:25 -04:00
Lex Berezhny
692d8e8e1a
new wallet becoming drop-in replacement for old lbryum wallet 2018-08-24 11:37:25 -04:00
Lex Berezhny
5e71dcbaf0
wip: implementation is now generic and supports multiple currencies 2018-08-24 11:37:25 -04:00
Lex Berezhny
83958604d5
finally generating fully signed tx submittable to lbrycrd 2018-08-24 11:37:25 -04:00
Lex Berezhny
dcd8a6bb0e
branch and bound based coin selection with random draw fallback 2018-08-24 11:37:25 -04:00
Lex Berezhny
7161a0edb9
new bitcoin script parser 2018-08-24 11:37:25 -04:00
Lex Berezhny
0fd160e6e6
a lot more stuff 2018-08-24 11:37:25 -04:00
Lex Berezhny
ca8b2dd83e
wip: initial import of twisted based wallet 2018-08-24 11:37:25 -04:00
Jack Robison
79d1da5ff8
Bump version 0.21.2rc3 --> 0.21.2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-23 23:43:35 -04:00
Jack Robison
d73252b11a
Bump version 0.21.2rc2 --> 0.21.2rc3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-23 22:40:16 -04:00
Jack Robison
a7a53f9381
fix mirror downloader looping call 2018-08-23 22:36:30 -04:00
Jack Robison
f4b2a05fff
fix a typo 2018-08-23 18:35:47 -04:00
Jack Robison
cdd2b6bfc1
Bump version 0.21.2rc1 --> 0.21.2rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-23 11:57:49 -04:00
Jack Robison
26bd27cd32
Bump version 0.21.1 --> 0.21.2rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-23 11:45:07 -04:00
Jack Robison
37ddaeca12
fix ping queue bug 2018-08-23 11:18:28 -04:00
Jack Robison
2c546b2cde
retry mirror downloads 2018-08-23 11:18:28 -04:00
Alex Grintsvayg
149fa625e0 back to reflector 1 2018-08-15 16:11:34 -04:00
Jack Robison
16cda60f31
fix test 2018-08-13 17:16:48 -04:00
Jack Robison
0d54f6215f
Bump version 0.21.1rc2 --> 0.21.1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-13 16:20:16 -04:00
Jack Robison
a9774a293f
docs 2018-08-13 16:18:31 -04:00
Jack Robison
ee8cf08c0e
Bump version 0.21.1rc1 --> 0.21.1rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-13 14:04:39 -04:00
Jack Robison
ea481e6c5a
fix download_progress in blockchain_headers status 
-use a 0-100 range for percentage regardless of how much we have to download (if we're resuming or starting fresh)
-prevent negative blocks or blocks_behind counts
 2018-08-13 14:03:15 -04:00
Jack Robison
36df9e8283
Bump version 0.21.0 --> 0.21.1rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-12 22:16:00 -04:00
Jack Robison
68f1dda7b0
initialize headers download progress 2018-08-12 22:05:07 -04:00
Jack Robison
5b7f7c87bf
fix stop_lbry_files 2018-08-12 22:04:55 -04:00
Jack Robison
153022a1a7
add is_locked to status 2018-08-12 22:04:48 -04:00
Lex Berezhny
1098ca0494 + convert float to decimal for wallet_send 2018-08-09 19:14:56 -04:00
Jack Robison
d4a7dbf805
Bump version 0.21.0rc13 --> 0.21.0 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-09 13:44:28 -04:00
Jack Robison
56ee815eec
Bump version 0.21.0rc12 --> 0.21.0rc13 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-09 13:20:15 -04:00
Jack Robison
fe43764bcb
fix announcement of blobs downloaded from a http mirror 2018-08-09 13:19:59 -04:00
Jack Robison
2448d51ed5
Bump version 0.21.0rc11 --> 0.21.0rc12 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-09 12:07:35 -04:00
Jack Robison
2804fa4448
fix disabling the hash announcer 2018-08-09 12:04:14 -04:00
Jack Robison
69ae60b4bb
Bump version 0.21.0rc10 --> 0.21.0rc11 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-09 11:29:49 -04:00
Jack Robison
dca4af942f
also try/except around upnp.discover 
-catches edge case where miniupnpc fallback is used and a device is found but selectigd fails
 2018-08-09 11:28:07 -04:00
Jack Robison
2b7e135839
fix error in blob_delete 2018-08-09 11:26:57 -04:00
Jack Robison
d565aa0b3f
Bump version 0.21.0rc9 --> 0.21.0rc10 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-09 09:24:39 -04:00
Jack Robison
8b53140581
set downloading_headers to False after the download finishes or fails 2018-08-09 09:24:04 -04:00
Jack Robison
917bae568d
fix disabling blob announcement by setting concurrent announcers to 0 2018-08-09 09:22:55 -04:00
Jack Robison
efb6af4d51
Bump version 0.21.0rc8 --> 0.21.0rc9 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-09 09:01:57 -04:00
Jack Robison
5fe8022b15
don't attempt to announce blobs until we we have contacts in routing 2018-08-09 09:00:36 -04:00
Jack Robison
7931397595
Bump version 0.21.0rc7 --> 0.21.0rc8 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-09 08:44:23 -04:00
Jack Robison
0501f52805
fix upnp edge case 
-fixes https://github.com/lbryio/lbry/issues/1352
 2018-08-09 08:42:51 -04:00
Jack Robison
108d2a033b
fix attribute error when reflector component is disabled 2018-08-09 08:32:43 -04:00
Jack Robison
17a9cfd65c
Bump version 0.21.0rc6 --> 0.21.0rc7 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-08 14:12:01 -04:00
Jack Robison
8eb740cf67
Bump version 0.21.0rc5 --> 0.21.0rc6 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-08 13:58:17 -04:00
Jack Robison
b73e50e64b
Bump version 0.21.0rc4 --> 0.21.0rc5 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-07 19:27:50 -04:00
Jack Robison
c73148a1fb
Merge remote-tracking branch 'origin/fix_1346' 2018-08-07 19:27:28 -04:00
Jack Robison
65a02190dc
Merge remote-tracking branch 'origin/fix_1344' 2018-08-07 19:26:15 -04:00
Jack Robison
26e32472d5
fix upnp and peer port setup 
-bump txupnp requirement
 2018-08-07 19:04:54 -04:00
Victor Shyba
d21313e590 allow mirrors if conf is set, but clear it for tests 2018-08-07 13:55:45 -03:00
Victor Shyba
382226ff9a tells that an address is wrong earlier on publishing 2018-08-07 13:52:01 -03:00
Jack Robison
9511040d5a
fix upnp and peer port setup 2018-08-05 13:12:39 -04:00
Jack Robison
15161dd429
fix docstring 2018-08-03 13:31:51 -04:00
Jack Robison
efc5982860
Bump version 0.21.0rc3 --> 0.21.0rc4 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-08-03 13:22:06 -04:00
Jack Robison
f1b19f10cc
Merge branch 'master' into greedy_search 2018-08-03 13:08:31 -04:00
Jack Robison
e50ac69358
tests and pylint 2018-08-03 12:35:10 -04:00
Jack Robison
aef561d78b
refactor status results 2018-08-03 12:33:31 -04:00
Jack Robison
4ef4a4816f
update component tests 2018-08-03 11:37:10 -04:00
Jack Robison
8533bfa7c5
refactor test_misc, remove Session 
-use only the one process
 2018-08-03 11:37:10 -04:00
Jack Robison
6389e961b9
update (and refactor) tests to not use Session 2018-08-03 11:37:10 -04:00
Jack Robison
6359fc608e
set download_mirrors upon making the downloader instead in the file manager globally 2018-08-03 11:37:10 -04:00
Jack Robison
314400a1bd
move looping call to check announcement status to SQLiteStorage 2018-08-03 11:37:10 -04:00
Jack Robison
a3de065c93
use txupnp instead of miniupnpc 2018-08-03 11:37:07 -04:00
Jack Robison
99207b7221
delete Session.py 
split Session into Components
 2018-07-30 18:00:33 -04:00
Jack Robison
e3c3fafa1e
split headers download into own component 
-add component statuses
 2018-07-30 18:00:33 -04:00
Victor Shyba
9742da348b do not consume errors on DeferredList 2018-07-30 13:53:58 -03:00
Victor Shyba
94a31922f7 fix unnecessary logging tag 2018-07-30 11:22:31 -03:00
Victor Shyba
1937eb17c4 adds a test for stopping 2018-07-30 11:22:31 -03:00
Victor Shyba
f291ea515a add test for invalid content 2018-07-30 11:22:31 -03:00
Victor Shyba
ff4aba9423 refactor mirroring 2018-07-30 11:22:31 -03:00
hackrush
9ab256df30 fixed improper error handling when data is not valid JSON (#1326) 2018-07-30 09:38:36 -04:00
Lex Berezhny
88b8ca8a49 Revert "negate wallet lock check in components" 
This reverts commit 32507d7
 2018-07-25 14:59:10 -04:00
Jack Robison
09f637496c
Bump version 0.21.0rc2 --> 0.21.0rc3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-25 12:25:24 -04:00
Jack Robison
826d269e0e
Merge branch 'blobs_mirroring' 2018-07-25 12:24:37 -04:00
Victor Shyba
ab27203100 improve exception logging and add a docstring on the interaction between downloaders 2018-07-25 13:01:13 -03:00
Victor Shyba
88c2051605 set download_mirror conf from components change 2018-07-25 12:23:15 -03:00
Victor Shyba
f510c2a433 improve logging from review 2018-07-25 12:15:52 -03:00
Victor Shyba
ec140d5d8a changes from code review 2018-07-25 12:15:52 -03:00
Victor Shyba
ad96b006f9 adds http download support for blobs mirroring 2018-07-25 12:15:52 -03:00
Lex Berezhny
32507d74f7 negate wallet lock check in components 2018-07-25 01:28:19 -04:00
Jack Robison
40c5f6e3ab
Bump version 0.21.0rc1 --> 0.21.0rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-24 21:41:58 -04:00
Jack Robison
c1b05402ef
add address and port arguments to peer_ping 
allows directly pinging the peer without first doing an iterative find
 2018-07-24 21:30:54 -04:00
Jack Robison
1dd1bad9c2
Bump version 0.20.4 --> 0.21.0rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-24 21:21:52 -04:00
Jack Robison
5984ae7ce9
fix 2018-07-24 21:10:53 -04:00
Jack Robison
5d9a187659
refactor required conditions and @requires decorator 2018-07-24 20:01:38 -04:00
Jack Robison
a9c94ca22d
move setup and _shutdown to AuthJSONRPCServer 2018-07-24 20:01:38 -04:00
Jack Robison
a285db1b08
pylint 2018-07-24 20:01:38 -04:00
Jack Robison
13bf8125e3
status doc, better determination of is_first_run 
-add skipped_components to status response
-re-add run_reflector_server to settings
 2018-07-24 20:01:38 -04:00
Jack Robison
b06dcf0a0d
cancel starting components if the reactor is stopped before startup has finished 
-don't block starting the dht component on having found enough peers, only on setting up the protocol
 2018-07-24 20:01:38 -04:00
Jack Robison
a800f6ddf0
update status command 2018-07-24 20:01:38 -04:00
Jack Robison
a89306b6bf
reorganize daemon startup 
-fix loggly not using the share usage setting

-delete more
 2018-07-24 20:01:38 -04:00
Jack Robison
c3120e93cf
delete unneeded daemon attributes 2018-07-24 20:01:38 -04:00
Jack Robison
defe9506bb
set daemon attribute for each component as they start 2018-07-24 20:01:38 -04:00
Jack Robison
55d3bb0ec3
remove auto_renew 2018-07-24 20:01:38 -04:00
hackrush
005a8b3008
allow utf-8 characters in Daemon.py 
-amit really wants the shrug emoji ¯\_(ツ)_/¯
 2018-07-24 20:01:38 -04:00
hackrush
a741fdfc44
update daemon unit tests 2018-07-24 20:01:38 -04:00
hackrush
944b94aae8
update logging tests 2018-07-24 20:01:38 -04:00
hackrush
37eaf634c4
update functional tests 2018-07-24 20:01:38 -04:00
hackrush
edcb06a415
update mocks, add test_Component_Manager 2018-07-24 20:01:38 -04:00
hackrush
62b50dc0ae
move custom logger to lbrynet directory 
-import on module level __init__
 2018-07-24 20:01:38 -04:00
hackrush
e7c57dcabc
add components_to_skip setting 2018-07-24 20:01:38 -04:00
hackrush
094d9c6497
update lbrynet-cli 2018-07-24 20:01:38 -04:00
hackrush
3dc5a9de7b
whitespace 2018-07-24 20:01:38 -04:00
hackrush
4e29041291
update status command 2018-07-24 20:01:38 -04:00
hackrush
6b6a29fdb7
update settings_set 2018-07-24 20:01:38 -04:00
hackrush
2d61ba629f
add requires decorator 2018-07-24 20:01:38 -04:00
hackrush
5a2075019c
update Wallet.check_locked 2018-07-24 20:01:38 -04:00
hackrush
944200ca8c
add all the daemon components 2018-07-24 20:01:38 -04:00
hackrush
40d8e96811
remove functions and attributes in Session and Daemon that are now part of components 
-rename attributes in daemon to use components
 2018-07-24 20:01:38 -04:00
Jack Robison
7e8ca842a2
change ComponentManager to use instance methods rather than class methods 
-add get_component method to ComponentManager

-add override_components kwargs to ComponentManager

-add skip_components to ComponentManager

-change component_manager attribute to exist on the AuthJSONRPCServer instance instead of the class
 2018-07-24 20:01:38 -04:00
Jack Robison
b808d08eb3
support callbacks to component setups 2018-07-24 20:01:38 -04:00
Jack Robison
eb11da9b19
convert directory and SQLiteStorage setup to be a Component 2018-07-24 20:01:38 -04:00
Jack Robison
68b31a09b4
add daemon Component and ComponentManager classes 2018-07-24 20:01:38 -04:00
Lex Berezhny
cab8416596
api doc generator (#1290) 
script to generate docs/api.json
 2018-07-24 19:36:09 -04:00
Electron - Mark Firth
94f4e6714a A More Informative Error Message (#1309) 
Additional information added to the balance error message when editing a claim.
 2018-07-20 15:41:24 -04:00
Jack Robison
2ddd6b051d
Bump version 0.20.4rc4 --> 0.20.4 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-18 15:36:21 -04:00
Jack Robison
c506fc5c75
lower peer finder timeout message to debug from warning 2018-07-18 15:32:45 -04:00
Jack Robison
d306ece0d4
Bump version 0.20.4rc3 --> 0.20.4rc4 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-17 17:38:27 -04:00
Jack Robison
d29f103910
pylint 2018-07-17 17:38:19 -04:00
Jack Robison
2386a3a79b
Bump version 0.20.4rc2 --> 0.20.4rc3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-17 17:14:07 -04:00
Jack Robison
ec51333b56
allow node udp interface to be configured 2018-07-17 17:13:33 -04:00
Victor Shyba
4d720370b1 fix where it called the wrong score method 2018-07-17 17:48:25 -03:00
Jack Robison
7d7dd665aa
Bump version 0.20.4rc1 --> 0.20.4rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-17 13:31:37 -04:00
Victor Shyba
5492ab9081
stop requesting peers which doesnt have a blob 2018-07-17 13:22:08 -04:00
Victor Shyba
562d23df11 remove nodes that went ignored during iteration 2018-07-16 17:22:46 -03:00
Jack Robison
2c13c04f86
Bump version 0.20.3 --> 0.20.4rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-13 12:02:50 -04:00
Victor Shyba
5c7d279104 prune failures during is_ignored calls 2018-07-12 18:24:59 -03:00
Victor Shyba
cfe8e17223 filter out the bad node in results instead of punishing the node we trusted to contact 2018-07-12 18:24:18 -03:00
Victor Shyba
c589e89bf0 greedy search with exclude filtering 2018-07-05 22:03:52 -03:00
Lex Berezhny
284264962d reflector test fix 2018-07-05 19:51:15 -04:00
Lex Berezhny
6952c2c07e
Revert "refactor lbrynet-daemon into modular components" (#1286) 
* Revert "fix reflector test"

This reverts commit 6a15b51ac3.

* Revert "refactor lbrynet-daemon into modular components (#1164)"

This reverts commit 75a6ff269e.
 2018-07-05 19:05:48 -04:00
Jack Robison
6a15b51ac3
fix reflector test 2018-07-05 15:40:13 -04:00
Jack Robison
75a6ff269e refactor lbrynet-daemon into modular components (#1164) 
* add daemon Component and ComponentManager classes

* convert directory and SQLiteStorage setup to be a Component

* support callbacks to component setups

* Fixed typo in ComponentManager

* convert wallet to be Component

* Use storage from session.

* Remove create_session internal function and PEP8

* Starting to convert session to its own component. Removed ref to `self.storage` from Daemon.py

* Making DHT component(broken)

* Refactored classes to reduce redundancy in getting config setting

* DHT is now it's own component

* Fixed `test_streamify` test

* Fixed regression caused by removing `peer_manager` from session

* refactor ComponentManager and Component to use instance instead of class methods

* Hash announcer, file manager, stream identifier components

* Query Handler and server components

* Reflector Component

* Fixed test_streamify(well Jack did, but ¯\_(ツ)_/¯)

* All tests now passing

* Pylint fixes

* Oops(That's all you're gonna get :-P)

* Making decorators(WIP, commit so that I don't lose work)

* Decorator made and decorating of functions done(some other changes)

* import fixes and removed temporary test function

* Fixed new broken tests from daemon refactor

* Sanitization of modules

* Reworded errors

* wallet unlock condition checks, fixed breaking changes

* Rebased on amster and other crazy stuff

* Started writing tests

* Tests for component manager

* Fix Daemon Tests

* Fixed passing mutable args in init

* Using constants instead of strings. Added CHANGELOG.md

* Now components can be skipped by setting relevant config in file.

* P-Y-L-I-N-T #angry_emoji
 2018-07-05 15:21:52 -04:00
ocornoc
148cc96025 Changed "cliam" to "claim" and added accurate info for nsfw. (#1285) 
* Changed "cliam" to "claim" and added accurate info for nsfw.
* Update CHANGELOG.md
 2018-07-05 12:00:43 -04:00
Jack Robison
da7e7503b9
Bump version 0.20.3rc2 --> 0.20.3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-03 14:32:38 -04:00
Jack Robison
5adcc86f40
Bump version 0.20.3rc1 --> 0.20.3rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-03 13:10:35 -04:00
Victor Shyba
1cc7ce69ab set the peer search timeout as configured and raise it to 30s 2018-07-03 13:47:00 -03:00
Victor Shyba
7e0784d8e0 log a warning when peer search times out for real 2018-07-03 12:20:33 -03:00
Victor Shyba
56613a71d5 let find value run until it finds a value 2018-07-03 11:51:39 -03:00
Jack Robison
2b0d4c1603
Bump version 0.20.2 --> 0.20.3rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-07-02 17:24:30 -04:00
Jack Robison
929a0cc5af
exclude self and querying node from closest contacts 2018-07-02 14:54:03 -04:00
Jack Robison
b6289d101d
fix improper sorting when getting the closest peers to a hash 2018-07-02 14:54:03 -04:00
Jack Robison
7fe92d2df0
load all finished blobs into the node datastore 2018-07-02 14:31:09 -04:00
Jack Robison
03769b94b8
accept invalid store tokens for the first expire-time after startup 
this is to better handle nodes storing to us after we've restarted our node
 2018-07-02 13:26:38 -04:00
Jack Robison
c2dc872a54
fix file manager startup locking up when there are many files in a channel 2018-06-29 21:45:30 -04:00
Jack Robison
e0ceaba655
fix blob_list raising an error when blobs in a stream haven't yet been created 2018-06-25 16:47:23 -04:00
Victor Shyba
c5f4f58221 collect finished deferred before cancel call 2018-06-23 18:23:25 -03:00
Jack Robison
12d1b93b5d
Bump version 0.20.2rc3 --> 0.20.2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-23 11:53:23 -04:00
Jack Robison
34febf75f9
Bump version 0.20.2rc2 --> 0.20.2rc3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-22 19:15:46 -04:00
Jack Robison
140c45b01f
Revert "add download progress and is downloading flag to daemon status (#1266)" 
This reverts commit 2fa2269
 2018-06-22 18:54:22 -04:00
Akinwale Ariwodola
2fa2269cc7
add download progress and is downloading flag to daemon status (#1266) 2018-06-21 23:49:22 +01:00
Jack Robison
4bcf0ab7fb
Bump version 0.20.2rc1 --> 0.20.2rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-20 17:07:54 -04:00
Jack Robison
61a7fd66bf
batch insert/update claims to sqlite 2018-06-20 16:08:12 -04:00
Jack Robison
889b2facce
Bump version 0.20.1 --> 0.20.2rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-20 16:01:24 -04:00
Jack Robison
e435a9f722
Bump version 0.20.1rc5 --> 0.20.1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-19 14:05:16 -04:00
Jack Robison
ba52574091
Bump version 0.20.1rc4 --> 0.20.1rc5 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-19 13:51:12 -04:00
Jack Robison
eb660e23b7
fix download being stopped if the sd blob downloaded and data did not start within the timeout 
fixes https://github.com/lbryio/lbry/issues/1172
 2018-06-19 13:38:25 -04:00
Jack Robison
89bc26191c
fix wallet startup locking up if a lbryumx server is unavailable 2018-06-18 18:42:48 -04:00
Jack Robison
5edd8deb63
fix blob client protocol not tearing itself down properly after a failure 2018-06-18 15:30:35 -04:00
hackrush
371b27b116 Fix approximations in bid during publish 2018-06-18 10:40:33 -04:00
Jack Robison
db15169ca6
Bump version 0.20.1rc3 --> 0.20.1rc4 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-15 14:38:23 -04:00
Jack Robison
71e2c545fc
Merge branch 'fix-1165' 2018-06-15 14:38:01 -04:00
Jack Robison
3270693a8f
Bump version 0.20.1rc2 --> 0.20.1rc3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-15 14:36:31 -04:00
Jack Robison
c26816c92d
fix database error when updating a claim that we don't have a file for (https://github.com/lbryio/lbry/issues/1165) 2018-06-15 10:21:37 -04:00
Jack Robison
e83ff47722
Bump version 0.20.1rc1 --> 0.20.1rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-15 10:19:43 -04:00
Jack Robison
4c97d2af2e
fix request_needed_blobs for partially reflected streams 2018-06-15 10:10:49 -04:00
Jack Robison
42daf0fc3f
Bump version 0.20.0 --> 0.20.1rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-14 17:55:10 -04:00
Jack Robison
70355145a0
fix race condition when inserting a blob to the database 2018-06-14 15:15:16 -04:00
Jack Robison
e6df378e9e
fix token validation error when the dht node has just been started (https://github.com/lbryio/lbry/issues/1248) 2018-06-14 15:07:10 -04:00
Lex Berezhny
e11a2e6f85
publish accepts decimal string for the bid value 2018-06-13 16:52:35 -04:00
Jack Robison
7030547849
Bump version 0.20.0rc14 --> 0.20.0 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-13 15:36:49 -04:00
Jack Robison
df7a59f40a
skip test on appveyor 2018-06-13 14:04:14 -04:00
jleute
0dbd15df7b Merge remote-tracking branch 'upstream/master' 2018-06-12 00:27:08 +02:00
jleute
9735373eef remove dependency on server_list_reverse 2018-06-12 00:10:23 +02:00
jleute
acbe3b0f65 updated test to compare original and saved config file 2018-06-12 00:06:49 +02:00
jleute
ea7ef54174 remove unused import 2018-06-12 00:06:24 +02:00
jleute
cfe5eb5d56 clean up temporary conf file 2018-06-12 00:06:21 +02:00
jleute
e00238427b add assert to test_load_save_load_config_file test 2018-06-12 00:05:50 +02:00
jleute
5926b17871 Updated unittest for saving of server lists in the conf file 2018-06-12 00:05:49 +02:00
jleute
2e3ceedc17 added unit test for reversal of conversion of config file entries 2018-06-12 00:04:35 +02:00
jleute
c411d8700b fixes #1109 2018-06-12 00:04:35 +02:00
Jack Robison
0ae89f01e6 Revert "WIP: feature/1098/sorted-claim-results" 2018-06-12 00:04:32 +02:00
Sergey Rozhnov
d66bce814c refactored unit test for sort_claim_results 2018-06-12 00:03:30 +02:00
Sergey Rozhnov
c290fb5908 refactored sorting of claims and unit tests 2018-06-12 00:02:48 +02:00
Sergey Rozhnov
156b132070 implemented additional test cases for claims sorting; updated changelog 2018-06-12 00:01:36 +02:00
Sergey Rozhnov
b770b2de6a simplified claims comparison logic; refactored unit tests 2018-06-12 00:01:36 +02:00
Sergey Rozhnov
c7ba82dc07 claim_list and claim_list_mine in Daemon return sorted results 2018-06-12 00:01:32 +02:00
Jack Robison
c0c12adefa
Bump version 0.20.0rc13 --> 0.20.0rc14 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-09 11:26:41 -04:00
Jack Robison
9219e5976e
update default lbryum servers 2018-06-09 11:26:26 -04:00
Jack Robison
2619c396d9
Bump version 0.20.0rc12 --> 0.20.0rc13 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-08 13:50:35 -04:00
Jack Robison
a1218ea565
Merge remote-tracking branch 'origin/fix_prm' 2018-06-08 13:50:23 -04:00
Jack Robison
b92800158e
Bump version 0.20.0rc11 --> 0.20.0rc12 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-08 13:49:36 -04:00
Jack Robison
d87d8875f6
fix migration error caused by using a current create tables query mid migration 2018-06-08 13:28:49 -04:00
Victor Shyba
8598280654 fix base brm to prm typo 2018-06-08 11:16:21 -03:00
Jack Robison
f0c732644a
Bump version 0.20.0rc10 --> 0.20.0rc11 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-06-07 15:18:30 -04:00
Jack Robison
1d0106929c
move daemon test to the same folder as the others 2018-06-07 15:02:47 -04:00
Jack Robison
a821647fbc
pylint and appveyor 2018-06-07 15:02:47 -04:00
Jack Robison
7f3ead67bf
disable forced bucket refresh during join 2018-06-07 15:02:47 -04:00
Jack Robison
f3e848b2e2
work around upnp bug 
this fixes an incorrectly raised mapping conflict error which the router raises when there is a redirect for the same internal port and a different lan address.
 2018-06-07 15:02:47 -04:00
Jack Robison
b0e4fc4faa
fix iterative find lockup 2018-06-07 15:02:47 -04:00
Jack Robison
af096aee41
update test 2018-06-07 15:02:47 -04:00
Jack Robison
ae631f05c3
fix teardown error 2018-06-07 15:02:47 -04:00
Jack Robison
bc0da5e2d1
only use seeds in iterative bootstrap if no contacts are known yet 2018-06-07 15:02:47 -04:00
Jack Robison
16cb6d8657
remove Session._join_deferred 2018-06-07 15:02:47 -04:00
Jack Robison
44644673d7
add profiler 2018-06-07 15:02:47 -04:00
Jack Robison
e8b402f998
remove deferredLock from iterativeFind 
-fire the first iteration right away
 2018-06-07 15:02:47 -04:00
Jack Robison
adca5f5993
fix routing_table_get 2018-06-07 15:02:47 -04:00
Jack Robison
4fbaaac3f3
default new contacts to protocol version 0 2018-06-07 15:02:47 -04:00
Jack Robison
db06191c33
reduce default concurrent announcers to 10 
-lower rpc timeout to what it originally was
 2018-06-07 15:02:47 -04:00
Jack Robison
b0a741b1f4
fix hash announcer semaphore 2018-06-07 15:02:47 -04:00
Jack Robison
537df6c8ad
log socket errors 2018-06-07 15:02:47 -04:00
Jack Robison
42eb172638
refactor announceHaveBlob 
-add cached `token` to Contact objects to minimize findValue requests
-remove self_store, always store to remote contacts even if we're the closest known node to the hash
-move the store call and error handling from announceHaveBlob to a smaller function of its own
 2018-06-07 15:02:47 -04:00
Jack Robison
9a63db4ec6
add protocol version to the dht and migrate old arg format for store 2018-06-07 15:02:47 -04:00
Jack Robison
7d21cc5822
pylint and more tests 2018-06-07 15:02:47 -04:00
Jack Robison
cce3c8c7b5
increase kademlia rpc timeout to 8 seconds 2018-06-07 15:02:47 -04:00
Jack Robison
0e80123615
use 12 minutes instead of 15 as delay in contact_is_good 2018-06-07 15:02:47 -04:00
Jack Robison
659632b66c
fix and update tests 2018-06-07 15:02:47 -04:00
Jack Robison
545930cea4
dht test environment fixes 2018-06-07 15:02:47 -04:00
Jack Robison
9582b7fcf5
use maybe_ping for refreshing stale buckets and storing peers 
-move store refresh to its own looping call
 2018-06-07 15:02:47 -04:00
Jack Robison
945da5985e
fix age used in datastore to determine if a value is expired 2018-06-07 15:02:47 -04:00
Jack Robison
921ee3c4c1
use refreshTimeout in getRefreshList 2018-06-07 15:02:47 -04:00
Jack Robison
8efede6ad6
maybe_ping bad and unknown contacts instead of only unknown 2018-06-07 15:02:47 -04:00
Jack Robison
fb3aac15fa
add optional delay argument to enqueue_maybe_ping, fix default value 2018-06-07 15:02:47 -04:00
Jack Robison
73e813f9ec
verify key size in Distance 2018-06-07 15:02:47 -04:00
Jack Robison
0d23c68797
raise attribute error for non-rpc functions in Contact 2018-06-07 15:02:47 -04:00
Jack Robison
ec1b6b2387
comments, cleaner key_bits constant 2018-06-07 15:02:47 -04:00
Jack Robison
29d5750371
pylint 2018-06-07 15:02:47 -04:00
Jack Robison
07f92014d7
omit bad contacts from getPeersForBlob 
-refresh stored contacts to detect when they go offline or come back
 2018-06-07 15:02:47 -04:00
Jack Robison
98e21cdba0
test re-join dht 2018-06-07 15:02:47 -04:00
Jack Robison
c521120b17
update and fix hash announcer test 2018-06-07 15:02:47 -04:00
Jack Robison
d02ed29e50
add kademlia store and expiration test 2018-06-07 15:02:47 -04:00
Jack Robison
470ebe2de3
remove unnecessary CallLaterManager from test_contact_rpc 2018-06-07 15:02:47 -04:00
Jack Robison
b5f3ed5542
update contact expiration test and add re-join after expiration test 2018-06-07 15:02:47 -04:00
Jack Robison
877da78505
ping contacts right away during refresh instead of using PingQueue 
-fixes contact expiration test
 2018-06-07 15:02:47 -04:00
Jack Robison
a952d2d2c8
reset _listeningPort and _listening Deferred on teardown 2018-06-07 15:02:47 -04:00
Jack Robison
3dfc6bd2cc
update CallLaterManager to be an object 2018-06-07 15:02:47 -04:00
Jack Robison
760417ff3a
pylint 2018-06-07 15:02:47 -04:00
Jack Robison
7da70cc02d
test peer expiration 2018-06-07 15:02:47 -04:00
Jack Robison
d3f4155a2b
add unit tests for contact_is_good 2018-06-07 15:02:47 -04:00
Jack Robison
d250e4d91a
add iterative find test 2018-06-07 15:02:47 -04:00
Jack Robison
950ec5bc9a
update mocks and dht tests 
-reorganize dht tests
 2018-06-07 15:02:47 -04:00
Jack Robison
bdd6f948ca
add port to routing_table_get 2018-06-07 15:02:47 -04:00
Jack Robison
cc32d987b2
update peer_list 2018-06-07 15:02:47 -04:00
Jack Robison
4f72098cad
use PingQueue to try refresh all contacts 2018-06-07 15:02:47 -04:00
Jack Robison
9920ff59d4
force KBucket refreshes 2018-06-07 15:02:47 -04:00
Jack Robison
ae22468fec
fix CallLaterManager trying to remove pending calls multiple times 2018-06-07 15:02:47 -04:00
Jack Robison
aee7a3aa38
simplify announceHaveBlob, remove unused getPeersForBlob 2018-06-07 15:02:47 -04:00
Jack Robison
372fb45e06
refactor dht bootstrap 
after finding the closest nodes try to populate the buckets out by looking up random ids in their key ranges
 2018-06-07 15:02:47 -04:00
Jack Robison
c65274e9e5
add PingQueue to KademliaProtocol 2018-06-07 15:02:47 -04:00
Jack Robison
1adf4f7818
fix constant used to check if a bucket is fresh 2018-06-07 15:02:47 -04:00
Jack Robison
05241012a2
update contact replacement in KBucket to follow BEP0005 
http://www.bittorrent.org/beps/bep_0005.html
 2018-06-07 15:02:47 -04:00
Jack Robison
cf3359044d
fix conditions for when a kbucket should be split 
https://stackoverflow.com/a/32187456
 2018-06-07 15:02:47 -04:00
Jack Robison
5631a24881
improve findCloseNodes, choose closest contacts from higher and lower buckets 2018-06-07 15:02:47 -04:00
Jack Robison
c654bfe296
use reactor clock in TreeRoutingTable instead of time module 2018-06-07 15:02:47 -04:00
Jack Robison
d4e28216a0
sort KBucket.getContacts 2018-06-07 15:02:47 -04:00
Jack Robison
95ed1e044b
raise TransportNotConnected instead of logging a warning 
-add a _listening Deferred to KademliaProtocol which is called when the protocol is started
 2018-06-07 15:02:47 -04:00
Jack Robison
f1e0a784d9
refactor iterativeFind, move to own file 2018-06-07 15:02:47 -04:00
Jack Robison
e5703833cf
prevent duplicate entries in the datastore 2018-06-07 15:02:47 -04:00
Jack Robison
23c202b5e4
refactor Contact class, DHT RPCs, and Contact addition/removal 
-track contact failures, last replied, and last requested. use this to provide a 'contact_is_good' property on Contact objects
-ensure no duplicate contact objects are created
-remove confusing conflation of node id strings with Contact objects, update docstrings
-move RPC failure tracking to a callback/errback pair in sendRPC (so the contact is only updated once)
-handle seed nodes during the join sequence by setting their node ids after they initially reply to our ping
-name all of the kademlia RPC keyword args, remove confusing **kwargs and dictionary parsing
-add host ip/port to DHT send/receive logging to make the results comprehensible when running many nodes at once
 2018-06-07 15:02:47 -04:00
Jack Robison
ad2dcf0893
add the parent node id to KBucket 2018-06-07 15:02:47 -04:00
Jack Robison
406ddaa4ef
use base class to simplify Node init 
-add looping call helpers which use the same clock as the Node
 2018-06-07 15:02:47 -04:00
Jack Robison
e52689a33d
remove OptimizedTreeRoutingTable for now, use TreeRoutingTable 2018-06-07 15:02:47 -04:00
Jack Robison
d65dc0aec3
disable loading DictDataStore in Node.__init__ 
-to be re-done when the datastore uses sqlite
 2018-06-07 15:02:47 -04:00
Jack Robison
159e153393
make DataStore clock mockable 2018-06-07 15:02:47 -04:00
Jack Robison
9ed08f8fc9
remove unused constant 2018-06-07 15:02:47 -04:00
Jack Robison
a503a800ca
disable Cryptonator exchange rate feed 2018-06-07 15:02:47 -04:00
Jack Robison
b673c508cc
disable NegotiatedPaymentRateManager, use OnlyFreePaymentsManager for now 2018-06-07 15:02:47 -04:00
Jack Robison
4bd9f3bd68
remove popular hash tracking, simplify DHTPeerFinder 2018-06-07 15:02:47 -04:00
Jack Robison
e6ffd7caf8
remove hashwatcher 2018-06-07 15:02:47 -04:00
Victor Shyba
b91181e640 refactor: simplify add_completed_blob + changelog 2018-05-30 16:19:49 -03:00
Lex Berezhny
23df1d0316
Merge branch 'master' into feature/file_list_sorting 2018-05-29 22:47:09 -04:00
Lex Berezhny
3d17c92bd3 moved import certifi to run only on windows 2018-05-29 22:36:37 -04:00
Akinwale Ariwodola
c4550ef5b6 remove unused import in lbrynet.daemon.Daemon 2018-05-29 22:36:37 -04:00
Akinwale Ariwodola
97547e904e add os and sys imports 2018-05-29 22:36:37 -04:00