Commit graph

2723 commits

Author SHA1 Message Date
Jack Robison
aef561d78b
refactor status results 2018-08-03 12:33:31 -04:00
Jack Robison
4ef4a4816f
update component tests 2018-08-03 11:37:10 -04:00
Jack Robison
8533bfa7c5
refactor test_misc, remove Session
-use only the one process
2018-08-03 11:37:10 -04:00
Jack Robison
6389e961b9
update (and refactor) tests to not use Session 2018-08-03 11:37:10 -04:00
Jack Robison
6359fc608e
set download_mirrors upon making the downloader instead in the file manager globally 2018-08-03 11:37:10 -04:00
Jack Robison
314400a1bd
move looping call to check announcement status to SQLiteStorage 2018-08-03 11:37:10 -04:00
Jack Robison
a3de065c93
use txupnp instead of miniupnpc 2018-08-03 11:37:07 -04:00
Jack Robison
99207b7221
delete Session.py
split Session into Components
2018-07-30 18:00:33 -04:00
Jack Robison
e3c3fafa1e
split headers download into own component
-add component statuses
2018-07-30 18:00:33 -04:00
Victor Shyba
9742da348b do not consume errors on DeferredList 2018-07-30 13:53:58 -03:00
Victor Shyba
94a31922f7 fix unnecessary logging tag 2018-07-30 11:22:31 -03:00
Victor Shyba
1937eb17c4 adds a test for stopping 2018-07-30 11:22:31 -03:00
Victor Shyba
f291ea515a add test for invalid content 2018-07-30 11:22:31 -03:00
Victor Shyba
ff4aba9423 refactor mirroring 2018-07-30 11:22:31 -03:00
hackrush
9ab256df30 fixed improper error handling when data is not valid JSON (#1326) 2018-07-30 09:38:36 -04:00
Lex Berezhny
88b8ca8a49 Revert "negate wallet lock check in components"
This reverts commit 32507d7
2018-07-25 14:59:10 -04:00
Jack Robison
09f637496c
Bump version 0.21.0rc2 --> 0.21.0rc3
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-07-25 12:25:24 -04:00
Jack Robison
826d269e0e
Merge branch 'blobs_mirroring' 2018-07-25 12:24:37 -04:00
Victor Shyba
ab27203100 improve exception logging and add a docstring on the interaction between downloaders 2018-07-25 13:01:13 -03:00
Victor Shyba
88c2051605 set download_mirror conf from components change 2018-07-25 12:23:15 -03:00
Victor Shyba
f510c2a433 improve logging from review 2018-07-25 12:15:52 -03:00
Victor Shyba
ec140d5d8a changes from code review 2018-07-25 12:15:52 -03:00
Victor Shyba
ad96b006f9 adds http download support for blobs mirroring 2018-07-25 12:15:52 -03:00
Lex Berezhny
32507d74f7 negate wallet lock check in components 2018-07-25 01:28:19 -04:00
Jack Robison
40c5f6e3ab
Bump version 0.21.0rc1 --> 0.21.0rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-07-24 21:41:58 -04:00
Jack Robison
c1b05402ef
add address and port arguments to peer_ping
allows directly pinging the peer without first doing an iterative find
2018-07-24 21:30:54 -04:00
Jack Robison
1dd1bad9c2
Bump version 0.20.4 --> 0.21.0rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-07-24 21:21:52 -04:00
Jack Robison
5984ae7ce9
fix 2018-07-24 21:10:53 -04:00
Jack Robison
5d9a187659
refactor required conditions and @requires decorator 2018-07-24 20:01:38 -04:00
Jack Robison
a9c94ca22d
move setup and _shutdown to AuthJSONRPCServer 2018-07-24 20:01:38 -04:00
Jack Robison
a285db1b08
pylint 2018-07-24 20:01:38 -04:00
Jack Robison
13bf8125e3
status doc, better determination of is_first_run
-add skipped_components to status response
-re-add run_reflector_server to settings
2018-07-24 20:01:38 -04:00
Jack Robison
b06dcf0a0d
cancel starting components if the reactor is stopped before startup has finished
-don't block starting the dht component on having found enough peers, only on setting up the protocol
2018-07-24 20:01:38 -04:00
Jack Robison
a800f6ddf0
update status command 2018-07-24 20:01:38 -04:00
Jack Robison
a89306b6bf
reorganize daemon startup
-fix loggly not using the share usage setting

-delete more
2018-07-24 20:01:38 -04:00
Jack Robison
c3120e93cf
delete unneeded daemon attributes 2018-07-24 20:01:38 -04:00
Jack Robison
defe9506bb
set daemon attribute for each component as they start 2018-07-24 20:01:38 -04:00
Jack Robison
55d3bb0ec3
remove auto_renew 2018-07-24 20:01:38 -04:00
hackrush
005a8b3008
allow utf-8 characters in Daemon.py
-amit really wants the shrug emoji ¯\_(ツ)_/¯
2018-07-24 20:01:38 -04:00
hackrush
a741fdfc44
update daemon unit tests 2018-07-24 20:01:38 -04:00
hackrush
944b94aae8
update logging tests 2018-07-24 20:01:38 -04:00
hackrush
37eaf634c4
update functional tests 2018-07-24 20:01:38 -04:00
hackrush
edcb06a415
update mocks, add test_Component_Manager 2018-07-24 20:01:38 -04:00
hackrush
62b50dc0ae
move custom logger to lbrynet directory
-import on module level __init__
2018-07-24 20:01:38 -04:00
hackrush
e7c57dcabc
add components_to_skip setting 2018-07-24 20:01:38 -04:00
hackrush
094d9c6497
update lbrynet-cli 2018-07-24 20:01:38 -04:00
hackrush
3dc5a9de7b
whitespace 2018-07-24 20:01:38 -04:00
hackrush
4e29041291
update status command 2018-07-24 20:01:38 -04:00
hackrush
6b6a29fdb7
update settings_set 2018-07-24 20:01:38 -04:00
hackrush
2d61ba629f
add requires decorator 2018-07-24 20:01:38 -04:00
hackrush
5a2075019c
update Wallet.check_locked 2018-07-24 20:01:38 -04:00
hackrush
944200ca8c
add all the daemon components 2018-07-24 20:01:38 -04:00
hackrush
40d8e96811
remove functions and attributes in Session and Daemon that are now part of components
-rename attributes in daemon to use components
2018-07-24 20:01:38 -04:00
Jack Robison
7e8ca842a2
change ComponentManager to use instance methods rather than class methods
-add get_component method to ComponentManager

-add override_components kwargs to ComponentManager

-add skip_components to ComponentManager

-change component_manager attribute to exist on the AuthJSONRPCServer instance instead of the class
2018-07-24 20:01:38 -04:00
Jack Robison
b808d08eb3
support callbacks to component setups 2018-07-24 20:01:38 -04:00
Jack Robison
eb11da9b19
convert directory and SQLiteStorage setup to be a Component 2018-07-24 20:01:38 -04:00
Jack Robison
68b31a09b4
add daemon Component and ComponentManager classes 2018-07-24 20:01:38 -04:00
Lex Berezhny
cab8416596
api doc generator (#1290)
script to generate docs/api.json
2018-07-24 19:36:09 -04:00
Electron - Mark Firth
94f4e6714a A More Informative Error Message (#1309)
Additional information added to the balance error message when editing a claim.
2018-07-20 15:41:24 -04:00
Jack Robison
2ddd6b051d
Bump version 0.20.4rc4 --> 0.20.4
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-07-18 15:36:21 -04:00
Jack Robison
c506fc5c75
lower peer finder timeout message to debug from warning 2018-07-18 15:32:45 -04:00
Jack Robison
d306ece0d4
Bump version 0.20.4rc3 --> 0.20.4rc4
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-07-17 17:38:27 -04:00
Jack Robison
d29f103910
pylint 2018-07-17 17:38:19 -04:00
Jack Robison
2386a3a79b
Bump version 0.20.4rc2 --> 0.20.4rc3
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-07-17 17:14:07 -04:00
Jack Robison
ec51333b56
allow node udp interface to be configured 2018-07-17 17:13:33 -04:00
Victor Shyba
4d720370b1 fix where it called the wrong score method 2018-07-17 17:48:25 -03:00
Jack Robison
7d7dd665aa
Bump version 0.20.4rc1 --> 0.20.4rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-07-17 13:31:37 -04:00
Victor Shyba
5492ab9081
stop requesting peers which doesnt have a blob 2018-07-17 13:22:08 -04:00
Victor Shyba
562d23df11 remove nodes that went ignored during iteration 2018-07-16 17:22:46 -03:00
Jack Robison
2c13c04f86
Bump version 0.20.3 --> 0.20.4rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-07-13 12:02:50 -04:00
Victor Shyba
5c7d279104 prune failures during is_ignored calls 2018-07-12 18:24:59 -03:00
Victor Shyba
cfe8e17223 filter out the bad node in results instead of punishing the node we trusted to contact 2018-07-12 18:24:18 -03:00
Victor Shyba
c589e89bf0 greedy search with exclude filtering 2018-07-05 22:03:52 -03:00
Lex Berezhny
284264962d reflector test fix 2018-07-05 19:51:15 -04:00
Lex Berezhny
6952c2c07e
Revert "refactor lbrynet-daemon into modular components" (#1286)
* Revert "fix reflector test"

This reverts commit 6a15b51ac3.

* Revert "refactor lbrynet-daemon into modular components (#1164)"

This reverts commit 75a6ff269e.
2018-07-05 19:05:48 -04:00
Jack Robison
6a15b51ac3
fix reflector test 2018-07-05 15:40:13 -04:00
Jack Robison
75a6ff269e refactor lbrynet-daemon into modular components (#1164)
* add daemon Component and ComponentManager classes

* convert directory and SQLiteStorage setup to be a Component

* support callbacks to component setups

* Fixed typo in ComponentManager

* convert wallet to be Component

* Use storage from session.

* Remove create_session internal function and PEP8

* Starting to convert session to its own component. Removed ref to `self.storage` from Daemon.py

* Making DHT component(broken)

* Refactored classes to reduce redundancy in getting config setting

* DHT is now it's own component

* Fixed `test_streamify` test

* Fixed regression caused by removing `peer_manager` from session

* refactor ComponentManager and Component to use instance instead of class methods

* Hash announcer, file manager, stream identifier components

* Query Handler and server components

* Reflector Component

* Fixed test_streamify(well Jack did, but ¯\_(ツ)_/¯)

* All tests now passing

* Pylint fixes

* Oops(That's all you're gonna get :-P)

* Making decorators(WIP, commit so that I don't lose work)

* Decorator made and decorating of functions done(some other changes)

* import fixes and removed temporary test function

* Fixed new broken tests from daemon refactor

* Sanitization of modules

* Reworded errors

* wallet unlock condition checks, fixed breaking changes

* Rebased on amster and other crazy stuff

* Started writing tests

* Tests for component manager

* Fix Daemon Tests

* Fixed passing mutable args in init

* Using constants instead of strings. Added CHANGELOG.md

* Now components can be skipped by setting relevant config in file.

* P-Y-L-I-N-T #angry_emoji
2018-07-05 15:21:52 -04:00
ocornoc
148cc96025 Changed "cliam" to "claim" and added accurate info for nsfw. (#1285)
* Changed "cliam" to "claim" and added accurate info for nsfw.
* Update CHANGELOG.md
2018-07-05 12:00:43 -04:00
Jack Robison
da7e7503b9
Bump version 0.20.3rc2 --> 0.20.3
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-07-03 14:32:38 -04:00
Jack Robison
5adcc86f40
Bump version 0.20.3rc1 --> 0.20.3rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-07-03 13:10:35 -04:00
Victor Shyba
1cc7ce69ab set the peer search timeout as configured and raise it to 30s 2018-07-03 13:47:00 -03:00
Victor Shyba
7e0784d8e0 log a warning when peer search times out for real 2018-07-03 12:20:33 -03:00
Victor Shyba
56613a71d5 let find value run until it finds a value 2018-07-03 11:51:39 -03:00
Jack Robison
2b0d4c1603
Bump version 0.20.2 --> 0.20.3rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-07-02 17:24:30 -04:00
Jack Robison
929a0cc5af
exclude self and querying node from closest contacts 2018-07-02 14:54:03 -04:00
Jack Robison
b6289d101d
fix improper sorting when getting the closest peers to a hash 2018-07-02 14:54:03 -04:00
Jack Robison
7fe92d2df0
load all finished blobs into the node datastore 2018-07-02 14:31:09 -04:00
Jack Robison
03769b94b8
accept invalid store tokens for the first expire-time after startup
this is to better handle nodes storing to us after we've restarted our node
2018-07-02 13:26:38 -04:00
Jack Robison
c2dc872a54
fix file manager startup locking up when there are many files in a channel 2018-06-29 21:45:30 -04:00
Jack Robison
e0ceaba655
fix blob_list raising an error when blobs in a stream haven't yet been created 2018-06-25 16:47:23 -04:00
Victor Shyba
c5f4f58221 collect finished deferred before cancel call 2018-06-23 18:23:25 -03:00
Jack Robison
12d1b93b5d
Bump version 0.20.2rc3 --> 0.20.2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-06-23 11:53:23 -04:00
Jack Robison
34febf75f9
Bump version 0.20.2rc2 --> 0.20.2rc3
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-06-22 19:15:46 -04:00
Jack Robison
140c45b01f
Revert "add download progress and is downloading flag to daemon status (#1266)"
This reverts commit 2fa2269
2018-06-22 18:54:22 -04:00
Akinwale Ariwodola
2fa2269cc7
add download progress and is downloading flag to daemon status (#1266) 2018-06-21 23:49:22 +01:00
Jack Robison
4bcf0ab7fb
Bump version 0.20.2rc1 --> 0.20.2rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-06-20 17:07:54 -04:00
Jack Robison
61a7fd66bf
batch insert/update claims to sqlite 2018-06-20 16:08:12 -04:00
Jack Robison
889b2facce
Bump version 0.20.1 --> 0.20.2rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-06-20 16:01:24 -04:00
Jack Robison
e435a9f722
Bump version 0.20.1rc5 --> 0.20.1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-06-19 14:05:16 -04:00
Jack Robison
ba52574091
Bump version 0.20.1rc4 --> 0.20.1rc5
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-06-19 13:51:12 -04:00