Commit graph

376 commits

Author SHA1 Message Date
hackrush 944200ca8c
add all the daemon components 2018-07-24 20:01:38 -04:00
hackrush 40d8e96811
remove functions and attributes in Session and Daemon that are now part of components
-rename attributes in daemon to use components
2018-07-24 20:01:38 -04:00
Jack Robison 7e8ca842a2
change ComponentManager to use instance methods rather than class methods
-add get_component method to ComponentManager

-add override_components kwargs to ComponentManager

-add skip_components to ComponentManager

-change component_manager attribute to exist on the AuthJSONRPCServer instance instead of the class
2018-07-24 20:01:38 -04:00
Jack Robison b808d08eb3
support callbacks to component setups 2018-07-24 20:01:38 -04:00
Jack Robison eb11da9b19
convert directory and SQLiteStorage setup to be a Component 2018-07-24 20:01:38 -04:00
Jack Robison 68b31a09b4
add daemon Component and ComponentManager classes 2018-07-24 20:01:38 -04:00
Lex Berezhny cab8416596
api doc generator (#1290)
script to generate docs/api.json
2018-07-24 19:36:09 -04:00
Electron - Mark Firth 94f4e6714a A More Informative Error Message (#1309)
Additional information added to the balance error message when editing a claim.
2018-07-20 15:41:24 -04:00
Lex Berezhny 6952c2c07e
Revert "refactor lbrynet-daemon into modular components" (#1286)
* Revert "fix reflector test"

This reverts commit 6a15b51ac3.

* Revert "refactor lbrynet-daemon into modular components (#1164)"

This reverts commit 75a6ff269e.
2018-07-05 19:05:48 -04:00
Jack Robison 75a6ff269e refactor lbrynet-daemon into modular components (#1164)
* add daemon Component and ComponentManager classes

* convert directory and SQLiteStorage setup to be a Component

* support callbacks to component setups

* Fixed typo in ComponentManager

* convert wallet to be Component

* Use storage from session.

* Remove create_session internal function and PEP8

* Starting to convert session to its own component. Removed ref to `self.storage` from Daemon.py

* Making DHT component(broken)

* Refactored classes to reduce redundancy in getting config setting

* DHT is now it's own component

* Fixed `test_streamify` test

* Fixed regression caused by removing `peer_manager` from session

* refactor ComponentManager and Component to use instance instead of class methods

* Hash announcer, file manager, stream identifier components

* Query Handler and server components

* Reflector Component

* Fixed test_streamify(well Jack did, but ¯\_(ツ)_/¯)

* All tests now passing

* Pylint fixes

* Oops(That's all you're gonna get :-P)

* Making decorators(WIP, commit so that I don't lose work)

* Decorator made and decorating of functions done(some other changes)

* import fixes and removed temporary test function

* Fixed new broken tests from daemon refactor

* Sanitization of modules

* Reworded errors

* wallet unlock condition checks, fixed breaking changes

* Rebased on amster and other crazy stuff

* Started writing tests

* Tests for component manager

* Fix Daemon Tests

* Fixed passing mutable args in init

* Using constants instead of strings. Added CHANGELOG.md

* Now components can be skipped by setting relevant config in file.

* P-Y-L-I-N-T #angry_emoji
2018-07-05 15:21:52 -04:00
ocornoc 148cc96025 Changed "cliam" to "claim" and added accurate info for nsfw. (#1285)
* Changed "cliam" to "claim" and added accurate info for nsfw.
* Update CHANGELOG.md
2018-07-05 12:00:43 -04:00
Jack Robison e0ceaba655
fix blob_list raising an error when blobs in a stream haven't yet been created 2018-06-25 16:47:23 -04:00
Jack Robison 140c45b01f
Revert "add download progress and is downloading flag to daemon status (#1266)"
This reverts commit 2fa2269
2018-06-22 18:54:22 -04:00
Akinwale Ariwodola 2fa2269cc7
add download progress and is downloading flag to daemon status (#1266) 2018-06-21 23:49:22 +01:00
Jack Robison eb660e23b7
fix download being stopped if the sd blob downloaded and data did not start within the timeout
fixes https://github.com/lbryio/lbry/issues/1172
2018-06-19 13:38:25 -04:00
hackrush 371b27b116 Fix approximations in bid during publish 2018-06-18 10:40:33 -04:00
Jack Robison c26816c92d
fix database error when updating a claim that we don't have a file for (https://github.com/lbryio/lbry/issues/1165) 2018-06-15 10:21:37 -04:00
Lex Berezhny e11a2e6f85
publish accepts decimal string for the bid value 2018-06-13 16:52:35 -04:00
Jack Robison adca5f5993
fix routing_table_get 2018-06-07 15:02:47 -04:00
Jack Robison bdd6f948ca
add port to routing_table_get 2018-06-07 15:02:47 -04:00
Jack Robison cc32d987b2
update peer_list 2018-06-07 15:02:47 -04:00
Jack Robison a503a800ca
disable Cryptonator exchange rate feed 2018-06-07 15:02:47 -04:00
Lex Berezhny 23df1d0316
Merge branch 'master' into feature/file_list_sorting 2018-05-29 22:47:09 -04:00
Lex Berezhny 3d17c92bd3 moved import certifi to run only on windows 2018-05-29 22:36:37 -04:00
Akinwale Ariwodola c4550ef5b6 remove unused import in lbrynet.daemon.Daemon 2018-05-29 22:36:37 -04:00
Akinwale Ariwodola 97547e904e add os and sys imports 2018-05-29 22:36:37 -04:00
Victor Shyba 03968f377e change fix position to before anything else starts 2018-05-29 22:36:37 -04:00
Akinwale Ariwodola 513f5d0568 added certifi package for Twisted SSL verification on Windows 2018-05-29 22:36:37 -04:00
Jack Robison e3265714ee
Merge remote-tracking branch 'origin/1193' 2018-05-29 15:25:17 -04:00
Jack Robison 9b1e687b9b
pylint 2018-05-29 14:36:00 -04:00
Sergey Rozhnov 11b882879a predictable result sorting for claim_list and claim_list_mine 2018-05-29 13:07:11 -04:00
Jack Robison 187f920961
disable Daemon headers check for now 2018-05-28 10:57:48 -04:00
Jack Robison 6d4b678b96
Revert "WIP: feature/1098/sorted-claim-results" 2018-05-22 17:15:34 -04:00
kafene 76a7cc4e58 refactor file list sorting per request 2018-05-21 00:24:18 -04:00
kafene 1790393273 remove unused attrgetter import 2018-05-21 00:04:27 -04:00
kafene 5069351287 refactor file_list sort to allow sorting by any field 2018-05-21 00:04:27 -04:00
kafene eec3734d2f some semantic variable renaing 2018-05-21 00:04:27 -04:00
kafene e7b22521ee remove pprint import 2018-05-21 00:04:27 -04:00
kafene 326d0cb8a3 initial naive implementation of file_list sorting 2018-05-21 00:04:21 -04:00
Sergey Rozhnov 13353bcfe4 refactored unit test for sort_claim_results 2018-05-18 18:51:28 +04:00
Sergey Rozhnov 40bcf96c3d refactored sorting of claims and unit tests 2018-05-18 12:53:32 +04:00
Victor Shyba b48492c1d6 verify streams on a new migration instead 2018-05-17 12:29:12 -03:00
Sergey Rozhnov a7a5bb8887 simplified claims comparison logic; refactored unit tests 2018-05-17 13:36:32 +04:00
Sergey Rozhnov 208284a0f8 claim_list and claim_list_mine in Daemon return sorted results 2018-05-16 18:29:44 +04:00
Victor Shyba df735252e5 verify streams only after migration 2018-05-11 12:17:55 -03:00
Jack Robison b3bf193188
Merge remote-tracking branch 'origin/treq_and_cryptography' 2018-05-11 09:22:28 -04:00
Jack Robison aa4240de85
track successful reflector uploads in sqlite to minimize how many streams are attempted by auto re-reflect
-increase the default `auto_re_reflect_interval` to a day
2018-05-08 14:41:56 -04:00
Victor Shyba c90140f701 make the exchange manager use treq instead of requests 2018-05-05 02:33:37 -03:00
Jack Robison b89823c968
fix blob announce locking up the daemon process 2018-04-19 15:47:19 -04:00
Jack Robison baf55165aa
lint 2018-04-19 14:35:11 -04:00
Jack Robison fa49b40389
fix claim_show 2018-04-19 12:31:36 -04:00
Jack Robison 450bed6350
fix kwargs bug 2018-04-19 11:00:44 -04:00
Alex Grintsvayg f8e418fb44 undeprecated report_bug while app team works on a new bug reporting flow 2018-04-18 14:58:58 -04:00
Niko c089f1954a
fix documentation for blob_reflect 2018-04-12 13:27:06 -04:00
Niko 0a14d51b96
fix documentation for peer_ping command 2018-04-12 13:08:58 -04:00
Jack Robison 5cea031f38
return list of dictionaries from peer_list, include peer node ids 2018-04-03 13:10:30 -04:00
Jack Robison 2903ccaeb4
add peer_ping 2018-04-03 13:10:30 -04:00
Jack Robison eae97a8133
off by one 2018-04-03 13:08:36 -04:00
Jack Robison 4e7bdafdcf
fix positional and keyword args 2018-04-03 12:27:49 -04:00
Jack Robison 12d378af13
show not connected error in lbrynet-cli when using auth 2018-04-03 12:25:18 -04:00
Jack Robison 743ae59d54
fix lbrynet-cli when using authentication
-add explanation of daemon authentication to AuthJSONRPCServer docstring
-remove auth_required decorator, use auth for all api methods if use_authentication is true
-fix issues with the command line --http-auth flag to lbrynet-daemon and the use_http_auth setting in the config file
2018-04-01 18:31:03 -04:00
Jack Robison 8c2b626f97
fix cli kwargs 2018-03-29 12:19:41 -04:00
Jack Robison 0279d37b32
fix status docstring 2018-03-29 12:19:18 -04:00
Jack Robison 492858596e
add single_announce column to blob table
-remove deprecated blob_announce_all function
-remove announce_all parameter to blob_announce
-change blob_announce to be asynchronous
2018-03-28 18:50:24 -04:00
Jack Robison 5bab6f7d39
remove bandwidth stats 2018-03-28 18:50:24 -04:00
Jack Robison a41bbd5e27
pylint and tests 2018-03-28 18:50:18 -04:00
Jack Robison 333d70860b
add last_announced_time to blob table 2018-03-28 15:53:50 -04:00
Lex Berezhny 267f50474b
removing more references to PTCWallet 2018-03-28 15:53:50 -04:00
Jack Robison 88970cb0a8
move peer manager class to lbrynet.core 2018-03-28 15:53:49 -04:00
Kay Kurokawa 60c7261871
add single_hash_announce_duration as a field that gets return for API call status for dht status 2018-03-28 15:53:46 -04:00
Jack Robison 439a0f8778
fix docstrings
-add docopt unit test
2018-03-26 13:20:33 -04:00
hackrush aa7b440989 Fixed regression in stream_availablity command 2018-03-26 19:43:06 +05:30
Jack Robison f0742675b8
Merge branch 'master' into no-short-flags 2018-03-23 14:59:53 -04:00
Jack Robison cb069ca002
add blob_reflect 2018-03-22 16:54:29 -04:00
Jack Robison b28bdbd752
rename existing reupload.reflect_stream --> reupload.reflect_file, add a reupload.reflect_stream function 2018-03-19 13:55:11 -04:00
hackrush 3724fa1810 Removed last flag decorator 2018-03-18 16:11:19 +05:30
hackrush f7f6770120 Removed flags decorator as short flags are no longer used. 2018-03-18 16:11:19 +05:30
hackrush 1d9c996217
Merge pull request #1148 from lbryio/channel-bid
Update channel balance checking to match claim balance checking
2018-03-17 09:05:08 +05:30
hackrush 2b69d2fad0
Fix pylint error 2018-03-16 21:42:40 +05:30
Jack Robison 8af96a0c51
don't try to announce the stream terminator 2018-03-15 17:42:21 -04:00
Jack Robison adb1291c09
fix blob list key error 2018-03-15 09:55:40 -04:00
Thomas Zarebczan b218e84d29
update channel balance checking to match claim
Simple balance check before calling get_max_usable_balance_for_claim - matches what happens on the claim.

Also provide clearer error message about maximum amount
2018-03-15 09:42:17 -04:00
Jack Robison 9b44ba7c84
only call get_max_usable_balance when the bid might be too high 2018-03-13 17:32:29 -04:00
Alex Grintsvayg d0aa0a7d0c make dht forwards-compatible for upcoming switch to standardized bencode dict keys 2018-03-13 09:43:32 -04:00
hackrush 16f2a5429b Name and output message fix. 2018-03-13 01:26:18 +05:30
hackrush 6d4af4ba90 Error cleanly when claiming a new channel with exact or higher amount than balance
fixes #1107
2018-03-09 21:28:33 +05:30
Jack Robison cdfb7f4cb4
fix blob_list error 2018-03-08 16:43:22 -05:00
Jack Robison 3f1bcbffeb
fix blob_announce when announcing a single blob 2018-03-07 18:25:30 -05:00
hackrush da4a24d79f Added scripts to autogenerate docs and api from docstring
Summary of changes
  Removed single dashed(short args) arguments(possibly breaking changes
for app side)
  Standardised the docstrings
  Added scripts to autogenerate API and CLI documentation using the
docstrings
2018-03-06 03:50:12 +05:30
Alex Grintsvayg 95e12a208d deprecate report_bug 2018-03-05 14:17:57 -05:00
Jack Robison 7862ee6715
fix blob_announce command 2018-03-02 16:46:07 -05:00
Jack Robison 01c4c6ed97
fetch claim heights 2018-03-02 16:46:02 -05:00
Jack Robison 6a4b65a796
have get fail when given a channel uri before attempting to resolve 2018-03-02 15:34:34 -05:00
Jack Robison 76cb674ebb
fix updating content claims for existing files
-update lbry file attributes as soon as a change to the content claim occurs
2018-03-02 15:34:20 -05:00
Jack Robison d1240541c8
always update lbry file attributes after publishing 2018-03-02 15:33:48 -05:00
Jack Robison 91229aac6e
remove old stream on a publish update 2018-03-02 15:33:48 -05:00
Alex Grintsvayg fa33110d04 stop spamming cryptonator errors. fixes #984 2018-02-27 14:06:45 -05:00
Jack Robison dafa80ce29
Merge branch 'master' into update_fix 2018-02-22 14:10:51 -05:00
Jack Robison 741e395677
fix blob_list falsely returning an empty list for streams with known blobs
-remove get_blobs functions from Daemon, use functions in SQLiteStorage instead
2018-02-22 10:37:53 -05:00
Jack Robison 9a046fca0f
remove unused calculate_available_blob_size function 2018-02-22 10:22:53 -05:00
Jack Robison b1c66015e1
detect and remove invalid streams and sd blobs 2018-02-21 19:09:10 -05:00
hackrush 3754f34f53 Review fixes and additional comments in test 2018-02-21 14:22:11 +05:30
hackrush 2368433b22 Check for max usable balance before updating 2018-02-20 08:54:03 +05:30
hackrush d72ef784ed Removed daemon side bid checks during publish
Fixes #748

Fixed failing test, Yay!

Why CHANGELOG? Why not anarchy?
2018-02-20 08:54:03 +05:30
hackrush 5fee660c9c Fixed error types to be more appropriate 2018-02-17 20:18:55 +05:30
Jeremy Curcio 2621ba6982 Add exception for non-float bids when pubishing 2018-02-17 19:29:53 +05:30
Jack Robison e40d4f74d8
fix default db_revision 2018-02-13 14:42:53 -05:00
Jack Robison 9d539aaa16
migrate databases 2018-02-13 10:27:51 -05:00
Jack Robison c15850ccab
re-enable filtering lbry files by claim attributes 2018-02-13 10:27:51 -05:00
Jack Robison 0df383b9f2
update Downloader and Publisher 2018-02-13 10:27:51 -05:00
Jack Robison ce4b82d929
update Daemon to use SQLiteStorage 2018-02-13 10:27:51 -05:00
Alex Grin d6819d8091
Merge pull request #1086 from lbryio/add-conf-flag-to-cli
fixes for the --conf flag
2018-02-12 17:01:43 -05:00
Alex Grintsvayg bb2efdcc7c fixed the error when trying to perform get on channels
now it states that get cannot be used on channels

closes #623
closes #1085
2018-02-12 16:40:29 -05:00
Antonio Quartulli 34976c7602
DaemonCLI: add --conf flag
When starting a daemon with a different configuration,
the same should also be used by the cli tool.

Add the --conf flag to the cli command to allow using a
custom config file.

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2018-02-10 16:22:32 +08:00
rick batka 69a99a61ba Fix issue #930. Disallow positional arguments for CLI settings_set and fix error reporting when settings_set fails. 2018-02-09 11:30:29 -05:00
Alex Grintsvayg b3d3c1c93b drop commands list from cli help 2018-02-08 09:36:59 -05:00
Roger Ostrander a4343c3eb3 API call to blob_list with uri parameter now succeeds 2018-02-03 23:08:15 -05:00
hackrush 5a3a592df8 Related changlelog for the PR lbryio/lbryum#203 2018-01-26 15:52:25 +05:30
Jack Robison 973978c1e5
pylint 2018-01-22 16:04:08 -05:00
Alex Grintsvayg a6588f740a stop sending useless analytics event 2018-01-22 15:21:39 -05:00
Jack Robison edb0f8deed
changelog and doc 2018-01-18 13:41:17 -05:00
hackrush 7472d12644 Removed include_tip_info from transaction_list, goes with lbryum#183 2018-01-18 08:43:58 +05:30
Jack Robison 8a133f9749
use lists of hostname:port strings in conf file 2018-01-09 16:55:39 -05:00
akinwale 5677f6d00d
added a new startup stage for wallet_unlock (#1048)
* added a new startup stage to indicate if the daemon is waiting for wallet_unlock
2018-01-07 06:44:29 +01:00
Thomas Zarebczan 4b6d0d33ef
remove download_directory from options 2018-01-05 14:19:21 -05:00
Jack Robison b046a6578b
add blockchain_name and lbryum_servers to the adjustable settings 2018-01-04 21:30:41 -05:00
Jack Robison 64e04f8a68
refactor start_lbry_file 2018-01-04 21:28:09 -05:00
Jack Robison bc58add6de
logging 2018-01-04 21:25:56 -05:00
Jack Robison 62a8789393
change default full_status to True in _get_lbry_files 2018-01-04 21:25:55 -05:00
Jack Robison 7a020bec05
Merge remote-tracking branch 'origin/add-conf-file-flag' 2018-01-03 14:46:57 -05:00
Antonio Quartulli 79054037a7
conf: make config file a CLI parameter
The config file might be stores in an alternate location for several
reasons (i.e. testing different configs or running multiple nodes on the
same host). Make the config file a CLI parameter so that it can be
specified when launching the lbrynet-daemon.

Related to #1039

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2017-12-30 04:11:06 +08:00
Jack Robison bf46f5616b
Merge branch 'add_lbry_file_manager_to_reflector_2' 2017-12-29 12:39:50 -05:00
Alex Grintsvayg b0c4746413 delete line that does nothing 2017-12-29 11:12:33 -05:00
Jack Robison 09c57675a7
add stream_availability and blob_availability, deprecate get_availability 2017-12-20 21:23:54 -05:00
Jack Robison e22d43bb03
fix wallet_unlock 2017-12-18 13:17:54 -05:00
Jack Robison 8c2d381aee Wallet encryption (#783)
* update known commands
* add wallet_unlock, block wallet startup on being unlocked
* add wallet_decrypt and wallet_encrypt
* wallet encryption unit tests
* added use_keyring configuration option in order to make keyring password storage optional
2017-12-17 07:00:12 +01:00
Jack Robison a6f0c5fb4c
pylint fixes
fix exception formatting and a circular import
2017-12-15 20:25:20 -05:00
Jack Robison e58f3593ee
pylint 2017-12-13 16:43:49 -05:00
Alex Grintsvayg ebed4f010b fixes #1029 - stupid error messages 2017-12-13 13:56:44 -05:00
Jack Robison b7ee5419d4
better address use, remove _save_wallet from Wallet.py 2017-12-07 14:36:51 -05:00
Jack Robison 330d0465b6
remove message field from lbry file json, add blobs_completed, blobs_in_stream, and status fields 2017-12-07 13:54:18 -05:00
Jack Robison fb6ceeed9e
delete unused code 2017-12-06 20:41:24 -05:00
Jack Robison b7503f8b61
log traceback info for failed api requests 2017-12-06 19:52:29 -05:00
Jack Robison b2a0aa21c9
get search timeout from conf.settings 2017-12-06 19:52:29 -05:00
Jack Robison ac7ffdbf3a
add lbry_file_metadata table to save outpoint data of downloads 2017-12-06 19:52:25 -05:00
Jack Robison 90aa89dcae
re-add outpoint to file dictionary returned from file_ commands 2017-12-06 17:22:47 -05:00
Jack Robison 1594c6a831
move db functions in EncryptedFileManger to EncryptedFileMetadataManager
- remove TempEncryptedFileMetadataManager, run tests with the normal
DBEncryptedFileMetadataManager
2017-12-06 16:49:49 -05:00
Jack Robison 8fdd8d8c43
fix api error responses 2017-12-06 13:25:58 -05:00
Jack Robison fbcc81adb4
add lbrynet-console 2017-12-05 13:34:46 -05:00
Kay Kurokawa 7e93ea8d97
do a sanity check to see if we have remote height, use remote height instead of local height when auto renewing 2017-12-05 09:41:45 -05:00