Commit graph

233 commits

Author SHA1 Message Date
Lex Berezhny
fb2fb5c38c
recovered an old stash 2018-08-24 11:37:25 -04:00
Lex Berezhny
5e71dcbaf0
wip: implementation is now generic and supports multiple currencies 2018-08-24 11:37:25 -04:00
Alex Grintsvayg
149fa625e0 back to reflector 1 2018-08-15 16:11:34 -04:00
Jack Robison
f1b19f10cc
Merge branch 'master' into greedy_search 2018-08-03 13:08:31 -04:00
Victor Shyba
ad96b006f9 adds http download support for blobs mirroring 2018-07-25 12:15:52 -03:00
Jack Robison
a285db1b08
pylint 2018-07-24 20:01:38 -04:00
Jack Robison
13bf8125e3
status doc, better determination of is_first_run
-add skipped_components to status response
-re-add run_reflector_server to settings
2018-07-24 20:01:38 -04:00
hackrush
e7c57dcabc
add components_to_skip setting 2018-07-24 20:01:38 -04:00
Victor Shyba
c589e89bf0 greedy search with exclude filtering 2018-07-05 22:03:52 -03:00
Lex Berezhny
6952c2c07e
Revert "refactor lbrynet-daemon into modular components" (#1286)
* Revert "fix reflector test"

This reverts commit 6a15b51ac3.

* Revert "refactor lbrynet-daemon into modular components (#1164)"

This reverts commit 75a6ff269e.
2018-07-05 19:05:48 -04:00
Jack Robison
75a6ff269e refactor lbrynet-daemon into modular components (#1164)
* add daemon Component and ComponentManager classes

* convert directory and SQLiteStorage setup to be a Component

* support callbacks to component setups

* Fixed typo in ComponentManager

* convert wallet to be Component

* Use storage from session.

* Remove create_session internal function and PEP8

* Starting to convert session to its own component. Removed ref to `self.storage` from Daemon.py

* Making DHT component(broken)

* Refactored classes to reduce redundancy in getting config setting

* DHT is now it's own component

* Fixed `test_streamify` test

* Fixed regression caused by removing `peer_manager` from session

* refactor ComponentManager and Component to use instance instead of class methods

* Hash announcer, file manager, stream identifier components

* Query Handler and server components

* Reflector Component

* Fixed test_streamify(well Jack did, but ¯\_(ツ)_/¯)

* All tests now passing

* Pylint fixes

* Oops(That's all you're gonna get :-P)

* Making decorators(WIP, commit so that I don't lose work)

* Decorator made and decorating of functions done(some other changes)

* import fixes and removed temporary test function

* Fixed new broken tests from daemon refactor

* Sanitization of modules

* Reworded errors

* wallet unlock condition checks, fixed breaking changes

* Rebased on amster and other crazy stuff

* Started writing tests

* Tests for component manager

* Fix Daemon Tests

* Fixed passing mutable args in init

* Using constants instead of strings. Added CHANGELOG.md

* Now components can be skipped by setting relevant config in file.

* P-Y-L-I-N-T #angry_emoji
2018-07-05 15:21:52 -04:00
Victor Shyba
1cc7ce69ab set the peer search timeout as configured and raise it to 30s 2018-07-03 13:47:00 -03:00
jleute
0dbd15df7b Merge remote-tracking branch 'upstream/master' 2018-06-12 00:27:08 +02:00
jleute
5926b17871 Updated unittest for saving of server lists in the conf file 2018-06-12 00:05:49 +02:00
jleute
c411d8700b fixes #1109 2018-06-12 00:04:35 +02:00
Jack Robison
9219e5976e
update default lbryum servers 2018-06-09 11:26:26 -04:00
Jack Robison
db06191c33
reduce default concurrent announcers to 10
-lower rpc timeout to what it originally was
2018-06-07 15:02:47 -04:00
Jack Robison
b3bf193188
Merge remote-tracking branch 'origin/treq_and_cryptography' 2018-05-11 09:22:28 -04:00
Jack Robison
aa4240de85
track successful reflector uploads in sqlite to minimize how many streams are attempted by auto re-reflect
-increase the default `auto_re_reflect_interval` to a day
2018-05-08 14:41:56 -04:00
Victor Shyba
2299098884 add integrity check for the headers file 2018-05-07 15:10:19 -03:00
Jack Robison
129d2687b9
download headers from s3 when more than 10 chunks behind 2018-05-02 15:00:50 -04:00
Jack Robison
dff1fd3fe9
logging, raise default concurrent announcers 2018-03-28 18:50:24 -04:00
Jack Robison
43d3f7c087
add concurrent_announcers to config 2018-03-28 15:53:51 -04:00
Antonio Quartulli
639744e047
conf: initialize IDs after reading config file
Installation_id and node_id are stored in the data dir.
For this reason they should be read/created only after the
config has been parsed.
This way they can be retrieved or stored at the right location.

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2018-02-10 16:22:33 +08:00
rick batka
69a99a61ba Fix issue #930. Disallow positional arguments for CLI settings_set and fix error reporting when settings_set fails. 2018-02-09 11:30:29 -05:00
Jack Robison
b6afc437e6
combine auto_re_reflect and reflect_uploads settings 2018-01-12 09:21:24 -05:00
Jack Robison
8a133f9749
use lists of hostname:port strings in conf file 2018-01-09 16:55:39 -05:00
Jack Robison
b046a6578b
add blockchain_name and lbryum_servers to the adjustable settings 2018-01-04 21:30:41 -05:00
Jack Robison
ecb9909faa
fix node and installation id whitespace bugs 2018-01-04 21:25:55 -05:00
Antonio Quartulli
79054037a7
conf: make config file a CLI parameter
The config file might be stores in an alternate location for several
reasons (i.e. testing different configs or running multiple nodes on the
same host). Make the config file a CLI parameter so that it can be
specified when launching the lbrynet-daemon.

Related to #1039

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2017-12-30 04:11:06 +08:00
Antonio Quartulli
0d3493ef73
conf: add method to check if a setting has default value
Sometimes it might be helpful to check if a given config
setting is still the default or if it was touched by the user
in any way (e.g. env, config file, ...).

Add is_default() method to Config object to perform such check.

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2017-12-29 19:49:59 +08:00
Alex Grintsvayg
21d9b9bc71 minor fixes 2017-12-28 10:08:30 -05:00
Jack Robison
8c2d381aee Wallet encryption (#783)
* update known commands
* add wallet_unlock, block wallet startup on being unlocked
* add wallet_decrypt and wallet_encrypt
* wallet encryption unit tests
* added use_keyring configuration option in order to make keyring password storage optional
2017-12-17 07:00:12 +01:00
Kay Kurokawa
e4e60ebe9b
add auto_renew_claim_height_delta to configuration and auto renew after startup if necessary 2017-12-05 09:41:42 -05:00
Kay Kurokawa
9470b318b0 moved BLOB_SIZE in conf to MAX_BLOB_SIZE constant in blob.blob_file 2017-10-31 15:38:00 -04:00
Akinwale Ariwodola
0291482abb raised errors directly instead of wrapping with AssertionError 2017-10-11 07:59:30 +01:00
Akinwale Ariwodola
fb6545481b refactored one more assert 2017-10-09 20:41:08 +01:00
Akinwale Ariwodola
4f6f226b18 refactor asserts due to PYTHONOPTIMIZE flag 2017-10-09 20:20:58 +01:00
Kay Kurokawa
0fc116fbdb Change to reflector2 in conf 2017-09-25 13:18:07 -04:00
Kay Kurokawa
cc98cdf933
announce_head_blobs_only is True by default 2017-09-22 14:46:28 -04:00
Kay Kurokawa
66152a8f93 turn on head blob announce seek for clients 2017-09-11 11:34:26 -04:00
Kay Kurokawa
a31b6b192f Create an optional way of downloading by head blob first in ConnectionManager 2017-08-28 10:46:47 -04:00
Kay Kurokawa
0639bb9865 add support for should_announce feature 2017-08-28 10:43:57 -04:00
Jack Robison
5fc55fc482
Merge branch 'master' into android_platform_paths 2017-08-22 15:39:02 -04:00
Akinwale Ariwodola
6252184699 fix pylint error 2017-08-18 15:09:08 +01:00
Akinwale Ariwodola
70881dab6e added Android platform detection and androidhelpers module which will be used to determine base paths 2017-08-18 11:52:03 +01:00
Jack Robison
d1b7de1807
persist dht node id 2017-08-16 21:18:10 -04:00
Kay Kurokawa
9d92fba02e add ability to control re-reflects through config 2017-08-03 23:44:20 -04:00
hackrush
ecd602e5fb Added validation for currencies.
Now while setting currency via API/CLI it is checked that the user has
not entered any currency other that LBC, BTC or USD.

Fixes #778
2017-07-24 16:38:15 -04:00
Jack Robison
5e2e96b1ff
fix directories 2017-07-19 18:52:48 -04:00
Zestyr
bfa626c6e6 Update default directories
Fixes #574
2017-07-17 21:50:58 +02:00
Jack Robison
dfedb6cd01
update loggly token 2017-07-14 14:29:12 -04:00
hackrush
f7b6a09110 Updated max_key_fee_setting
Added an option to disable max key fee check.
Did the required docs changes.
2017-07-14 14:09:30 -04:00
Kay Kurokawa
2730aa9ad6 make sure window paths of directories are in string not unicode 2017-07-03 16:01:18 -04:00
Umpei Kay Kurokawa
4e42ae97ea Revert "Fix default directories (fixes #574)" 2017-07-03 11:09:59 -04:00
Zestyr
091c49115c Merge remote-tracking branch 'upstream/master' 2017-06-28 17:54:42 +02:00
hackrush
9743162cda Increased max_key_fee
The default max_key_fee value is increased to US$ 50.
Fixes #721
2017-06-27 21:48:42 +05:30
Zed
9caea54490 Merge branch 'master' into master 2017-06-23 02:45:12 +02:00
Jack Robison
bc34c22e58 update daemon settings and settings_set 2017-06-21 22:54:47 -04:00
Zestyr
6a1a91f8f1 Fix old legacy Windows location 2017-06-22 02:28:32 +02:00
Zestyr
ebec2fe955 Make directories lowercase, catch exception, initialize settings 2017-06-19 19:49:27 +02:00
Zestyr
ddde036e3a Add check for old folder locations 2017-06-19 19:24:39 +02:00
Zestyr
28613f1990 Shorten download dir variable for consistency 2017-06-18 07:15:28 +02:00
Zestyr
e0ff3171d8 Fix default directories 2017-06-18 07:14:42 +02:00
Alex Grintsvayg
15e89650ff track more events 2017-04-26 20:02:00 -04:00
Alex Grintsvayg
2353dbcb00 refactor analytics 2017-04-26 14:19:03 -04:00
Alex Grintsvayg
cd16383fa6 use git version when in dev 2017-04-26 14:18:41 -04:00
Alex Grintsvayg
492cbc83c9 pylint 2017-04-19 16:00:39 -04:00
Jack Robison
40374ec202 use lbryio api for price data instead of bittrex 2017-04-07 19:33:13 -04:00
Jack Robison
1880f64da2 raise default download timeout 2017-04-06 20:50:28 -04:00
Kay Kurokawa
931038d478 bug fixes for lbryschema integration 2017-04-04 20:30:51 -04:00
Alex Grintsvayg
1a562d70aa config to share debug info with lbry devs 2017-03-29 11:06:07 -04:00
Alex Grintsvayg
15517732ae add config to disable reflecting on publish 2017-03-16 17:49:24 -04:00
Alex Grintsvayg
68f5588bd9 make loggly logs less verbose 2017-03-08 11:23:28 -05:00
Jack Robison
25ec8fde23 add timeout to get_availability and peer_list
-add optional timeout to DHTPeerFinder.find_peers_for_blob
-add peer_search_timeout setting
2017-02-16 11:17:37 -05:00
Jack Robison
c6648ff6bc add installation id, re-initialize lbryid on each start 2017-02-02 10:23:17 -05:00
Alex Grintsvayg
c62ee6bb0c fix loading settings from env 2017-01-20 13:38:49 -05:00
Alex Grintsvayg
3aea476014 ignore invalid config file keys 2017-01-20 12:39:59 -05:00
Alex Grintsvayg
cac8267e85 updates, more refactoring for greater clarity 2017-01-17 12:29:09 -05:00
Alex Grintsvayg
267c6cbaca refactor conf.settings 2017-01-16 22:32:54 -05:00
Jack
2cf08fda2d use urllib for loggly url formatting 2017-01-02 16:09:28 -05:00
Jack
c2c7d2b327 send bug reports to slack 2017-01-02 14:52:24 -05:00
Job Evers-Meltzer
8f61fb3fc4 Initialize settings, along with lbryid and session_id on startup 2016-12-30 13:05:19 -06:00
Job Evers-Meltzer
39b2e44492 Replace settings with conf.settings
In the next commit I change conf.settings to be initialized
at runtime instead of load time and so any import of
`from lbrynet.conf import settings` will be and stay None if
it happens before the initialization.
2016-12-30 13:05:18 -06:00
Job Evers-Meltzer
fa29c92760 Add setting to disable reuploading to reflector 2016-12-15 18:58:16 -06:00
Job Evers-Meltzer
14ac2bac39 pylint: fix trailing-whitespace 2016-12-14 19:21:59 -06:00
Job Evers-Meltzer
e8faadc324 fix more long lines 2016-12-07 10:10:46 -05:00
alexliebowitz
39005ffc14 Merge pull request #310 from lbryio/allow-cors-config
allow Access-Control-Allow-Origin to be configurable
2016-12-06 15:11:38 -05:00
Jack Robison
28e88d89a5 Merge pull request #313 from lbryio/config-bittrex
Add bittrex to conf
2016-12-06 12:41:45 -05:00
Jack Robison
4c4bccfe73 Merge pull request #312 from lbryio/local-ui-conf
local_ui_path needs to be a str
2016-12-06 12:23:45 -05:00
Umpei Kay Kurokawa
6076861cd0 Merge pull request #304 from kaykurokawa/remove_lbrycrd
Remove lbrycrdd
2016-12-06 12:06:09 -05:00
Job Evers‐Meltzer
8b427a92ac Merge pull request #311 from lbryio/fix-server-port
port needs to be an int
2016-12-06 09:48:08 -05:00
Job Evers-Meltzer
8f80e8a3da add bittrex to conf 2016-12-05 17:14:25 -05:00
Job Evers-Meltzer
cd44ae02a3 __getattr__ should call __getattribute__ 2016-12-05 17:06:45 -05:00
Job Evers-Meltzer
848f1f025c local_ui_path needs to be a str 2016-12-05 16:29:18 -05:00
Job Evers-Meltzer
d2cc8355dc port needs to be an int 2016-12-05 16:20:16 -05:00
Job Evers
ee00d1984a allow Access-Control-Allow-Origin to be configurable 2016-12-05 15:34:48 -05:00
Jack
d9e1e88c05 refactor get_est_cost
-add size parameter, if provided the sd blob won’t be downloaded (can
be used with size information from lighthouse)

-check if blob was already downloaded before trying to download it again
2016-12-05 11:48:43 -05:00
Alex Liebowitz
7d0e9f6ab9 Tweak logic in ApplicationSettings
Use self.environ instead of ENVIRONMENT to avoid global reference
2016-12-01 23:51:58 -05:00
Kay Kurokawa
200a22c93b Remove support for lbrycrdd wallet and related code 2016-12-01 16:45:48 -05:00