Commit graph

2640 commits

Author SHA1 Message Date
Jack Robison 1c793931ed
Bump version 0.20.0rc7 --> 0.20.0rc8
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-04-19 12:31:54 -04:00
Jack Robison fa49b40389
fix claim_show 2018-04-19 12:31:36 -04:00
Jack Robison 89b4487eb9
Bump version 0.20.0rc6 --> 0.20.0rc7
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-04-19 11:05:42 -04:00
Jack Robison 450bed6350
fix kwargs bug 2018-04-19 11:00:44 -04:00
Alex Grintsvayg f8e418fb44 undeprecated report_bug while app team works on a new bug reporting flow 2018-04-18 14:58:58 -04:00
Jack Robison 2655797692
move docs tests to own file 2018-04-12 14:04:22 -04:00
Niko c089f1954a
fix documentation for blob_reflect 2018-04-12 13:27:06 -04:00
Niko 0a14d51b96
fix documentation for peer_ping command 2018-04-12 13:08:58 -04:00
Jack Robison bb7e17e54a
Bump version 0.20.0rc5 --> 0.20.0rc6
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-04-03 13:21:17 -04:00
Jack Robison 5cea031f38
return list of dictionaries from peer_list, include peer node ids 2018-04-03 13:10:30 -04:00
Jack Robison 2903ccaeb4
add peer_ping 2018-04-03 13:10:30 -04:00
Jack Robison eae97a8133
off by one 2018-04-03 13:08:36 -04:00
Jack Robison bc3128ae3b
Bump version 0.20.0rc4 --> 0.20.0rc5
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-04-03 12:34:45 -04:00
Jack Robison 4e7bdafdcf
fix positional and keyword args 2018-04-03 12:27:49 -04:00
Jack Robison 12d378af13
show not connected error in lbrynet-cli when using auth 2018-04-03 12:25:18 -04:00
Jack Robison ca73d632d3
Bump version 0.20.0rc3 --> 0.20.0rc4
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-04-02 10:13:02 -04:00
Jack Robison 743ae59d54
fix lbrynet-cli when using authentication
-add explanation of daemon authentication to AuthJSONRPCServer docstring
-remove auth_required decorator, use auth for all api methods if use_authentication is true
-fix issues with the command line --http-auth flag to lbrynet-daemon and the use_http_auth setting in the config file
2018-04-01 18:31:03 -04:00
Jack Robison ea5190aa9a
Bump version 0.20.0rc2 --> 0.20.0rc3
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-29 15:06:41 -04:00
Jack Robison 51662b1e5b
re-add hash_queue_size function 2018-03-29 15:06:08 -04:00
Jack Robison 789ca3693f
Bump version 0.20.0rc1 --> 0.20.0rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-29 12:20:54 -04:00
Jack Robison 8c2b626f97
fix cli kwargs 2018-03-29 12:19:41 -04:00
Jack Robison 0279d37b32
fix status docstring 2018-03-29 12:19:18 -04:00
Jack Robison f4aca40ff9
Bump version 0.19.3rc2 --> 0.20.0rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-29 09:55:34 -04:00
Jack Robison 08e9f9ac0e
Bump version 0.19.3rc1 --> 0.19.3rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-29 09:50:14 -04:00
Jack Robison 9a9b2f47ce
pass sd_hash to reflector client factory instead of looking it up 2018-03-29 09:46:34 -04:00
Jack Robison b9600101ae
Bump version 0.19.2 --> 0.19.3rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-28 19:36:39 -04:00
Jack Robison 492858596e
add single_announce column to blob table
-remove deprecated blob_announce_all function
-remove announce_all parameter to blob_announce
-change blob_announce to be asynchronous
2018-03-28 18:50:24 -04:00
Jack Robison dff1fd3fe9
logging, raise default concurrent announcers 2018-03-28 18:50:24 -04:00
Jack Robison eabf4a0e40
remove delay from udp write 2018-03-28 18:50:24 -04:00
Jack Robison 5bab6f7d39
remove bandwidth stats 2018-03-28 18:50:24 -04:00
Jack Robison a41bbd5e27
pylint and tests 2018-03-28 18:50:18 -04:00
Jack Robison 43d3f7c087
add concurrent_announcers to config 2018-03-28 15:53:51 -04:00
Jack Robison c5bf64cf0a
refactor DHTHashAnnouncer
-remove hash_announcer from Node and DiskBlobManager
-remove announcement related functions from DiskBlobManager
-update SQLiteStorage to store announcement times and provide blob hashes needing to be announced
-use dataExpireTimeout from lbrynet.dht.constants for re-announce timing
-use DeferredSemaphore for concurrent blob announcement
2018-03-28 15:53:51 -04:00
Jack Robison ea0ea704a2
refactor iterativeAnnounceHaveBlob
-change to only self_store if the number of contacts to store to is less than k and we are the closest node to the hash
2018-03-28 15:53:51 -04:00
Jack Robison 14f9bb7b82
log EWOULDBLOCK 2018-03-28 15:53:51 -04:00
Jack Robison a8025b02c6
log invalid vs missing token 2018-03-28 15:53:51 -04:00
Jack Robison 333d70860b
add last_announced_time to blob table 2018-03-28 15:53:50 -04:00
Lex Berezhny 267f50474b
removing more references to PTCWallet 2018-03-28 15:53:50 -04:00
Lex Berezhny 866f220d9b
removed PTCWallet 2018-03-28 15:53:50 -04:00
Jack Robison a96d827c0f
use reactor time in Delay 2018-03-28 15:53:50 -04:00
Jack Robison 4eab77fa10
safe start_listening 2018-03-28 15:53:50 -04:00
Jack Robison 5013426e02
logging and docstring 2018-03-28 15:53:50 -04:00
Jack Robison cb09be5336
remove unused stuff 2018-03-28 15:53:50 -04:00
Lex Berezhny 339e666f38
+ Wallet.wait_for_tx_in_wallet 2018-03-28 15:53:49 -04:00
Jack Robison ebe5dd0e68
better ping test 2018-03-28 15:53:49 -04:00
Jack Robison 1db44d5fb6
rename variable 2018-03-28 15:53:49 -04:00
Jack Robison fd7a771f66
add sanity check to CreateEncryptedFileTest 2018-03-28 15:53:49 -04:00
Jack Robison 5628d0825b
add CallLaterManager 2018-03-28 15:53:49 -04:00
Jack Robison 88970cb0a8
move peer manager class to lbrynet.core 2018-03-28 15:53:49 -04:00
Jack Robison d2a6dd3ed3
add dht functional tests 2018-03-28 15:53:49 -04:00
Jack Robison 1eff35ce76
update dht unit tests to use task.Clock 2018-03-28 15:53:49 -04:00
Jack Robison 0ab5dd28bc
update tests 2018-03-28 15:53:48 -04:00
Jack Robison 2e30ce9ae5
add mock udp transport layer 2018-03-28 15:53:48 -04:00
Jack Robison 87c69742cd
log packet encoding errors and warn if the transport is not connected 2018-03-28 15:53:48 -04:00
Jack Robison b4bc5e2110
cancel callLater on error or timeout 2018-03-28 15:53:48 -04:00
Jack Robison df78f7ff9f
add response assertion to announce_to_peer 2018-03-28 15:53:48 -04:00
Jack Robison bdba263224
catch TimeoutError in _IterativeFindHelper 2018-03-28 15:53:48 -04:00
Jack Robison 16fcc3f5c1
findValue inlinecallbacks refactor 2018-03-28 15:53:48 -04:00
Jack Robison 43896c8d17
refactor joinNetwork into smaller functions
-try to re-join network if no contacts are known
2018-03-28 15:53:47 -04:00
Jack Robison 04e76443c6
move dht node component setup from Session into Node 2018-03-28 15:53:47 -04:00
Jack Robison e6caedac91
remove DHTHashSupplier class, move former functions into DHTHashAnnouncer 2018-03-28 15:53:47 -04:00
Jack Robison 6666468640
add reactor arguments to Node
-adds reactor (clock) and reactor functions listenUDP, callLater, and resolve as arguments to Node.__init__
-set the reactor clock on LoopingCalls to make them easily testable
-convert callLater manage loops to LoopingCalls
2018-03-28 15:53:47 -04:00
Jack Robison efaa97216f
move dht node setup back into node class 2018-03-28 15:53:47 -04:00
Jack Robison e30ea50ef4
more 2018-03-28 15:53:47 -04:00
Jack Robison 3296c0fb3d
move dht related classes to lbrynet.dht 2018-03-28 15:53:47 -04:00
Jack Robison 54a152fa8e
fix merge conflict in dht tests 2018-03-28 15:53:46 -04:00
Kay Kurokawa 9088d152b5
better to keey track of retry count in function instead of unbounded dictionary 2018-03-28 15:53:46 -04:00
Kay Kurokawa 4cb461601e
result must be set here, otherwise it will not be defined when used later. Add test for it 2018-03-28 15:53:46 -04:00
Kay Kurokawa 0425c95b68
No need for clock now in test for DHTHashAnnouncer 2018-03-28 15:53:46 -04:00
Kay Kurokawa 75b977dff9
we just have one supplier not a list of suppliers 2018-03-28 15:53:46 -04:00
Kay Kurokawa 60c7261871
add single_hash_announce_duration as a field that gets return for API call status for dht status 2018-03-28 15:53:46 -04:00
Kay Kurokawa 0f3385e4dc
make the single hash announce duration adjustable in DHTHashSupplier 2018-03-28 15:53:46 -04:00
Jack Robison ad6a2bef7f
handle error from old clients with a broken ping command 2018-03-28 15:53:45 -04:00
Jack Robison 446c3a88dc
refactor DHTHashAnnouncer and iterativeAnnounceHaveBlob
-use looping call for running manage function rather than a scheduled
callLater

-track announce speed

-retry store requests that failed up to 3 times

-return a dict of {blob_hash: [storing_node_id]} results from
_announce_hashes

_refreshRoutingTable inline cb refactor

-add and use DeferredLockContextManager

-don't trap errback from iterativeFindNode in iterativeAnnounceHaveBlob
2018-03-28 15:53:45 -04:00
Jack Robison 67ef8be7b7
convert node manage function to a looping call 2018-03-28 15:53:45 -04:00
Jack Robison ecbe4113ce
move Distance to own file 2018-03-28 15:53:45 -04:00
Jack Robison b75c8d96ce
Bump version 0.19.2rc3 --> 0.19.2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-28 15:35:46 -04:00
Jack Robison cb83531d05
Bump version 0.19.2rc2 --> 0.19.2rc3
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-28 15:15:47 -04:00
Jack Robison dc65fd148e
Bump version 0.19.2rc1 --> 0.19.2rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-26 13:36:51 -04:00
Jack Robison 439a0f8778
fix docstrings
-add docopt unit test
2018-03-26 13:20:33 -04:00
hackrush aa7b440989 Fixed regression in stream_availablity command 2018-03-26 19:43:06 +05:30
Jack Robison f0742675b8
Merge branch 'master' into no-short-flags 2018-03-23 14:59:53 -04:00
Alex Grintsvayg 9ee5a3511d missed this in dht-compat merge 2018-03-23 12:50:18 -04:00
Jack Robison 69657750b8
Bump version 0.19.1 --> 0.19.2rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-22 17:04:12 -04:00
Jack Robison cb069ca002
add blob_reflect 2018-03-22 16:54:29 -04:00
Jack Robison 3085e28490
don't try to resend failed blobs to reflector
-fixes infinite loop where client keeps trying to send failing blobs, which may be failing because they are invalid

-return list of reflected blob hashes from BlobReflectorClient
2018-03-22 16:53:16 -04:00
Jack Robison 679c2f403f
fix incorrectly raised DownloadCanceledError for already verified blobs
-make InvalidDataError message clearer
-fix BlobReflectorClient result
2018-03-22 13:23:12 -04:00
Jack Robison de280b5ebf
Bump version 0.19.1rc7 --> 0.19.1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-20 10:15:50 -04:00
Jack Robison 113cc8bb15
Bump version 0.19.1rc6 --> 0.19.1rc7
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-19 14:31:17 -04:00
Jack Robison b28bdbd752
rename existing reupload.reflect_stream --> reupload.reflect_file, add a reupload.reflect_stream function 2018-03-19 13:55:11 -04:00
Jack Robison f94a9e8729
start lbry files in parallel 2018-03-19 13:46:27 -04:00
Jack Robison 43c73b9abf
fix slow sqlite query 2018-03-19 13:31:05 -04:00
hackrush 3724fa1810 Removed last flag decorator 2018-03-18 16:11:19 +05:30
hackrush f7f6770120 Removed flags decorator as short flags are no longer used. 2018-03-18 16:11:19 +05:30
hackrush 1d9c996217
Merge pull request #1148 from lbryio/channel-bid
Update channel balance checking to match claim balance checking
2018-03-17 09:05:08 +05:30
hackrush 2b69d2fad0
Fix pylint error 2018-03-16 21:42:40 +05:30
Jack Robison 0313f857ba
don't try to delete the stream terminator from the blob table when deleting a stream 2018-03-15 17:44:54 -04:00
Jack Robison 8af96a0c51
don't try to announce the stream terminator 2018-03-15 17:42:21 -04:00
Jack Robison adb1291c09
fix blob list key error 2018-03-15 09:55:40 -04:00
Thomas Zarebczan b218e84d29
update channel balance checking to match claim
Simple balance check before calling get_max_usable_balance_for_claim - matches what happens on the claim.

Also provide clearer error message about maximum amount
2018-03-15 09:42:17 -04:00
Jack Robison 80fcb760b7
Bump version 0.19.1rc5 --> 0.19.1rc6
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-14 16:45:39 -04:00
Jack Robison bc2f5901a7
Merge branch 'add-txlbryum' 2018-03-14 15:07:57 -04:00
Lex Berezhny 633b49da92 removed RequestCounter 2018-03-14 15:01:47 -04:00
Jack Robison 76b3d219c8
Bump version 0.19.1rc4 --> 0.19.1rc5
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-14 13:54:05 -04:00
Jack Robison e94d10d3eb
only call get_max_usable_balance_for_claim in Wallet.py if the bid looks too high for the balance 2018-03-14 13:47:34 -04:00
Jack Robison 25eb64b346
Bump version 0.19.1rc3 --> 0.19.1rc4
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-13 17:34:08 -04:00
Jack Robison 9b44ba7c84
only call get_max_usable_balance when the bid might be too high 2018-03-13 17:32:29 -04:00
Jack Robison 69ecc6ce90
Bump version 0.19.1rc2 --> 0.19.1rc3
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-13 11:44:27 -04:00
Jack Robison cde78f8134
migrate configured download directory instead of assuming the default 2018-03-13 11:40:34 -04:00
Alex Grintsvayg d0aa0a7d0c make dht forwards-compatible for upcoming switch to standardized bencode dict keys 2018-03-13 09:43:32 -04:00
Lex Berezhny 37bfed8aee
Merge pull request #1137 from lbryio/new-channel-fix
Error cleanly when claiming a new channel with exact or higher amount than balance
2018-03-12 16:17:18 -04:00
hackrush 16f2a5429b Name and output message fix. 2018-03-13 01:26:18 +05:30
Jack Robison e881b608bf
Revert "don't block daemon startup on the file manager"
This reverts commit f25b772
2018-03-12 10:44:29 -04:00
Jack Robison b41bb9beee
Bump version 0.19.1rc1 --> 0.19.1rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-09 14:14:02 -05:00
Jack Robison f25b772b56
don't block daemon startup on the file manager 2018-03-09 14:09:07 -05:00
Jack Robison f07e696c31
fix get_pending_blobs_for_stream 2018-03-09 14:07:26 -05:00
hackrush f5aadf3918 Sanitized logged error for channel and name claims 2018-03-09 21:28:33 +05:30
hackrush 6d4af4ba90 Error cleanly when claiming a new channel with exact or higher amount than balance
fixes #1107
2018-03-09 21:28:33 +05:30
Jack Robison 96e30984c1
Bump version 0.19.0 --> 0.19.1rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-08 16:51:23 -05:00
Jack Robison 81de5fbbf4
verify_will_announce_head_and_sd_blobs 2018-03-08 16:46:39 -05:00
Jack Robison cdfb7f4cb4
fix blob_list error 2018-03-08 16:43:22 -05:00
Jack Robison 3f1bcbffeb
fix blob_announce when announcing a single blob 2018-03-07 18:25:30 -05:00
Jack Robison 2040748c62
add stratum client protocol 2018-03-06 14:30:19 -05:00
hackrush 14c01b095b Added tests for removing short args in cli 2018-03-06 03:50:12 +05:30
hackrush da4a24d79f Added scripts to autogenerate docs and api from docstring
Summary of changes
  Removed single dashed(short args) arguments(possibly breaking changes
for app side)
  Standardised the docstrings
  Added scripts to autogenerate API and CLI documentation using the
docstrings
2018-03-06 03:50:12 +05:30
Alex Grintsvayg 95e12a208d deprecate report_bug 2018-03-05 14:17:57 -05:00
Jack Robison 67a3001a0b
Bump version 0.19.0rc38 --> 0.19.0
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-02 23:01:23 -05:00
Jack Robison a12b011b1e
get file claim info by outpoint 2018-03-02 18:25:53 -05:00
Jack Robison 2c91d30655
Bump version 0.19.0rc37 --> 0.19.0rc38
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-03-02 17:36:56 -05:00
Jack Robison 7862ee6715
fix blob_announce command 2018-03-02 16:46:07 -05:00
Jack Robison 01c4c6ed97
fetch claim heights 2018-03-02 16:46:02 -05:00
Jack Robison 6a4b65a796
have get fail when given a channel uri before attempting to resolve 2018-03-02 15:34:34 -05:00
Jack Robison 35426c7350
remove some unused code 2018-03-02 15:34:34 -05:00
Jack Robison 1958327796
comments and logging 2018-03-02 15:34:34 -05:00
Jack Robison 76cb674ebb
fix updating content claims for existing files
-update lbry file attributes as soon as a change to the content claim occurs
2018-03-02 15:34:20 -05:00
Jack Robison d1240541c8
always update lbry file attributes after publishing 2018-03-02 15:33:48 -05:00
Jack Robison 91229aac6e
remove old stream on a publish update 2018-03-02 15:33:48 -05:00
Jack Robison 96d435cebd
don't import reactor, set in SqliteConnection 2018-03-02 15:15:42 -05:00
Jack Robison bceaaa5724
delay re-running query after database locked error 2018-03-02 15:15:41 -05:00
Jack Robison a1aadb0bce
fix join_dht attribute error 2018-03-02 15:13:22 -05:00
Alex Grintsvayg d086fb9547 only log errors to loggly 2018-03-01 16:31:00 -05:00
Alex Grintsvayg fa33110d04 stop spamming cryptonator errors. fixes #984 2018-02-27 14:06:45 -05:00
Jack Robison dafa80ce29
Merge branch 'master' into update_fix 2018-02-22 14:10:51 -05:00
Jack Robison 21900b2e7f
Bump version 0.19.0rc36 --> 0.19.0rc37
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-02-22 10:50:03 -05:00
Jack Robison 741e395677
fix blob_list falsely returning an empty list for streams with known blobs
-remove get_blobs functions from Daemon, use functions in SQLiteStorage instead
2018-02-22 10:37:53 -05:00
Jack Robison 9a046fca0f
remove unused calculate_available_blob_size function 2018-02-22 10:22:53 -05:00
Jack Robison 3b369103a0
Bump version 0.19.0rc35 --> 0.19.0rc36
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-02-21 19:19:15 -05:00
Jack Robison b1c66015e1
detect and remove invalid streams and sd blobs 2018-02-21 19:09:10 -05:00
Jack Robison 73eb66c0f2
pylint 2018-02-21 16:45:12 -05:00
Jack Robison 8b93fb5b13
update test
check sd info read from the blob and from the database
2018-02-21 16:41:15 -05:00
Jack Robison d7bfeae6b8
fix position of stream terminator blob 2018-02-21 16:37:00 -05:00
Jack Robison 3e6b00ad00
remove sort from get_stream_hash
error on zero length data blobs or a non-zero length stream terminator blob
2018-02-21 16:34:48 -05:00
Jack Robison 0904c74273
remove unused create_plain_sd function 2018-02-21 16:33:15 -05:00
hackrush 3754f34f53 Review fixes and additional comments in test 2018-02-21 14:22:11 +05:30
hackrush 2368433b22 Check for max usable balance before updating 2018-02-20 08:54:03 +05:30
hackrush d72ef784ed Removed daemon side bid checks during publish
Fixes #748

Fixed failing test, Yay!

Why CHANGELOG? Why not anarchy?
2018-02-20 08:54:03 +05:30
hackrush 5fee660c9c Fixed error types to be more appropriate 2018-02-17 20:18:55 +05:30
Jeremy Curcio 2621ba6982 Add exception for non-float bids when pubishing 2018-02-17 19:29:53 +05:30
Jack Robison 0edcf2dcc7
Bump version 0.19.0rc34 --> 0.19.0rc35
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-02-15 09:35:04 -05:00
Jack Robison 6ea5492ee5
dont delete old databases yet 2018-02-15 09:33:47 -05:00
Jack Robison 1a330fcb41
Bump version 0.19.0rc33 --> 0.19.0rc34
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-02-13 16:02:53 -05:00
Jack Robison a7567361dc
fix file name for files that already exist 2018-02-13 15:02:06 -05:00
Jack Robison e40d4f74d8
fix default db_revision 2018-02-13 14:42:53 -05:00
Jack Robison 73f09edcf0
fix setup and teardown for wallet tests
-also fixes a few wallet tests that weren't checking exceptions correctly
2018-02-13 14:22:52 -05:00
Jack Robison 9d87de1433
fix setup and teardown for blob manager tests 2018-02-13 14:22:40 -05:00
Jack Robison 3769287e88
fix setup and teardown for test_streamify 2018-02-13 14:22:21 -05:00
Jack Robison 68c906aff9
pylint 2018-02-13 10:27:52 -05:00
Jack Robison 9e11c075c6
cleaner foreign keys 2018-02-13 10:27:52 -05:00
Jack Robison b7d0191e5d
update functional tests 2018-02-13 10:27:52 -05:00
Jack Robison 49507b98f4
update unit tests, add test_SQLiteStorage 2018-02-13 10:27:51 -05:00
Jack Robison e9b9118c2a
whitespace 2018-02-13 10:27:51 -05:00
Jack Robison 9d539aaa16
migrate databases 2018-02-13 10:27:51 -05:00
Jack Robison c15850ccab
re-enable filtering lbry files by claim attributes 2018-02-13 10:27:51 -05:00
Jack Robison 0df383b9f2
update Downloader and Publisher 2018-02-13 10:27:51 -05:00
Jack Robison ce4b82d929
update Daemon to use SQLiteStorage 2018-02-13 10:27:51 -05:00
Jack Robison 9a8cac20e7
update reflector client and server to use SQLiteStorage 2018-02-13 10:27:51 -05:00
Jack Robison 68542f3ae1
refactor EncryptedFileDownloader and EncryptedFileManager
-remove stream info manager (DBEncryptedMetadataManager)
-split `add_lbry_file` into separate `add_published_file` and `add_downloaded_file` functions
-set the download path upon adding file to the db, use the source file path for publishes
-remove the lbry file manager-wide download directory, set for each file individually
-add claim `metadata`, `claim_name`, `claim_id`, `outpoint`, `txid`, `nout`, `channel_claim_id`, and `channel_name` attributes to EncryptedFileDownloader
2018-02-13 10:27:50 -05:00
Jack Robison f8c33b6acb
refactor lbrynet.core.StreamDescriptor
-remove lbrynet/lbry_file/StreamDescriptor.py
2018-02-13 10:27:50 -05:00
Jack Robison 0b1f4192fc
update Wallet to use SQLiteStorage
-remove CachedClaim and wallet storage classes
2018-02-13 10:27:50 -05:00
Jack Robison af87df3709
remove sqlite_helpers 2018-02-13 10:27:50 -05:00
Jack Robison e671005c3c
update BlobManager to use SQLiteStorage, remove old database functions
-remove blob upload/download history
2018-02-13 10:27:50 -05:00
Jack Robison db7061ce92
set up a SQLiteStorage object in Session 2018-02-13 10:27:50 -05:00
Jack Robison 2d462acefc
add SQLiteStorage 2018-02-13 10:27:50 -05:00
Jack Robison e77e41fb6d
move migrators to lbrynet.database, remove lbrynet.db_migrator 2018-02-13 10:27:49 -05:00
Alex Grin d6819d8091
Merge pull request #1086 from lbryio/add-conf-flag-to-cli
fixes for the --conf flag
2018-02-12 17:01:43 -05:00
Alex Grintsvayg bb2efdcc7c fixed the error when trying to perform get on channels
now it states that get cannot be used on channels

closes #623
closes #1085
2018-02-12 16:40:29 -05:00
Jack Robison bd6bd24478
Bump version 0.19.0rc32 --> 0.19.0rc33
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-02-12 13:24:19 -05:00
Antonio Quartulli 639744e047
conf: initialize IDs after reading config file
Installation_id and node_id are stored in the data dir.
For this reason they should be read/created only after the
config has been parsed.
This way they can be retrieved or stored at the right location.

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2018-02-10 16:22:33 +08:00
Antonio Quartulli 34976c7602
DaemonCLI: add --conf flag
When starting a daemon with a different configuration,
the same should also be used by the cli tool.

Add the --conf flag to the cli command to allow using a
custom config file.

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2018-02-10 16:22:32 +08:00
rick batka 69a99a61ba Fix issue #930. Disallow positional arguments for CLI settings_set and fix error reporting when settings_set fails. 2018-02-09 11:30:29 -05:00
Alex Grintsvayg b3d3c1c93b drop commands list from cli help 2018-02-08 09:36:59 -05:00
Alex Grintsvayg 2f8c645edc download script now gets all blobs in stream if you give it an sd hash 2018-02-07 11:21:34 -05:00
Jack Robison 1c45cf05d7
Merge branch 'atiaxi-blob-list-uri-fix' 2018-02-06 22:55:02 -05:00
Jack Robison 0f46785739
Merge branch 'blob-list-uri-fix' of https://github.com/atiaxi/lbry into atiaxi-blob-list-uri-fix 2018-02-06 22:51:06 -05:00
Roger Ostrander 44df26abd3 Removing unused import 2018-02-06 01:32:10 -05:00
Roger Ostrander d8e1738f27 Code review changes (removed safe_dict_descend) 2018-02-06 01:16:10 -05:00
Antonio Quartulli 8a7e707504
DHTPeerFinder: re-join the network if we have no peers
Periodically check if the routing table is empty and, if so,
re-attempt joining the DHT network.

This check is performed in the main DHTPeerFinder loop every 60 secs.

Closes: #1093
Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2018-02-06 12:33:12 +08:00
Antonio Quartulli 4f7885e499
dht_node: add hasContacts method
This method can be used by other components to check
if in the Node routing table there is at least one peer.

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2018-02-06 12:33:10 +08:00
Antonio Quartulli ce0af77aa9
dht_node: split network start and join procedures
In order to attempt to join the DHT several times
(i.e. when the first attempt has failed) we need to
split the components initialization from the real
joining operation.

Create node.startNetwork() to initialize the node
and keep the rest in node.joinNetwork()

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2018-02-06 12:19:33 +08:00
Jack Robison 1f68d29d73
Bump version 0.19.0rc31 --> 0.19.0rc32
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-02-05 21:25:33 -05:00
Roger Ostrander a4343c3eb3 API call to blob_list with uri parameter now succeeds 2018-02-03 23:08:15 -05:00
Jack Robison f918916160
remove gmpy and seccure dependencies 2018-02-01 12:39:00 -05:00
Jack Robison 1327757e35
Bump version 0.19.0rc30 --> 0.19.0rc31
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-01-31 19:52:24 -05:00
Jack Robison b8accbb049
Bump version 0.19.0rc29 --> 0.19.0rc30
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-01-29 10:29:54 -05:00
hackrush 5a3a592df8 Related changlelog for the PR lbryio/lbryum#203 2018-01-26 15:52:25 +05:30
Alex Grintsvayg 3b5978992c no more lbryapi 2018-01-23 16:53:29 -05:00
Jack Robison 798d2c6984
Bump version 0.19.0rc28 --> 0.19.0rc29
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-01-22 16:04:54 -05:00
Jack Robison 973978c1e5
pylint 2018-01-22 16:04:08 -05:00
Jack Robison 52aa1ba3a0
Bump version 0.19.0rc27 --> 0.19.0rc28
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-01-22 15:59:54 -05:00
Jack Robison eb4ba089ab
fix checking the external ip 2018-01-22 15:47:14 -05:00
Alex Grintsvayg a6588f740a stop sending useless analytics event 2018-01-22 15:21:39 -05:00
Jack Robison 9121b79f22
Bump version 0.19.0rc26 --> 0.19.0rc27
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-01-18 13:44:15 -05:00
Jack Robison edb0f8deed
changelog and doc 2018-01-18 13:41:17 -05:00
hackrush 7472d12644 Removed include_tip_info from transaction_list, goes with lbryum#183 2018-01-18 08:43:58 +05:30
Kay Kurokawa 1c608a09a9 use reworked lbryum payto command 2018-01-16 13:30:12 -05:00
Jack Robison c29456b130
Bump version 0.19.0rc25 --> 0.19.0rc26
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-01-12 09:56:19 -05:00
Jack Robison b6afc437e6
combine auto_re_reflect and reflect_uploads settings 2018-01-12 09:21:24 -05:00
Jack Robison 8a133f9749
use lists of hostname:port strings in conf file 2018-01-09 16:55:39 -05:00
Jack Robison 9302d71012
Bump version 0.19.0rc24 --> 0.19.0rc25
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-01-07 12:18:37 -05:00
akinwale 5677f6d00d
added a new startup stage for wallet_unlock (#1048)
* added a new startup stage to indicate if the daemon is waiting for wallet_unlock
2018-01-07 06:44:29 +01:00
Thomas Zarebczan 4b6d0d33ef
remove download_directory from options 2018-01-05 14:19:21 -05:00
Jack Robison e4364a60c2
Bump version 0.19.0rc23 --> 0.19.0rc24
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2018-01-04 21:39:36 -05:00
Jack Robison b046a6578b
add blockchain_name and lbryum_servers to the adjustable settings 2018-01-04 21:30:41 -05:00
Jack Robison 64e04f8a68
refactor start_lbry_file 2018-01-04 21:28:09 -05:00
Jack Robison 76de605b7f
refactor start_lbry_files 2018-01-04 21:25:56 -05:00
Jack Robison 2af61460a7
add attributes to lbry file base classes 2018-01-04 21:25:56 -05:00
Jack Robison bc58add6de
logging 2018-01-04 21:25:56 -05:00
Jack Robison ecb9909faa
fix node and installation id whitespace bugs 2018-01-04 21:25:55 -05:00
Jack Robison 62a8789393
change default full_status to True in _get_lbry_files 2018-01-04 21:25:55 -05:00
Jack Robison 2523afa266
catch error from blob with invalid AES key size 2018-01-04 21:25:55 -05:00
Jack Robison 6385ab27c1
fix handling stream with no data blobs
fixes https://github.com/lbryio/lbry/issues/905
2018-01-04 21:25:54 -05:00
Jack Robison 7a020bec05
Merge remote-tracking branch 'origin/add-conf-file-flag' 2018-01-03 14:46:57 -05:00
Antonio Quartulli 79054037a7
conf: make config file a CLI parameter
The config file might be stores in an alternate location for several
reasons (i.e. testing different configs or running multiple nodes on the
same host). Make the config file a CLI parameter so that it can be
specified when launching the lbrynet-daemon.

Related to #1039

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2017-12-30 04:11:06 +08:00
Jack Robison 3d94d9ad9e
Bump version 0.19.0rc22 --> 0.19.0rc23
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-29 12:53:27 -05:00
Jack Robison bf46f5616b
Merge branch 'add_lbry_file_manager_to_reflector_2' 2017-12-29 12:39:50 -05:00
Alex Grintsvayg b0c4746413 delete line that does nothing 2017-12-29 11:12:33 -05:00
Antonio Quartulli 0d3493ef73
conf: add method to check if a setting has default value
Sometimes it might be helpful to check if a given config
setting is still the default or if it was touched by the user
in any way (e.g. env, config file, ...).

Add is_default() method to Config object to perform such check.

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2017-12-29 19:49:59 +08:00
Alex Grintsvayg 21d9b9bc71 minor fixes 2017-12-28 10:08:30 -05:00
Jack Robison 09c57675a7
add stream_availability and blob_availability, deprecate get_availability 2017-12-20 21:23:54 -05:00
Jack Robison 7c6c666342
fix verbose error 2017-12-20 20:43:01 -05:00
Jack Robison f0a1adc9c5
whitespace, logging 2017-12-20 20:43:01 -05:00
Jack Robison 990e2a714a
Bump version 0.19.0rc21 --> 0.19.0rc22
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-18 16:20:56 -05:00
Jack Robison 225745f0e1
Bump version 0.19.0rc20 --> 0.19.0rc21
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-18 14:34:48 -05:00
Jack Robison e22d43bb03
fix wallet_unlock 2017-12-18 13:17:54 -05:00
Jack Robison 4dc6eb8fea
Bump version 0.19.0rc19 --> 0.19.0rc20
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-18 11:34:33 -05:00
Jack Robison 20b9e4d17e
fix typo 2017-12-18 11:31:59 -05:00
Jack Robison 8c2d381aee Wallet encryption (#783)
* update known commands
* add wallet_unlock, block wallet startup on being unlocked
* add wallet_decrypt and wallet_encrypt
* wallet encryption unit tests
* added use_keyring configuration option in order to make keyring password storage optional
2017-12-17 07:00:12 +01:00
Jack Robison bcdeea75d6
Bump version 0.19.0rc18 --> 0.19.0rc19
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-15 20:39:39 -05:00
Jack Robison a6f0c5fb4c
pylint fixes
fix exception formatting and a circular import
2017-12-15 20:25:20 -05:00
Jack Robison 7794109e57
Bump version 0.19.0rc17 --> 0.19.0rc18
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-13 16:45:59 -05:00
Jack Robison e58f3593ee
pylint 2017-12-13 16:43:49 -05:00
Jack Robison 5a41afc9fc
Bump version 0.19.0rc16 --> 0.19.0rc17
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-13 16:40:25 -05:00
Alex Grintsvayg ebed4f010b fixes #1029 - stupid error messages 2017-12-13 13:56:44 -05:00
Jack Robison 668eaa6591
Bump version 0.19.0rc15 --> 0.19.0rc16
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-12 09:32:31 -05:00
Jack Robison b2141bdf3d
fix import error 2017-12-12 09:26:28 -05:00
Jack Robison f29437f474
Bump version 0.19.0rc14 --> 0.19.0rc15
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-11 14:54:24 -05:00
Jack Robison 7e3abe0bda
Bump version 0.19.0rc13 --> 0.19.0rc14
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-11 12:49:50 -05:00
Jack Robison 1307727130
revert run commands using deferToThread
reverts most of
https://github.com/lbryio/lbry/commit/100493f9068589095c489f797587ddbfd1
7f7899
2017-12-11 12:45:38 -05:00
Jack Robison fbe55d5cd3
Bump version 0.19.0rc12 --> 0.19.0rc13
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-07 15:06:11 -05:00
Jack Robison 100493f906
run commands using the network as deferToThread, don't manually broadcast claims from lbrynet 2017-12-07 14:36:52 -05:00
Jack Robison b7ee5419d4
better address use, remove _save_wallet from Wallet.py 2017-12-07 14:36:51 -05:00
Jack Robison 66f0c0f296
Bump version 0.19.0rc11 --> 0.19.0rc12
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-07 14:36:02 -05:00
Jack Robison 330d0465b6
remove message field from lbry file json, add blobs_completed, blobs_in_stream, and status fields 2017-12-07 13:54:18 -05:00
Jack Robison fb65536f18
Bump version 0.19.0rc10 --> 0.19.0rc11
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-06 20:48:44 -05:00
Jack Robison fb6ceeed9e
delete unused code 2017-12-06 20:41:24 -05:00
Jack Robison 6a83f67dfa
Bump version 0.19.0rc9 --> 0.19.0rc10
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-06 20:22:39 -05:00
Jack Robison b7503f8b61
log traceback info for failed api requests 2017-12-06 19:52:29 -05:00
Jack Robison b2a0aa21c9
get search timeout from conf.settings 2017-12-06 19:52:29 -05:00
Jack Robison ac7ffdbf3a
add lbry_file_metadata table to save outpoint data of downloads 2017-12-06 19:52:25 -05:00
Jack Robison 90aa89dcae
re-add outpoint to file dictionary returned from file_ commands 2017-12-06 17:22:47 -05:00
Jack Robison 1594c6a831
move db functions in EncryptedFileManger to EncryptedFileMetadataManager
- remove TempEncryptedFileMetadataManager, run tests with the normal
DBEncryptedFileMetadataManager
2017-12-06 16:49:49 -05:00
Jack Robison f9dee51ca4
Bump version 0.19.0rc8 --> 0.19.0rc9
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-06 15:21:44 -05:00
Jack Robison 329d74f6be
don't include file names when logging stream related info 2017-12-06 15:09:35 -05:00
Jack Robison a92191709d
Bump version 0.19.0rc7 --> 0.19.0rc8
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-06 13:27:43 -05:00
Jack Robison 8fdd8d8c43
fix api error responses 2017-12-06 13:25:58 -05:00
Jack Robison ecdba8dc38
Bump version 0.19.0rc6 --> 0.19.0rc7
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-05 15:34:43 -05:00
Jack Robison 88c6eb7816
Merge branch 'increase_announce_duration' 2017-12-05 15:34:16 -05:00
Jack Robison 4c0692bd7a
Bump version 0.19.0rc5 --> 0.19.0rc6
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-05 14:03:10 -05:00
Jack Robison fbcc81adb4
add lbrynet-console 2017-12-05 13:34:46 -05:00
Kay Kurokawa 915ab668f5 add some tests to make sure file status after reflector server download (make sure in stopped state, and have correct number of blobs) 2017-12-05 13:18:31 -05:00
Kay Kurokawa 63c6d3580d do not yield on add_lbry_file() when obtaining sd blob as reflector server 2017-12-05 13:18:16 -05:00
Kay Kurokawa 989f77c00a increase SINGLE_HASH_ANNONCE_DURATION from 1 to 5 2017-12-05 11:55:59 -05:00
Jack Robison 5d95194469
Bump version 0.19.0rc4 --> 0.19.0rc5
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-05 09:49:21 -05:00
Kay Kurokawa 7e93ea8d97
do a sanity check to see if we have remote height, use remote height instead of local height when auto renewing 2017-12-05 09:41:45 -05:00
Kay Kurokawa bfbecd9196
fix use of return in inlinecallback, change to defer.returnValue(None) 2017-12-05 09:41:44 -05:00
Kay Kurokawa 707775214a
update docstrings and make sure return value is consistent 2017-12-05 09:41:44 -05:00
Kay Kurokawa bf29d28c4d
bug fix in claim_renew() 2017-12-05 09:41:43 -05:00
Kay Kurokawa 8f05c1083f
pylint long lines 2017-12-05 09:41:43 -05:00
Kay Kurokawa 36510a0a59
make auto_renew_claim_height_delta settable in API commands settings_set 2017-12-05 09:41:43 -05:00
Kay Kurokawa e4e60ebe9b
add auto_renew_claim_height_delta to configuration and auto renew after startup if necessary 2017-12-05 09:41:42 -05:00
Kay Kurokawa 1ea8c1ad29
no underscore necessary (not a private function) 2017-12-05 09:41:42 -05:00
Jack Robison d6e3b11026
add claim_renew 2017-12-05 09:41:42 -05:00
Jack Robison 0cf45657c0
Bump version 0.19.0rc3 --> 0.19.0rc4
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-12-05 09:34:03 -05:00
Jack Robison 58b789ed42
fix https://github.com/lbryio/lbry/issues/1013 2017-12-05 09:31:29 -05:00
Kay Kurokawa 95289952b5
No need to set up DummmyRateLimiter for reflector test 2017-12-04 13:08:34 -05:00
Kay Kurokawa 4971ddda78
No need to check for None in reflector test tear down 2017-12-04 13:08:34 -05:00
Kay Kurokawa ae74d80c8a
add lbry_file_manager to reflector server in functional reflector test, make sure file is added to lbry_file_manager when reflected 2017-12-04 13:08:34 -05:00
Kay Kurokawa ab667015c4
add lbry_file_manager to reflector server and add files to it 2017-12-04 13:08:33 -05:00
Kay Kurokawa 6218df2a92
make payment_rate_manager in add_lbry_file() an optional argument, initialize it from Session if not specified 2017-12-04 13:08:33 -05:00
Kay Kurokawa 57117baab5
remove ManagedEncryptedFileDownloader.load_file_attributes() move it to EncryptedFileDownloader.set_stream_info() 2017-12-04 13:08:32 -05:00