LBRYCommunity/lbry-sdk
1
0
Fork 1
Code Issues Pull requests Projects Releases 282 Packages Wiki Activity
3525 commits 110 branches 641 tags 31 MiB
Commit graph

2431 commits

Author SHA1 Message Date
Jack Robison
04e76443c6
move dht node component setup from Session into Node 2018-03-28 15:53:47 -04:00
Jack Robison
e6caedac91
remove DHTHashSupplier class, move former functions into DHTHashAnnouncer 2018-03-28 15:53:47 -04:00
Jack Robison
6666468640
add reactor arguments to Node 
-adds reactor (clock) and reactor functions listenUDP, callLater, and resolve as arguments to Node.__init__
-set the reactor clock on LoopingCalls to make them easily testable
-convert callLater manage loops to LoopingCalls
 2018-03-28 15:53:47 -04:00
Jack Robison
efaa97216f
move dht node setup back into node class 2018-03-28 15:53:47 -04:00
Jack Robison
e30ea50ef4
more 2018-03-28 15:53:47 -04:00
Jack Robison
3296c0fb3d
move dht related classes to lbrynet.dht 2018-03-28 15:53:47 -04:00
Jack Robison
54a152fa8e
fix merge conflict in dht tests 2018-03-28 15:53:46 -04:00
Kay Kurokawa
9088d152b5
better to keey track of retry count in function instead of unbounded dictionary 2018-03-28 15:53:46 -04:00
Kay Kurokawa
4cb461601e
result must be set here, otherwise it will not be defined when used later. Add test for it 2018-03-28 15:53:46 -04:00
Kay Kurokawa
0425c95b68
No need for clock now in test for DHTHashAnnouncer 2018-03-28 15:53:46 -04:00
Kay Kurokawa
75b977dff9
we just have one supplier not a list of suppliers 2018-03-28 15:53:46 -04:00
Kay Kurokawa
60c7261871
add single_hash_announce_duration as a field that gets return for API call status for dht status 2018-03-28 15:53:46 -04:00
Kay Kurokawa
0f3385e4dc
make the single hash announce duration adjustable in DHTHashSupplier 2018-03-28 15:53:46 -04:00
Jack Robison
ad6a2bef7f
handle error from old clients with a broken ping command 2018-03-28 15:53:45 -04:00
Jack Robison
446c3a88dc
refactor DHTHashAnnouncer and iterativeAnnounceHaveBlob 
-use looping call for running manage function rather than a scheduled
callLater

-track announce speed

-retry store requests that failed up to 3 times

-return a dict of {blob_hash: [storing_node_id]} results from
_announce_hashes

_refreshRoutingTable inline cb refactor

-add and use DeferredLockContextManager

-don't trap errback from iterativeFindNode in iterativeAnnounceHaveBlob
 2018-03-28 15:53:45 -04:00
Jack Robison
67ef8be7b7
convert node manage function to a looping call 2018-03-28 15:53:45 -04:00
Jack Robison
ecbe4113ce
move Distance to own file 2018-03-28 15:53:45 -04:00
Jack Robison
b75c8d96ce
Bump version 0.19.2rc3 --> 0.19.2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-28 15:35:46 -04:00
Jack Robison
cb83531d05
Bump version 0.19.2rc2 --> 0.19.2rc3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-28 15:15:47 -04:00
Jack Robison
dc65fd148e
Bump version 0.19.2rc1 --> 0.19.2rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-26 13:36:51 -04:00
Jack Robison
439a0f8778
fix docstrings 
-add docopt unit test
 2018-03-26 13:20:33 -04:00
hackrush
aa7b440989 Fixed regression in stream_availablity command 2018-03-26 19:43:06 +05:30
Jack Robison
f0742675b8
Merge branch 'master' into no-short-flags 2018-03-23 14:59:53 -04:00
Alex Grintsvayg
9ee5a3511d missed this in dht-compat merge 2018-03-23 12:50:18 -04:00
Jack Robison
69657750b8
Bump version 0.19.1 --> 0.19.2rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-22 17:04:12 -04:00
Jack Robison
cb069ca002
add blob_reflect 2018-03-22 16:54:29 -04:00
Jack Robison
3085e28490
don't try to resend failed blobs to reflector 
-fixes infinite loop where client keeps trying to send failing blobs, which may be failing because they are invalid

-return list of reflected blob hashes from BlobReflectorClient
 2018-03-22 16:53:16 -04:00
Jack Robison
679c2f403f
fix incorrectly raised DownloadCanceledError for already verified blobs 
-make InvalidDataError message clearer
-fix BlobReflectorClient result
 2018-03-22 13:23:12 -04:00
Jack Robison
de280b5ebf
Bump version 0.19.1rc7 --> 0.19.1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-20 10:15:50 -04:00
Jack Robison
113cc8bb15
Bump version 0.19.1rc6 --> 0.19.1rc7 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-19 14:31:17 -04:00
Jack Robison
b28bdbd752
rename existing reupload.reflect_stream --> reupload.reflect_file, add a reupload.reflect_stream function 2018-03-19 13:55:11 -04:00
Jack Robison
f94a9e8729
start lbry files in parallel 2018-03-19 13:46:27 -04:00
Jack Robison
43c73b9abf
fix slow sqlite query 2018-03-19 13:31:05 -04:00
hackrush
3724fa1810 Removed last flag decorator 2018-03-18 16:11:19 +05:30
hackrush
f7f6770120 Removed flags decorator as short flags are no longer used. 2018-03-18 16:11:19 +05:30
hackrush
1d9c996217
Merge pull request #1148 from lbryio/channel-bid 
Update channel balance checking to match claim balance checking
 2018-03-17 09:05:08 +05:30
hackrush
2b69d2fad0
Fix pylint error 2018-03-16 21:42:40 +05:30
Jack Robison
0313f857ba
don't try to delete the stream terminator from the blob table when deleting a stream 2018-03-15 17:44:54 -04:00
Jack Robison
8af96a0c51
don't try to announce the stream terminator 2018-03-15 17:42:21 -04:00
Jack Robison
adb1291c09
fix blob list key error 2018-03-15 09:55:40 -04:00
Thomas Zarebczan
b218e84d29
update channel balance checking to match claim 
Simple balance check before calling get_max_usable_balance_for_claim - matches what happens on the claim.

Also provide clearer error message about maximum amount
 2018-03-15 09:42:17 -04:00
Jack Robison
80fcb760b7
Bump version 0.19.1rc5 --> 0.19.1rc6 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-14 16:45:39 -04:00
Jack Robison
bc2f5901a7
Merge branch 'add-txlbryum' 2018-03-14 15:07:57 -04:00
Lex Berezhny
633b49da92 removed RequestCounter 2018-03-14 15:01:47 -04:00
Jack Robison
76b3d219c8
Bump version 0.19.1rc4 --> 0.19.1rc5 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-14 13:54:05 -04:00
Jack Robison
e94d10d3eb
only call get_max_usable_balance_for_claim in Wallet.py if the bid looks too high for the balance 2018-03-14 13:47:34 -04:00
Jack Robison
25eb64b346
Bump version 0.19.1rc3 --> 0.19.1rc4 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-13 17:34:08 -04:00
Jack Robison
9b44ba7c84
only call get_max_usable_balance when the bid might be too high 2018-03-13 17:32:29 -04:00
Jack Robison
69ecc6ce90
Bump version 0.19.1rc2 --> 0.19.1rc3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-13 11:44:27 -04:00
Jack Robison
cde78f8134
migrate configured download directory instead of assuming the default 2018-03-13 11:40:34 -04:00
Alex Grintsvayg
d0aa0a7d0c make dht forwards-compatible for upcoming switch to standardized bencode dict keys 2018-03-13 09:43:32 -04:00
Lex Berezhny
37bfed8aee
Merge pull request #1137 from lbryio/new-channel-fix 
Error cleanly when claiming a new channel with exact or higher amount than balance
 2018-03-12 16:17:18 -04:00
hackrush
16f2a5429b Name and output message fix. 2018-03-13 01:26:18 +05:30
Jack Robison
e881b608bf
Revert "don't block daemon startup on the file manager" 
This reverts commit f25b772
 2018-03-12 10:44:29 -04:00
Jack Robison
b41bb9beee
Bump version 0.19.1rc1 --> 0.19.1rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-09 14:14:02 -05:00
Jack Robison
f25b772b56
don't block daemon startup on the file manager 2018-03-09 14:09:07 -05:00
Jack Robison
f07e696c31
fix get_pending_blobs_for_stream 2018-03-09 14:07:26 -05:00
hackrush
f5aadf3918 Sanitized logged error for channel and name claims 2018-03-09 21:28:33 +05:30
hackrush
6d4af4ba90 Error cleanly when claiming a new channel with exact or higher amount than balance 
fixes #1107
 2018-03-09 21:28:33 +05:30
Jack Robison
96e30984c1
Bump version 0.19.0 --> 0.19.1rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-08 16:51:23 -05:00
Jack Robison
81de5fbbf4
verify_will_announce_head_and_sd_blobs 2018-03-08 16:46:39 -05:00
Jack Robison
cdfb7f4cb4
fix blob_list error 2018-03-08 16:43:22 -05:00
Jack Robison
3f1bcbffeb
fix blob_announce when announcing a single blob 2018-03-07 18:25:30 -05:00
Jack Robison
2040748c62
add stratum client protocol 2018-03-06 14:30:19 -05:00
hackrush
14c01b095b Added tests for removing short args in cli 2018-03-06 03:50:12 +05:30
hackrush
da4a24d79f Added scripts to autogenerate docs and api from docstring 
Summary of changes
  Removed single dashed(short args) arguments(possibly breaking changes
for app side)
  Standardised the docstrings
  Added scripts to autogenerate API and CLI documentation using the
docstrings
 2018-03-06 03:50:12 +05:30
Alex Grintsvayg
95e12a208d deprecate report_bug 2018-03-05 14:17:57 -05:00
Jack Robison
67a3001a0b
Bump version 0.19.0rc38 --> 0.19.0 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-02 23:01:23 -05:00
Jack Robison
a12b011b1e
get file claim info by outpoint 2018-03-02 18:25:53 -05:00
Jack Robison
2c91d30655
Bump version 0.19.0rc37 --> 0.19.0rc38 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-03-02 17:36:56 -05:00
Jack Robison
7862ee6715
fix blob_announce command 2018-03-02 16:46:07 -05:00
Jack Robison
01c4c6ed97
fetch claim heights 2018-03-02 16:46:02 -05:00
Jack Robison
6a4b65a796
have get fail when given a channel uri before attempting to resolve 2018-03-02 15:34:34 -05:00
Jack Robison
35426c7350
remove some unused code 2018-03-02 15:34:34 -05:00
Jack Robison
1958327796
comments and logging 2018-03-02 15:34:34 -05:00
Jack Robison
76cb674ebb
fix updating content claims for existing files 
-update lbry file attributes as soon as a change to the content claim occurs
 2018-03-02 15:34:20 -05:00
Jack Robison
d1240541c8
always update lbry file attributes after publishing 2018-03-02 15:33:48 -05:00
Jack Robison
91229aac6e
remove old stream on a publish update 2018-03-02 15:33:48 -05:00
Jack Robison
96d435cebd
don't import reactor, set in SqliteConnection 2018-03-02 15:15:42 -05:00
Jack Robison
bceaaa5724
delay re-running query after database locked error 2018-03-02 15:15:41 -05:00
Jack Robison
a1aadb0bce
fix join_dht attribute error 2018-03-02 15:13:22 -05:00
Alex Grintsvayg
d086fb9547 only log errors to loggly 2018-03-01 16:31:00 -05:00
Alex Grintsvayg
fa33110d04 stop spamming cryptonator errors. fixes #984 2018-02-27 14:06:45 -05:00
Jack Robison
dafa80ce29
Merge branch 'master' into update_fix 2018-02-22 14:10:51 -05:00
Jack Robison
21900b2e7f
Bump version 0.19.0rc36 --> 0.19.0rc37 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-02-22 10:50:03 -05:00
Jack Robison
741e395677
fix blob_list falsely returning an empty list for streams with known blobs 
-remove get_blobs functions from Daemon, use functions in SQLiteStorage instead
 2018-02-22 10:37:53 -05:00
Jack Robison
9a046fca0f
remove unused calculate_available_blob_size function 2018-02-22 10:22:53 -05:00
Jack Robison
3b369103a0
Bump version 0.19.0rc35 --> 0.19.0rc36 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-02-21 19:19:15 -05:00
Jack Robison
b1c66015e1
detect and remove invalid streams and sd blobs 2018-02-21 19:09:10 -05:00
Jack Robison
73eb66c0f2
pylint 2018-02-21 16:45:12 -05:00
Jack Robison
8b93fb5b13
update test 
check sd info read from the blob and from the database
 2018-02-21 16:41:15 -05:00
Jack Robison
d7bfeae6b8
fix position of stream terminator blob 2018-02-21 16:37:00 -05:00
Jack Robison
3e6b00ad00
remove sort from get_stream_hash 
error on zero length data blobs or a non-zero length stream terminator blob
 2018-02-21 16:34:48 -05:00
Jack Robison
0904c74273
remove unused create_plain_sd function 2018-02-21 16:33:15 -05:00
hackrush
3754f34f53 Review fixes and additional comments in test 2018-02-21 14:22:11 +05:30
hackrush
2368433b22 Check for max usable balance before updating 2018-02-20 08:54:03 +05:30
hackrush
d72ef784ed Removed daemon side bid checks during publish 
Fixes #748

Fixed failing test, Yay!

Why CHANGELOG? Why not anarchy?
 2018-02-20 08:54:03 +05:30
hackrush
5fee660c9c Fixed error types to be more appropriate 2018-02-17 20:18:55 +05:30
Jeremy Curcio
2621ba6982 Add exception for non-float bids when pubishing 2018-02-17 19:29:53 +05:30
Jack Robison
0edcf2dcc7
Bump version 0.19.0rc34 --> 0.19.0rc35 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-02-15 09:35:04 -05:00
Jack Robison
6ea5492ee5
dont delete old databases yet 2018-02-15 09:33:47 -05:00
Jack Robison
1a330fcb41
Bump version 0.19.0rc33 --> 0.19.0rc34 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-02-13 16:02:53 -05:00
Jack Robison
a7567361dc
fix file name for files that already exist 2018-02-13 15:02:06 -05:00
Jack Robison
e40d4f74d8
fix default db_revision 2018-02-13 14:42:53 -05:00
Jack Robison
73f09edcf0
fix setup and teardown for wallet tests 
-also fixes a few wallet tests that weren't checking exceptions correctly
 2018-02-13 14:22:52 -05:00
Jack Robison
9d87de1433
fix setup and teardown for blob manager tests 2018-02-13 14:22:40 -05:00
Jack Robison
3769287e88
fix setup and teardown for test_streamify 2018-02-13 14:22:21 -05:00
Jack Robison
68c906aff9
pylint 2018-02-13 10:27:52 -05:00
Jack Robison
9e11c075c6
cleaner foreign keys 2018-02-13 10:27:52 -05:00
Jack Robison
b7d0191e5d
update functional tests 2018-02-13 10:27:52 -05:00
Jack Robison
49507b98f4
update unit tests, add test_SQLiteStorage 2018-02-13 10:27:51 -05:00
Jack Robison
e9b9118c2a
whitespace 2018-02-13 10:27:51 -05:00
Jack Robison
9d539aaa16
migrate databases 2018-02-13 10:27:51 -05:00
Jack Robison
c15850ccab
re-enable filtering lbry files by claim attributes 2018-02-13 10:27:51 -05:00
Jack Robison
0df383b9f2
update Downloader and Publisher 2018-02-13 10:27:51 -05:00
Jack Robison
ce4b82d929
update Daemon to use SQLiteStorage 2018-02-13 10:27:51 -05:00
Jack Robison
9a8cac20e7
update reflector client and server to use SQLiteStorage 2018-02-13 10:27:51 -05:00
Jack Robison
68542f3ae1
refactor EncryptedFileDownloader and EncryptedFileManager 
-remove stream info manager (DBEncryptedMetadataManager)
-split `add_lbry_file` into separate `add_published_file` and `add_downloaded_file` functions
-set the download path upon adding file to the db, use the source file path for publishes
-remove the lbry file manager-wide download directory, set for each file individually
-add claim `metadata`, `claim_name`, `claim_id`, `outpoint`, `txid`, `nout`, `channel_claim_id`, and `channel_name` attributes to EncryptedFileDownloader
 2018-02-13 10:27:50 -05:00
Jack Robison
f8c33b6acb
refactor lbrynet.core.StreamDescriptor 
-remove lbrynet/lbry_file/StreamDescriptor.py
 2018-02-13 10:27:50 -05:00
Jack Robison
0b1f4192fc
update Wallet to use SQLiteStorage 
-remove CachedClaim and wallet storage classes
 2018-02-13 10:27:50 -05:00
Jack Robison
af87df3709
remove sqlite_helpers 2018-02-13 10:27:50 -05:00
Jack Robison
e671005c3c
update BlobManager to use SQLiteStorage, remove old database functions 
-remove blob upload/download history
 2018-02-13 10:27:50 -05:00
Jack Robison
db7061ce92
set up a SQLiteStorage object in Session 2018-02-13 10:27:50 -05:00
Jack Robison
2d462acefc
add SQLiteStorage 2018-02-13 10:27:50 -05:00
Jack Robison
e77e41fb6d
move migrators to lbrynet.database, remove lbrynet.db_migrator 2018-02-13 10:27:49 -05:00
Alex Grin
d6819d8091
Merge pull request #1086 from lbryio/add-conf-flag-to-cli 
fixes for the --conf flag
 2018-02-12 17:01:43 -05:00
Alex Grintsvayg
bb2efdcc7c fixed the error when trying to perform get on channels 
now it states that get cannot be used on channels

closes #623
closes #1085
 2018-02-12 16:40:29 -05:00
Jack Robison
bd6bd24478
Bump version 0.19.0rc32 --> 0.19.0rc33 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-02-12 13:24:19 -05:00
Antonio Quartulli
639744e047
conf: initialize IDs after reading config file 
Installation_id and node_id are stored in the data dir.
For this reason they should be read/created only after the
config has been parsed.
This way they can be retrieved or stored at the right location.

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
 2018-02-10 16:22:33 +08:00
Antonio Quartulli
34976c7602
DaemonCLI: add --conf flag 
When starting a daemon with a different configuration,
the same should also be used by the cli tool.

Add the --conf flag to the cli command to allow using a
custom config file.

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
 2018-02-10 16:22:32 +08:00
rick batka
69a99a61ba Fix issue #930. Disallow positional arguments for CLI settings_set and fix error reporting when settings_set fails. 2018-02-09 11:30:29 -05:00
Alex Grintsvayg
b3d3c1c93b drop commands list from cli help 2018-02-08 09:36:59 -05:00
Alex Grintsvayg
2f8c645edc download script now gets all blobs in stream if you give it an sd hash 2018-02-07 11:21:34 -05:00
Jack Robison
1c45cf05d7
Merge branch 'atiaxi-blob-list-uri-fix' 2018-02-06 22:55:02 -05:00
Jack Robison
0f46785739
Merge branch 'blob-list-uri-fix' of https://github.com/atiaxi/lbry into atiaxi-blob-list-uri-fix 2018-02-06 22:51:06 -05:00
Roger Ostrander
44df26abd3 Removing unused import 2018-02-06 01:32:10 -05:00
Roger Ostrander
d8e1738f27 Code review changes (removed safe_dict_descend) 2018-02-06 01:16:10 -05:00
Antonio Quartulli
8a7e707504
DHTPeerFinder: re-join the network if we have no peers 
Periodically check if the routing table is empty and, if so,
re-attempt joining the DHT network.

This check is performed in the main DHTPeerFinder loop every 60 secs.

Closes: #1093
Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
 2018-02-06 12:33:12 +08:00
Antonio Quartulli
4f7885e499
dht_node: add hasContacts method 
This method can be used by other components to check
if in the Node routing table there is at least one peer.

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
 2018-02-06 12:33:10 +08:00
Antonio Quartulli
ce0af77aa9
dht_node: split network start and join procedures 
In order to attempt to join the DHT several times
(i.e. when the first attempt has failed) we need to
split the components initialization from the real
joining operation.

Create node.startNetwork() to initialize the node
and keep the rest in node.joinNetwork()

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
 2018-02-06 12:19:33 +08:00
Jack Robison
1f68d29d73
Bump version 0.19.0rc31 --> 0.19.0rc32 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-02-05 21:25:33 -05:00
Roger Ostrander
a4343c3eb3 API call to blob_list with uri parameter now succeeds 2018-02-03 23:08:15 -05:00
Jack Robison
f918916160
remove gmpy and seccure dependencies 2018-02-01 12:39:00 -05:00
Jack Robison
1327757e35
Bump version 0.19.0rc30 --> 0.19.0rc31 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-01-31 19:52:24 -05:00
Jack Robison
b8accbb049
Bump version 0.19.0rc29 --> 0.19.0rc30 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-01-29 10:29:54 -05:00
hackrush
5a3a592df8 Related changlelog for the PR lbryio/lbryum#203 2018-01-26 15:52:25 +05:30
Alex Grintsvayg
3b5978992c no more lbryapi 2018-01-23 16:53:29 -05:00
Jack Robison
798d2c6984
Bump version 0.19.0rc28 --> 0.19.0rc29 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-01-22 16:04:54 -05:00
Jack Robison
973978c1e5
pylint 2018-01-22 16:04:08 -05:00
Jack Robison
52aa1ba3a0
Bump version 0.19.0rc27 --> 0.19.0rc28 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2018-01-22 15:59:54 -05:00