Madiator2011/lbry-sdk
1
0
Fork 0
forked from LBRYCommunity/lbry-sdk
Code Pull requests Activity
6140 commits 111 branches 641 tags 30 MiB
Commit graph

3992 commits

Author SHA1 Message Date
Jack Robison
324cbdcdb2
only save the content claim if stream_hash isn't None 
-stream_hash being none means we don't have the file in the database
 2019-05-10 11:50:20 -04:00
Lex Berezhny
6c0c0ee322 added logging to publish command 2019-05-10 11:43:34 -04:00
Jack Robison
54b9ed6cb2
fix store content fee 2019-05-09 18:14:54 -04:00
Lex Berezhny
558a02d187 correctly format lat/long and fee amounts in JSON RPC response 2019-05-09 16:19:49 -04:00
Jack Robison
3567b331c0 v0.37.0rc6 2019-05-09 11:52:34 -04:00
Thomas Zarebczan
db1d547b19
adjust the default max_connections_per_download and peer_connect_timeout 2019-05-09 10:38:32 -04:00
Victor Shyba
ec07037e88 set shutdown_timeout on TCPSite 2019-05-09 01:01:07 -03:00
Lex Berezhny
d98162a118 stream_update --replace also clears the channel 2019-05-09 00:00:39 -04:00
Victor Shyba
efbf2f49a9 fix generator junction 2019-05-08 23:02:38 -03:00
Victor Shyba
2e09d2adfa close search on transport close 2019-05-08 23:02:38 -03:00
Jack Robison
e2c123456b
write decrypted blob data from run_in_executor 2019-05-08 16:07:32 -04:00
Jack Robison
c9be79f062
prevent re-migrating 10 to 11 2019-05-08 15:13:07 -04:00
Jack Robison
a2a1ef34ab
fix tests 2019-05-08 14:55:09 -04:00
Jack Robison
761a2b235c
set written_bytes, download_path, file_name, and download_directory to None if the file doesn't exist 2019-05-08 14:11:44 -04:00
Jack Robison
3ca2fee592
use stream size from claim if available 2019-05-08 14:11:39 -04:00
Jack Robison
a480b2d25f
fix race when closing blob client protocol after getting a response 2019-05-08 12:21:11 -04:00
Jack Robison
d7032b12d7
add saved_file and content_fee columns to file table 
-drop not null constraints for file_name and download_directory

-add migrator
 2019-05-08 10:26:06 -04:00
Victor Shyba
007dd43861 re-raise cancelled errors 2019-05-07 11:10:49 -03:00
Victor Shyba
1bc4e4b702 typo on logging, announcements logging is info, not warning 2019-05-07 11:10:49 -03:00
Victor Shyba
b91f27219d use fetchall as there is an update while iterating 2019-05-07 11:10:49 -03:00
Victor Shyba
dc4560cc9a refactor announcer 2019-05-07 11:10:49 -03:00
Victor Shyba
c6a3c05a0c add missing migrator line 2019-05-07 11:10:49 -03:00
Jack Robison
32dc1297ec
fix infinite loop 2019-05-06 18:46:26 -04:00
Jack Robison
bef244ba77
dont make duplicate files 2019-05-06 18:46:26 -04:00
Jack Robison
3c231d6215
handle get with file_name/download_directory/save_file arg for a stream that is already running 2019-05-06 18:46:26 -04:00
Jack Robison
a212cf6ba4
set content_fee attribute 2019-05-06 18:46:26 -04:00
Jack Robison
bc060f1378
pay fee after downloading the sd blob/adding to the db 2019-05-06 18:46:26 -04:00
Jack Robison
22c701fd50
fix completed field for an item in file list 2019-05-06 18:46:26 -04:00
Jack Robison
4f0e8fce6e
add optional download_directory argument to get 2019-05-06 18:46:26 -04:00
Jack Robison
f642cfe9dd
fix resuming save tasks on startup 2019-05-06 18:46:26 -04:00
Jack Robison
24e073680b
add connection id workaround 2019-05-06 18:46:26 -04:00
Jack Robison
b2f63a1545
fix tests 2019-05-06 18:46:26 -04:00
Jack Robison
f506b3e6d4
tests 2019-05-06 18:46:26 -04:00
Jack Robison
f7412514b3
fix partial content 0 padding 2019-05-06 18:46:26 -04:00
Jack Robison
bd6a609b30
fix logging 2019-05-06 18:46:26 -04:00
Jack Robison
4e32b69d1d
don't set running streams as stopped on startup 2019-05-06 18:46:26 -04:00
Jack Robison
1116c7f29e
logging 2019-05-06 18:46:26 -04:00
Jack Robison
d80c671cf2
look victor 2019-05-06 18:46:26 -04:00
Jack Robison
14b12cbea2
block /stream and /get requests on the stream manager starting 2019-05-06 18:46:26 -04:00
Jack Robison
1f7feafb67
force close open streaming requests and api calls on shutdown 2019-05-06 18:46:26 -04:00
Jack Robison
cbe689ea7f
logging 2019-05-06 18:46:26 -04:00
Jack Robison
9099ee2e8e
fix/refactor starting and stopping files 
-move partial content handling into ManagedStream
-add delayed stop test
 2019-05-06 18:46:26 -04:00
Jack Robison
b134e0c9c9
fix blob_get 2019-05-06 18:46:26 -04:00
Jack Robison
f8c0e80cfc
add __slots__ to BlobInfo, StreamDescriptor, and KademliaPeer 2019-05-06 18:46:26 -04:00
Jack Robison
1f266ebdad
add logging for streams we already have 2019-05-06 18:46:26 -04:00
Jack Robison
b09e1f8825
fix written_bytes never being 0 2019-05-06 18:46:26 -04:00
Victor Shyba
cacc65d45e fix edge case from test for single blob stream 2019-05-06 18:18:12 -03:00
Victor Shyba
43111f0497 bump db revision 2019-05-06 17:19:40 -03:00
Victor Shyba
6c142b4477 add migrator for previous bugs 2019-05-06 17:12:04 -03:00
Victor Shyba
e8683a24bd fix should_announce being set on stream creation 2019-05-06 16:49:52 -03:00
Baltazar Gomez
a030e13548 fix incorrect media-type of .cbr archives 2019-05-05 20:57:36 -04:00
Victor Shyba
f5bd28bfdb make save_file a parameter instead of a flag so it obeys conf 2019-05-05 19:46:42 -03:00
Lex Berezhny
6cbbe23c7c account_list defaults to 0 confirmations for balance 2019-05-04 18:08:33 -04:00
Lex Berezhny
d7c2e4e9b3 fixed bug where lbrynet failed to start with single-key accounts in the wallet 2019-05-04 17:56:39 -04:00
Victor Shyba
cf7bb6a391 fix tests and stream being deleted on data timeout 2019-05-02 16:41:48 -03:00
Victor Shyba
68d7328918 always close the write handle 2019-05-02 12:20:49 -03:00
Victor Shyba
ff2985cc80 close protocol if transport reuse brings responses before requests 2019-05-02 12:13:33 -03:00
Victor Shyba
ac69fcbc5f fix possible division by zero 2019-05-02 11:52:09 -03:00
Victor Shyba
609cf42868 cleanup downloader code 2019-05-01 18:04:45 -03:00
Victor Shyba
e43b29fcd1 if the current writer is closed, its fine to open a new one 2019-05-01 15:09:11 -03:00
Victor Shyba
ae2121c5c4 fix tests and new test 2019-05-01 13:16:45 -03:00
Victor Shyba
60f7766cf7 small adjustment to new_peer_or_finished 2019-05-01 02:55:51 -03:00
Victor Shyba
63bd983012 pylint 2019-05-01 00:42:51 -03:00
Victor Shyba
7ffce1040c fix foreign key error 2019-04-30 19:51:19 -03:00
Victor Shyba
ac6835fa60 dont get stuck 2019-04-30 19:51:02 -03:00
Victor Shyba
3cf5c536c0 improve ban timing and downloader loop friction 2019-04-30 17:56:29 -03:00
Lex Berezhny
85cc1a4763 v0.37.0rc5 2019-04-29 17:22:47 -04:00
Lex Berezhny
aeaa7ba986 switched from sha256 for unencrypted file hash to sha384 2019-04-29 16:01:59 -04:00
Lex Berezhny
a36936b5ff v0.37.0rc4 2019-04-29 00:27:53 -04:00
Victor Shyba
7cf245a0e9 encode timestamp and confirmations into file list 2019-04-29 00:26:14 -04:00
Victor Shyba
30b113d64a depth -> confirmations 2019-04-29 00:26:14 -04:00
Victor Shyba
ccd2023d37 add timestamp field to resolve 2019-04-29 00:26:14 -04:00
Victor Shyba
6e483cba8d tests: add confirm parameters, like the other calls 2019-04-28 22:53:43 -04:00
Victor Shyba
46c03c0cb2 refactor: move generate to blockchain call 2019-04-28 22:53:43 -04:00
Victor Shyba
b350e74aca fix stream update callback to update the main dict 2019-04-28 22:53:43 -04:00
Victor Shyba
de9473f75a test resolve updates file list 2019-04-28 22:53:43 -04:00
Lex Berezhny
bfc107fdb3 removed blockchain.block.get_block from wallet server API 2019-04-27 18:03:35 -04:00
Lex Berezhny
6a2efa54ab dropped block_show command from API, users should run a full node if they need access to blocks 2019-04-27 18:03:35 -04:00
Lex Berezhny
72f0e1ca14 added timestamp field to transaction output results from JSON RPC calls 2019-04-27 17:10:49 -04:00
Lex Berezhny
706a8e52dc v0.37.0rc3 2019-04-27 13:12:27 -04:00
Lex Berezhny
f3c8776878 fixed --preview mode on stream_create/update 2019-04-27 13:11:32 -04:00
Lex Berezhny
539ea04039 fixed signing streams using --channel_name argument 2019-04-27 11:52:29 -04:00
Lex Berezhny
8f96b07559 updating stream claim with new file now correctly updates file list removing old file 2019-04-27 10:55:20 -04:00
Lex Berezhny
da637b9c0e added --replace option to stream_update and channel_update, publish defaults to --replace 2019-04-26 23:37:10 -04:00
Lex Berezhny
3618de1227 added --clear_fee ability to stream update command 2019-04-26 17:52:29 -04:00
Victor Shyba
3cb8a63bf9 add channel_name parameter on claim search 2019-04-26 17:30:21 -04:00
Lex Berezhny
3d1efbc9bb v0.37.0rc2 2019-04-25 20:40:07 -04:00
Victor Shyba
7bdef3146b fix ttfb 2019-04-25 20:38:33 -04:00
Lex Berezhny
db08882f20 v0.37.0rc1 2019-04-24 21:35:59 -04:00
Jack Robison
056a629e87
remove unused property 2019-04-24 13:39:06 -04:00
Jack Robison
1ffb99f9f9
rename streaming_only setting -> save_files 2019-04-24 12:44:12 -04:00
Jack Robison
67088b2ca2
test_blob_writers_concurrency 2019-04-24 09:48:04 -04:00
Jack Robison
dab49e812f
set writer result or error before calling close_handle 2019-04-24 09:48:04 -04:00
Jack Robison
0f3f38d8a3
pylint 2019-04-24 09:48:04 -04:00
Jack Robison
7ba433c2e5
fix setting blob verified event and canceling blob writers 
-raise OSError if multiple writers for one peer are opened for a blob
 2019-04-24 09:48:04 -04:00
Jack Robison
832537a5cf
set deleted downloads as streaming mode on startup 2019-04-24 09:48:04 -04:00
Jack Robison
3234d70270
add peer address/port to hash blob writer 2019-04-24 09:48:04 -04:00
Jack Robison
432fe444f8
fix cache_concurrent decorator 2019-04-24 09:48:04 -04:00
Victor Shyba
9ba6653475
raise proper error when sd is not available 2019-04-24 09:48:04 -04:00
Jack Robison
8107e97304
remove debugging /streams endpoint 2019-04-24 09:48:04 -04:00
Jack Robison
e2663f6d57
remove unnecessary except/raise 2019-04-24 09:48:04 -04:00
Jack Robison
3a997277aa
reduce the amount of Blob objects created 2019-04-24 09:48:04 -04:00
Jack Robison
a7d94f4514
add file_save 2019-04-24 09:48:04 -04:00
Jack Robison
a0e3338177
only re-reflect streams if the sd blob is readable 2019-04-24 09:48:04 -04:00
Jack Robison
d5a353066c
missing await 2019-04-24 09:48:04 -04:00
Jack Robison
bc29fc4465
type 2019-04-24 09:48:04 -04:00
Jack Robison
987f175fcc
logging 2019-04-24 09:48:04 -04:00
Jack Robison
01a81fceed
more streaming_only + save_blobs integration testing 2019-04-24 09:48:04 -04:00
Jack Robison
a1abb7c8fb
test range requests 2019-04-24 09:48:04 -04:00
Jack Robison
46b166952b
non async blob_completed callback, tests 2019-04-24 09:48:04 -04:00
Jack Robison
1375153fda
fix publish updates not being saved to the db, don't query the db for the stream hash 2019-04-24 09:48:04 -04:00
Jack Robison
1a14157d37
fix unawaited task 2019-04-24 09:48:04 -04:00
Jack Robison
4d0e9e0428
relative http redirect from /get -> /stream 2019-04-24 09:48:04 -04:00
Jack Robison
3a53ef5690
catch TransportNotConnected 2019-04-24 09:48:04 -04:00
Jack Robison
33a68b5cef
handle dht is_closing 2019-04-24 09:48:04 -04:00
Jack Robison
63bf084a6a
cancel dht response future 2019-04-24 09:48:04 -04:00
Jack Robison
a882f2e8c5
merge conflicts 2019-04-24 09:48:04 -04:00
Jack Robison
119e0ec408
cancelled error 2019-04-24 09:48:04 -04:00
Jack Robison
7d782d516a
track and close blob readers 2019-04-24 09:48:04 -04:00
Jack Robison
d3eac48035
tests, add __slots__ to AbstractBlob 2019-04-24 09:48:04 -04:00
Jack Robison
60c9ae64b4
endpoint to call get and redirect to the partial content stream 2019-04-24 09:48:04 -04:00
Jack Robison
2d314dce60
add save_file argument to get 2019-04-24 09:48:04 -04:00
Jack Robison
287b89db66
fix tests 2019-04-24 09:48:04 -04:00
Jack Robison
7a160f7335
fix tests 2019-04-24 09:48:04 -04:00
Jack Robison
04ddee7d89
blob tests 2019-04-24 09:48:04 -04:00
Jack Robison
3a916a8e8e
tests 2019-04-24 09:48:04 -04:00
Jack Robison
f125468ebf
fix claim not being saved to the db 2019-04-24 09:48:04 -04:00
Jack Robison
f0e17cff9a
support streaming downloads / range requests 2019-04-24 09:48:04 -04:00
Jack Robison
93267efe0b
remove StreamAssembler, refactor ManagedStream and StreamDownloader (WIP) 2019-04-24 09:48:04 -04:00
Jack Robison
c663e5a3cf
add cache_concurrent decorator 2019-04-24 09:48:04 -04:00
Jack Robison
676f0015aa
refactor BlobFile into AbstractBlob, BlobFile, and BlobBuffer classes 2019-04-24 09:48:04 -04:00
Jack Robison
d44a79ada2
cache resolve_host, add async_timed_cache decorator 2019-04-24 09:48:04 -04:00
Jack Robison
d7ed8ffaa6
add streaming_only and save_blobs settings 2019-04-24 09:48:04 -04:00
Jack Robison
b230d8fbcb
rename BlobFileManager -> BlobManager 2019-04-24 09:48:04 -04:00
Lex Berezhny
58987857cf v0.36.0 2019-04-22 18:47:58 -04:00
Lex Berezhny
fa8858325c add lbry:// to permanent_url response field 2019-04-22 18:41:11 -04:00
Lex Berezhny
3357a419ab ability to overide the file name, hash and size when updating a stream claim 2019-04-22 18:05:49 -04:00
Lex Berezhny
e8991e6d52 improve account locking/unlocing CLI docs 2019-04-22 14:06:42 -04:00
Lex Berezhny
13bd81c2b6 v0.36.0rc4 2019-04-21 23:11:23 -04:00
Victor Shyba
21241b98a4 workaround for having new encoder fields on resolve so app can use them 2019-04-21 22:51:48 -04:00
Lex Berezhny
886ed6415a added examples which include all metadata passed to create stream and create channel 2019-04-21 21:34:13 -04:00
Lex Berezhny
97db241109 v0.36.0rc3 2019-04-21 20:20:53 -04:00
Lex Berezhny
216379918b renamed txo sub_type to value_type in txo json encoder output 2019-04-21 17:40:40 -04:00
Lex Berezhny
19f300cc45 added protobuf to get and file_list commands 2019-04-21 14:28:43 -04:00
Lex Berezhny
7824de655e updated stream manager to pull protobuf instead of hex from resolve response 2019-04-21 14:28:43 -04:00
Lex Berezhny
6ef1b1dd59 resolve command also returns protobuf 2019-04-21 14:28:43 -04:00
Lex Berezhny
9fae8f5153 added --include_protobuf to add hexlified protobuf to RPC responses 2019-04-21 14:28:43 -04:00
Lex Berezhny
f660691e78 v0.36.0rc2 2019-04-21 00:50:27 -04:00
Lex Berezhny
bf60683ba6 update to protobuf change where ClaimList defaults to collection list type 2019-04-21 00:45:51 -04:00
Lex Berezhny
71f5061848 exposed new protobuf fields in APIs and updated tests 2019-04-21 00:45:51 -04:00
Lex Berezhny
61cadb5cbe v0.36.0rc1 2019-04-20 02:34:27 -04:00
Lex Berezhny
2034104cfc test fixes 2019-04-20 02:33:41 -04:00
Lex Berezhny
8bf2e41c95 --contact_email -> --email and --homepage_url -> --website_url 2019-04-20 02:33:41 -04:00
Lex Berezhny
fa9a4a75c6 update to an even newer protobufs 2019-04-20 02:33:41 -04:00
Lex Berezhny
90bef98bc3 use TXORef.hash instead of TXORef.id when signing claim with channel 2019-04-20 02:33:41 -04:00
Lex Berezhny
35c43647aa use TXORef.hash instead of TXORef.id when signing claim with channel 2019-04-20 02:33:41 -04:00
Lex Berezhny
449a583286 default to claimType == 1 when it is missing for old claim protobufs 2019-04-20 02:33:41 -04:00
Lex Berezhny
b1f813782a regenerated protobuf python code 2019-04-20 02:33:41 -04:00
Lex Berezhny
60080cbd19 updating to new protobufs 2019-04-20 02:33:41 -04:00
Victor Shyba
665dba62c7 simplify save from resolve, deduplicate items 2019-04-20 01:19:40 -04:00
Victor Shyba
76dea9e89b batch save supports 2019-04-20 01:19:40 -04:00
Victor Shyba
ebc9ed01c5 make lru_cache a power of two, following py docs 2019-04-20 01:19:40 -04:00
Victor Shyba
55116763e9 cache transactions 2019-04-20 01:19:40 -04:00
Victor Shyba
e1a6b4e3d6 fix dict handling mistake 2019-04-20 01:19:40 -04:00
Victor Shyba
911ca8c37e cache and share txs fetches while validating concurrently on batches 2019-04-20 01:19:40 -04:00
ポール ウェッブ
a63442f843 Fixes and updated gitignore 2019-04-12 11:53:37 -04:00
Oleg Silkin
b6a4589da5 Adds comment group to lbrynet with commands list and create 2019-04-07 15:27:59 -04:00
Oleg Silkin
fbbb0a9931 Adds server URL to configuration settings 2019-04-07 15:27:59 -04:00
Oleg Silkin
a94d65d522 Adds utility functions for making batch jsonrpc requests to comment server 2019-04-07 15:27:59 -04:00
Lex Berezhny
9af625e627 test fixes 2019-04-06 17:08:15 -04:00
Lex Berezhny
93220c3874 daemon json rpc return type docs 2019-04-06 17:08:15 -04:00
Lex Berezhny
362ed3f1c8 remove unused import 2019-04-06 17:08:15 -04:00
Lex Berezhny
6f76d9e24a moved integration testcase.py into lbrynet so that it can be used from scripts 2019-04-06 17:08:15 -04:00
Victor Shyba
fd56dc68cd fix depth on resolve, add tests 2019-04-05 09:40:26 -04:00
Victor Shyba
a0a810edc3 make permanent url name#claim_id on torba too 2019-04-05 09:40:26 -04:00
Victor Shyba
c1d3b5984d fix old hash reverse confusion 2019-04-05 09:40:26 -04:00
Victor Shyba
1fb719dd61 fix valid_at_height not being shown for name resolutions, which fixes tests 2019-04-05 09:40:26 -04:00
Victor Shyba
b87316fb02 make permanent url name#id only for now 2019-04-05 09:40:26 -04:00
Victor Shyba
65f3d78084 fix invalid signatures for missing certificates 2019-04-05 09:40:26 -04:00
Victor Shyba
3acabec4bb fixes from review 2019-04-03 00:51:05 -04:00
Victor Shyba
2e22473ce3 pylint and smaller fixes 2019-04-03 00:51:05 -04:00
Victor Shyba
0b0fd64642 further refactor resolve.py 2019-04-03 00:51:05 -04:00
Victor Shyba
ca17d8597d move resolve from ledger to resolve.py 2019-04-03 00:51:05 -04:00
Victor Shyba
d16e2716c8 handle invalid data 2019-04-03 00:51:05 -04:00
Thomas Zarebczan
021e30ffde fix: extension check 
disregard the first period, otherwise the `filename.` test fails.
 2019-04-01 22:56:40 -04:00
Thomas Zarebczan
eb2cd8fec1 stream type mapping 
Mapping extensions to stream types. I went with document / model / binary for the ones we were missing. This can be adjusted later on if not correct, but at least we'll have the main ones. Added extensions for lbry, cbz, cbr also.
 2019-04-01 22:56:40 -04:00
Lex Berezhny
ef7bd00f22 round USD fees to nearest penny 2019-03-31 18:14:13 -04:00
Lex Berezhny
3c1fdb5114 v0.35.0 2019-03-29 21:51:05 -04:00
Lex Berezhny
83411acfbd split claim_abandon into stream_abandon and channel_abandon 2019-03-29 21:48:55 -04:00
Lex Berezhny
7b57ba96dd fix docopt parsing and stream manager tests 2019-03-29 21:14:20 -04:00
Lex Berezhny
668840921f typo fix 2019-03-29 21:14:20 -04:00
Lex Berezhny
a3bd335f7f --languages, --locations fully support all attributes, add BTC 2019-03-29 21:14:20 -04:00
Lex Berezhny
4e6bca1389 support_abandon sends new --keep support to same address as the first support being abandoned 2019-03-29 21:14:20 -04:00
Lex Berezhny
c4b15920ff dont show supports to foreign address if the inputs are also foreign 2019-03-29 21:14:20 -04:00
Lex Berezhny
2a55e583e7 added to docstring that a channel_id is a channel claim id 2019-03-29 21:14:20 -04:00
Lex Berezhny
2c4fde06c5 --new-signing-key -> --new_signing_key 2019-03-29 21:14:20 -04:00
Lex Berezhny
eca83d7f47 --clear-tags -> --clear_tags 2019-03-29 21:14:20 -04:00
Lex Berezhny
87e818ac39 v0.35.0rc2 2019-03-27 22:20:09 -04:00
Lex Berezhny
5f8482bdb7 hash -> sd_hash, encoding fixes, update to new protobufs 2019-03-27 21:57:22 -04:00
Lex Berezhny
cd266477fb stop regenerating v1 protobufs 2019-03-27 21:57:22 -04:00