Commit graph

3914 commits

Author SHA1 Message Date
Jack Robison
4f0e8fce6e
add optional download_directory argument to get 2019-05-06 18:46:26 -04:00
Jack Robison
f642cfe9dd
fix resuming save tasks on startup 2019-05-06 18:46:26 -04:00
Jack Robison
24e073680b
add connection id workaround 2019-05-06 18:46:26 -04:00
Jack Robison
b2f63a1545
fix tests 2019-05-06 18:46:26 -04:00
Jack Robison
f506b3e6d4
tests 2019-05-06 18:46:26 -04:00
Jack Robison
f7412514b3
fix partial content 0 padding 2019-05-06 18:46:26 -04:00
Jack Robison
bd6a609b30
fix logging 2019-05-06 18:46:26 -04:00
Jack Robison
4e32b69d1d
don't set running streams as stopped on startup 2019-05-06 18:46:26 -04:00
Jack Robison
1116c7f29e
logging 2019-05-06 18:46:26 -04:00
Jack Robison
d80c671cf2
look victor 2019-05-06 18:46:26 -04:00
Jack Robison
14b12cbea2
block /stream and /get requests on the stream manager starting 2019-05-06 18:46:26 -04:00
Jack Robison
1f7feafb67
force close open streaming requests and api calls on shutdown 2019-05-06 18:46:26 -04:00
Jack Robison
cbe689ea7f
logging 2019-05-06 18:46:26 -04:00
Jack Robison
9099ee2e8e
fix/refactor starting and stopping files
-move partial content handling into ManagedStream
-add delayed stop test
2019-05-06 18:46:26 -04:00
Jack Robison
b134e0c9c9
fix blob_get 2019-05-06 18:46:26 -04:00
Jack Robison
f8c0e80cfc
add __slots__ to BlobInfo, StreamDescriptor, and KademliaPeer 2019-05-06 18:46:26 -04:00
Jack Robison
1f266ebdad
add logging for streams we already have 2019-05-06 18:46:26 -04:00
Jack Robison
b09e1f8825
fix written_bytes never being 0 2019-05-06 18:46:26 -04:00
Victor Shyba
cacc65d45e fix edge case from test for single blob stream 2019-05-06 18:18:12 -03:00
Victor Shyba
43111f0497 bump db revision 2019-05-06 17:19:40 -03:00
Victor Shyba
6c142b4477 add migrator for previous bugs 2019-05-06 17:12:04 -03:00
Victor Shyba
e8683a24bd fix should_announce being set on stream creation 2019-05-06 16:49:52 -03:00
Baltazar Gomez
a030e13548 fix incorrect media-type of .cbr archives 2019-05-05 20:57:36 -04:00
Victor Shyba
f5bd28bfdb make save_file a parameter instead of a flag so it obeys conf 2019-05-05 19:46:42 -03:00
Lex Berezhny
6cbbe23c7c account_list defaults to 0 confirmations for balance 2019-05-04 18:08:33 -04:00
Lex Berezhny
d7c2e4e9b3 fixed bug where lbrynet failed to start with single-key accounts in the wallet 2019-05-04 17:56:39 -04:00
Victor Shyba
cf7bb6a391 fix tests and stream being deleted on data timeout 2019-05-02 16:41:48 -03:00
Victor Shyba
68d7328918 always close the write handle 2019-05-02 12:20:49 -03:00
Victor Shyba
ff2985cc80 close protocol if transport reuse brings responses before requests 2019-05-02 12:13:33 -03:00
Victor Shyba
ac69fcbc5f fix possible division by zero 2019-05-02 11:52:09 -03:00
Victor Shyba
609cf42868 cleanup downloader code 2019-05-01 18:04:45 -03:00
Victor Shyba
e43b29fcd1 if the current writer is closed, its fine to open a new one 2019-05-01 15:09:11 -03:00
Victor Shyba
ae2121c5c4 fix tests and new test 2019-05-01 13:16:45 -03:00
Victor Shyba
60f7766cf7 small adjustment to new_peer_or_finished 2019-05-01 02:55:51 -03:00
Victor Shyba
63bd983012 pylint 2019-05-01 00:42:51 -03:00
Victor Shyba
7ffce1040c fix foreign key error 2019-04-30 19:51:19 -03:00
Victor Shyba
ac6835fa60 dont get stuck 2019-04-30 19:51:02 -03:00
Victor Shyba
3cf5c536c0 improve ban timing and downloader loop friction 2019-04-30 17:56:29 -03:00
Lex Berezhny
85cc1a4763 v0.37.0rc5 2019-04-29 17:22:47 -04:00
Lex Berezhny
aeaa7ba986 switched from sha256 for unencrypted file hash to sha384 2019-04-29 16:01:59 -04:00
Lex Berezhny
a36936b5ff v0.37.0rc4 2019-04-29 00:27:53 -04:00
Victor Shyba
7cf245a0e9 encode timestamp and confirmations into file list 2019-04-29 00:26:14 -04:00
Victor Shyba
30b113d64a depth -> confirmations 2019-04-29 00:26:14 -04:00
Victor Shyba
ccd2023d37 add timestamp field to resolve 2019-04-29 00:26:14 -04:00
Victor Shyba
6e483cba8d tests: add confirm parameters, like the other calls 2019-04-28 22:53:43 -04:00
Victor Shyba
46c03c0cb2 refactor: move generate to blockchain call 2019-04-28 22:53:43 -04:00
Victor Shyba
b350e74aca fix stream update callback to update the main dict 2019-04-28 22:53:43 -04:00
Victor Shyba
de9473f75a test resolve updates file list 2019-04-28 22:53:43 -04:00
Lex Berezhny
bfc107fdb3 removed blockchain.block.get_block from wallet server API 2019-04-27 18:03:35 -04:00
Lex Berezhny
6a2efa54ab dropped block_show command from API, users should run a full node if they need access to blocks 2019-04-27 18:03:35 -04:00
Lex Berezhny
72f0e1ca14 added timestamp field to transaction output results from JSON RPC calls 2019-04-27 17:10:49 -04:00
Lex Berezhny
706a8e52dc v0.37.0rc3 2019-04-27 13:12:27 -04:00
Lex Berezhny
f3c8776878 fixed --preview mode on stream_create/update 2019-04-27 13:11:32 -04:00
Lex Berezhny
539ea04039 fixed signing streams using --channel_name argument 2019-04-27 11:52:29 -04:00
Lex Berezhny
8f96b07559 updating stream claim with new file now correctly updates file list removing old file 2019-04-27 10:55:20 -04:00
Lex Berezhny
da637b9c0e added --replace option to stream_update and channel_update, publish defaults to --replace 2019-04-26 23:37:10 -04:00
Lex Berezhny
3618de1227 added --clear_fee ability to stream update command 2019-04-26 17:52:29 -04:00
Victor Shyba
3cb8a63bf9 add channel_name parameter on claim search 2019-04-26 17:30:21 -04:00
Lex Berezhny
3d1efbc9bb v0.37.0rc2 2019-04-25 20:40:07 -04:00
Victor Shyba
7bdef3146b fix ttfb 2019-04-25 20:38:33 -04:00
Lex Berezhny
db08882f20 v0.37.0rc1 2019-04-24 21:35:59 -04:00
Jack Robison
056a629e87
remove unused property 2019-04-24 13:39:06 -04:00
Jack Robison
1ffb99f9f9
rename streaming_only setting -> save_files 2019-04-24 12:44:12 -04:00
Jack Robison
67088b2ca2
test_blob_writers_concurrency 2019-04-24 09:48:04 -04:00
Jack Robison
dab49e812f
set writer result or error before calling close_handle 2019-04-24 09:48:04 -04:00
Jack Robison
0f3f38d8a3
pylint 2019-04-24 09:48:04 -04:00
Jack Robison
7ba433c2e5
fix setting blob verified event and canceling blob writers
-raise OSError if multiple writers for one peer are opened for a blob
2019-04-24 09:48:04 -04:00
Jack Robison
832537a5cf
set deleted downloads as streaming mode on startup 2019-04-24 09:48:04 -04:00
Jack Robison
3234d70270
add peer address/port to hash blob writer 2019-04-24 09:48:04 -04:00
Jack Robison
432fe444f8
fix cache_concurrent decorator 2019-04-24 09:48:04 -04:00
Victor Shyba
9ba6653475
raise proper error when sd is not available 2019-04-24 09:48:04 -04:00
Jack Robison
8107e97304
remove debugging /streams endpoint 2019-04-24 09:48:04 -04:00
Jack Robison
e2663f6d57
remove unnecessary except/raise 2019-04-24 09:48:04 -04:00
Jack Robison
3a997277aa
reduce the amount of Blob objects created 2019-04-24 09:48:04 -04:00
Jack Robison
a7d94f4514
add file_save 2019-04-24 09:48:04 -04:00
Jack Robison
a0e3338177
only re-reflect streams if the sd blob is readable 2019-04-24 09:48:04 -04:00
Jack Robison
d5a353066c
missing await 2019-04-24 09:48:04 -04:00
Jack Robison
bc29fc4465
type 2019-04-24 09:48:04 -04:00
Jack Robison
987f175fcc
logging 2019-04-24 09:48:04 -04:00
Jack Robison
01a81fceed
more streaming_only + save_blobs integration testing 2019-04-24 09:48:04 -04:00
Jack Robison
a1abb7c8fb
test range requests 2019-04-24 09:48:04 -04:00
Jack Robison
46b166952b
non async blob_completed callback, tests 2019-04-24 09:48:04 -04:00
Jack Robison
1375153fda
fix publish updates not being saved to the db, don't query the db for the stream hash 2019-04-24 09:48:04 -04:00
Jack Robison
1a14157d37
fix unawaited task 2019-04-24 09:48:04 -04:00
Jack Robison
4d0e9e0428
relative http redirect from /get -> /stream 2019-04-24 09:48:04 -04:00
Jack Robison
3a53ef5690
catch TransportNotConnected 2019-04-24 09:48:04 -04:00
Jack Robison
33a68b5cef
handle dht is_closing 2019-04-24 09:48:04 -04:00
Jack Robison
63bf084a6a
cancel dht response future 2019-04-24 09:48:04 -04:00
Jack Robison
a882f2e8c5
merge conflicts 2019-04-24 09:48:04 -04:00
Jack Robison
119e0ec408
cancelled error 2019-04-24 09:48:04 -04:00
Jack Robison
7d782d516a
track and close blob readers 2019-04-24 09:48:04 -04:00
Jack Robison
d3eac48035
tests, add __slots__ to AbstractBlob 2019-04-24 09:48:04 -04:00
Jack Robison
60c9ae64b4
endpoint to call get and redirect to the partial content stream 2019-04-24 09:48:04 -04:00
Jack Robison
2d314dce60
add save_file argument to get 2019-04-24 09:48:04 -04:00
Jack Robison
287b89db66
fix tests 2019-04-24 09:48:04 -04:00
Jack Robison
7a160f7335
fix tests 2019-04-24 09:48:04 -04:00
Jack Robison
04ddee7d89
blob tests 2019-04-24 09:48:04 -04:00
Jack Robison
3a916a8e8e
tests 2019-04-24 09:48:04 -04:00
Jack Robison
f125468ebf
fix claim not being saved to the db 2019-04-24 09:48:04 -04:00
Jack Robison
f0e17cff9a
support streaming downloads / range requests 2019-04-24 09:48:04 -04:00
Jack Robison
93267efe0b
remove StreamAssembler, refactor ManagedStream and StreamDownloader (WIP) 2019-04-24 09:48:04 -04:00
Jack Robison
c663e5a3cf
add cache_concurrent decorator 2019-04-24 09:48:04 -04:00
Jack Robison
676f0015aa
refactor BlobFile into AbstractBlob, BlobFile, and BlobBuffer classes 2019-04-24 09:48:04 -04:00
Jack Robison
d44a79ada2
cache resolve_host, add async_timed_cache decorator 2019-04-24 09:48:04 -04:00
Jack Robison
d7ed8ffaa6
add streaming_only and save_blobs settings 2019-04-24 09:48:04 -04:00
Jack Robison
b230d8fbcb
rename BlobFileManager -> BlobManager 2019-04-24 09:48:04 -04:00
Lex Berezhny
58987857cf v0.36.0 2019-04-22 18:47:58 -04:00
Lex Berezhny
fa8858325c add lbry:// to permanent_url response field 2019-04-22 18:41:11 -04:00
Lex Berezhny
3357a419ab ability to overide the file name, hash and size when updating a stream claim 2019-04-22 18:05:49 -04:00
Lex Berezhny
e8991e6d52 improve account locking/unlocing CLI docs 2019-04-22 14:06:42 -04:00
Lex Berezhny
13bd81c2b6 v0.36.0rc4 2019-04-21 23:11:23 -04:00
Victor Shyba
21241b98a4 workaround for having new encoder fields on resolve so app can use them 2019-04-21 22:51:48 -04:00
Lex Berezhny
886ed6415a added examples which include all metadata passed to create stream and create channel 2019-04-21 21:34:13 -04:00
Lex Berezhny
97db241109 v0.36.0rc3 2019-04-21 20:20:53 -04:00
Lex Berezhny
216379918b renamed txo sub_type to value_type in txo json encoder output 2019-04-21 17:40:40 -04:00
Lex Berezhny
19f300cc45 added protobuf to get and file_list commands 2019-04-21 14:28:43 -04:00
Lex Berezhny
7824de655e updated stream manager to pull protobuf instead of hex from resolve response 2019-04-21 14:28:43 -04:00
Lex Berezhny
6ef1b1dd59 resolve command also returns protobuf 2019-04-21 14:28:43 -04:00
Lex Berezhny
9fae8f5153 added --include_protobuf to add hexlified protobuf to RPC responses 2019-04-21 14:28:43 -04:00
Lex Berezhny
f660691e78 v0.36.0rc2 2019-04-21 00:50:27 -04:00
Lex Berezhny
bf60683ba6 update to protobuf change where ClaimList defaults to collection list type 2019-04-21 00:45:51 -04:00
Lex Berezhny
71f5061848 exposed new protobuf fields in APIs and updated tests 2019-04-21 00:45:51 -04:00
Lex Berezhny
61cadb5cbe v0.36.0rc1 2019-04-20 02:34:27 -04:00
Lex Berezhny
2034104cfc test fixes 2019-04-20 02:33:41 -04:00
Lex Berezhny
8bf2e41c95 --contact_email -> --email and --homepage_url -> --website_url 2019-04-20 02:33:41 -04:00
Lex Berezhny
fa9a4a75c6 update to an even newer protobufs 2019-04-20 02:33:41 -04:00
Lex Berezhny
90bef98bc3 use TXORef.hash instead of TXORef.id when signing claim with channel 2019-04-20 02:33:41 -04:00
Lex Berezhny
35c43647aa use TXORef.hash instead of TXORef.id when signing claim with channel 2019-04-20 02:33:41 -04:00
Lex Berezhny
449a583286 default to claimType == 1 when it is missing for old claim protobufs 2019-04-20 02:33:41 -04:00
Lex Berezhny
b1f813782a regenerated protobuf python code 2019-04-20 02:33:41 -04:00
Lex Berezhny
60080cbd19 updating to new protobufs 2019-04-20 02:33:41 -04:00
Victor Shyba
665dba62c7 simplify save from resolve, deduplicate items 2019-04-20 01:19:40 -04:00
Victor Shyba
76dea9e89b batch save supports 2019-04-20 01:19:40 -04:00
Victor Shyba
ebc9ed01c5 make lru_cache a power of two, following py docs 2019-04-20 01:19:40 -04:00
Victor Shyba
55116763e9 cache transactions 2019-04-20 01:19:40 -04:00
Victor Shyba
e1a6b4e3d6 fix dict handling mistake 2019-04-20 01:19:40 -04:00
Victor Shyba
911ca8c37e cache and share txs fetches while validating concurrently on batches 2019-04-20 01:19:40 -04:00
ポール ウェッブ
a63442f843 Fixes and updated gitignore 2019-04-12 11:53:37 -04:00
Oleg Silkin
b6a4589da5 Adds comment group to lbrynet with commands list and create 2019-04-07 15:27:59 -04:00
Oleg Silkin
fbbb0a9931 Adds server URL to configuration settings 2019-04-07 15:27:59 -04:00
Oleg Silkin
a94d65d522 Adds utility functions for making batch jsonrpc requests to comment server 2019-04-07 15:27:59 -04:00
Lex Berezhny
9af625e627 test fixes 2019-04-06 17:08:15 -04:00
Lex Berezhny
93220c3874 daemon json rpc return type docs 2019-04-06 17:08:15 -04:00
Lex Berezhny
362ed3f1c8 remove unused import 2019-04-06 17:08:15 -04:00
Lex Berezhny
6f76d9e24a moved integration testcase.py into lbrynet so that it can be used from scripts 2019-04-06 17:08:15 -04:00
Victor Shyba
fd56dc68cd fix depth on resolve, add tests 2019-04-05 09:40:26 -04:00
Victor Shyba
a0a810edc3 make permanent url name#claim_id on torba too 2019-04-05 09:40:26 -04:00
Victor Shyba
c1d3b5984d fix old hash reverse confusion 2019-04-05 09:40:26 -04:00
Victor Shyba
1fb719dd61 fix valid_at_height not being shown for name resolutions, which fixes tests 2019-04-05 09:40:26 -04:00
Victor Shyba
b87316fb02 make permanent url name#id only for now 2019-04-05 09:40:26 -04:00