LBRYCommunity/lbry-sdk
1
0
Fork 1
Code Issues Pull requests Projects Releases 282 Packages Wiki Activity
2952 commits 110 branches 641 tags 31 MiB
Commit graph

1999 commits

Author SHA1 Message Date
Kay Kurokawa
043758c11f rename moved_verified_blob as saved_verified_blob 2017-10-06 17:05:16 -04:00
Kay Kurokawa
d9cc81766d
use DeferredLock instead of threading.Lock() as it can cause deadlocks 2017-10-06 17:05:10 -04:00
Kay Kurokawa
2115919c55
Add test when mutliple writers call _save_verified_blob at once, this will cause deadlock 2017-10-06 16:34:45 -04:00
Jack Robison
d1511cba54 fix reading sd blob 
TODO: add __enter__ and __exit__ methods to HashBlobReader to let it be
used as a contextmanager
 2017-10-05 17:58:18 -04:00
Kay Kurokawa
db0bc92087
add unit tests for should annouce functions in BlobManager 2017-10-05 13:59:50 -04:00
Kay Kurokawa
1f839fe2a6
add blob announcement information to session_status 2017-10-05 13:59:27 -04:00
Kay Kurokawa
0a919c3eab fix inconsistency in how blob_hashes_to_send is used, preventing proper reflecting 2017-10-03 11:22:07 -04:00
Kay Kurokawa
6268e43509 make sure to close blob files when connection is lost on reflector client 2017-10-02 16:30:58 -04:00
Kay Kurokawa
d33ebd60c4 fix to not reflect all the files at once 2017-10-02 16:30:58 -04:00
Jack Robison
64a4c47536
Bump version 0.17.0rc10 --> 0.17.0rc11 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2017-10-02 10:12:19 -07:00
Jack Robison
33a95abeac
Merge branch 'tests_to_lbrynet' 2017-10-02 10:06:12 -07:00
Akinwale Ariwodola
63dd57aaea fixed long string concatenation and merged with master 2017-10-02 17:13:45 +01:00
Jack Robison
b22c9c0f25
Bump version 0.17.0rc9 --> 0.17.0rc10 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2017-10-02 11:30:05 -04:00
Jack Robison
a0817840c5
Bump version 0.17.0rc8 --> 0.17.0rc9 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2017-10-02 11:22:44 -04:00
Jack Robison
aa3982f0e2
temporarily disable blob analytics 2017-10-02 11:21:51 -04:00
Jack Robison
6a7982022a
Bump version 0.17.0rc7 --> 0.17.0rc8 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2017-09-29 12:37:57 -04:00
Jack Robison
838436d641
Merge remote-tracking branch 'origin/fix_blob_reader_closing' 2017-09-29 12:37:15 -04:00
Akinwale Ariwodola
91498822ae fixed all pylint errors 2017-09-29 11:44:22 +01:00
Jack Robison
5ac60cf2c2
Bump version 0.17.0rc6 --> 0.17.0rc7 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2017-09-28 17:46:47 -04:00
Jack Robison
b85a813aaf
fix sd timeout 2017-09-28 17:36:55 -04:00
Jack Robison
89ef5620a4
Bump version 0.17.0rc5 --> 0.17.0rc6 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2017-09-28 16:08:15 -04:00
Jack Robison
2ebb9da108
move download_failed 2017-09-28 15:46:02 -04:00
Jack Robison
c6db4b187a
fix error name 2017-09-28 15:45:24 -04:00
Jack Robison
b7bfb259e5
fix download exceptions 2017-09-28 15:28:39 -04:00
Jack Robison
9fd60c823f
add _download_failed errback 2017-09-28 15:28:37 -04:00
Jack Robison
82a2805aaf
json blobs 2017-09-28 15:28:06 -04:00
Jack Robison
50b51569a3
cancel streams on shutdown 2017-09-28 14:48:05 -04:00
Jack Robison
fa83a4f671
fix stop condition 2017-09-28 14:04:03 -04:00
Jack Robison
c9ae251d60
download analytics 2017-09-28 14:04:03 -04:00
Jack Robison
af99edc764
add get_host_downloaded_from 2017-09-28 14:04:03 -04:00
Jack Robison
9de4657a4d
fix blob history and callback from _download_succeeded 
previously _download_succeeded did not block on blob_completed,
presumably because even longer ago it did not block on a deriving
immediate_announce call and thus took a long time to return
 2017-09-28 14:04:02 -04:00
Jack Robison
250855d45d
stop failed downloader outside of GetStream 2017-09-28 14:04:02 -04:00
Jack Robison
b0a3771ccf
better download errors 2017-09-28 14:04:02 -04:00
Akinwale Ariwodola
2abe85ba25 moved tests into the lbrynet package 2017-09-28 18:21:26 +01:00
Kay Kurokawa
533835a732 add comments and docstrings 2017-09-27 17:40:52 -04:00
Kay Kurokawa
a4ea49cf65 read handle was not being closed after file transfer 2017-09-27 17:30:20 -04:00
Kay Kurokawa
aab43c8d6c close the reader directly instead of calling close_read_handle() 2017-09-27 17:30:20 -04:00
Kay Kurokawa
f6da00cbab no need to catch IOError exception here, let it propagage 2017-09-27 17:30:20 -04:00
Kay Kurokawa
3b5690614c Return HashBlobReader instead of file handle in open_for_reading() 2017-09-27 17:30:20 -04:00
Kay Kurokawa
09e25ba285 add reader, for BlobFile, change original reader to v0 2017-09-27 17:30:20 -04:00
Jack Robison
df9cec66be
Bump version 0.17.0rc4 --> 0.17.0rc5 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2017-09-26 16:53:27 -04:00
Jack Robison
53456c61b8
Bump version 0.17.0rc3 --> 0.17.0rc4 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2017-09-25 19:11:10 -04:00
Jack Robison
8847e07f87
Bump version 0.17.0rc2 --> 0.17.0rc3 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2017-09-25 13:30:10 -04:00
Kay Kurokawa
0fc116fbdb Change to reflector2 in conf 2017-09-25 13:18:07 -04:00
Jack Robison
d2de0911b3
Bump version 0.17.0rc1 --> 0.17.0rc2 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2017-09-22 14:57:32 -04:00
Kay Kurokawa
cc98cdf933
announce_head_blobs_only is True by default 2017-09-22 14:46:28 -04:00
Jack Robison
4b8700268f
discover stream info for uploads via reflector v1 2017-09-22 14:46:23 -04:00
Kay Kurokawa
4d5ba94a6e
add tests for checking stream info on reflector server 2017-09-22 14:39:37 -04:00
Kay Kurokawa
32feb628c3
add stream_info_manager to reflector server initialization 2017-09-22 14:39:29 -04:00
Kay Kurokawa
1a8e11ead3
work on reflector head blob announce only 2017-09-22 14:39:28 -04:00
Jack Robison
5503b0f290
Bump version 0.16.1 --> 0.17.0rc1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2017-09-22 14:38:57 -04:00
Jack Robison
6cbe86d057
rename is_validated() to get_is_verified() to distinguish from verified property 2017-09-20 14:02:34 -04:00
Jack Robison
ffbcd82263
fix redundant blob request to peer 2017-09-20 13:59:29 -04:00
Kay Kurokawa
ab3c987034
fix lints 2017-09-20 13:59:28 -04:00
Jack Robison
b6e9aa420c
fix cancelled blob request? 2017-09-20 13:59:28 -04:00
Kay Kurokawa
e50ade85be
catch IOError properly 2017-09-20 13:59:28 -04:00
Kay Kurokawa
ea49cddf52
catch IOError when writing 2017-09-20 13:59:28 -04:00
Jack Robison
85f25a8d99
remove debug logging 2017-09-20 13:59:27 -04:00
Jack Robison
19ff0941f5
fix ClientProtocol. _handle_response_error 2017-09-20 13:59:27 -04:00
Jack Robison
adf89a9d1a
logging 2017-09-20 13:59:27 -04:00
Jack Robison
8419e1e1d5
change some ValueErrors to IOErrors 2017-09-20 13:59:26 -04:00
Jack Robison
421141b958
raise instead of assert 2017-09-20 13:59:26 -04:00
Jack Robison
96357ab833
exchange rate error 2017-09-20 13:59:26 -04:00
Jack Robison
b9b5e755db
raise rather than assert 2017-09-20 13:59:26 -04:00
Jack Robison
ad061b5ea3
use fixed BlobFile type 2017-09-20 13:59:25 -04:00
Kay Kurokawa
8d2cc4a4c0
lint, remove ununsed imports 2017-09-20 13:59:25 -04:00
Kay Kurokawa
af3ab96815
deleting unused BlobFile.finished_deferred 2017-09-20 13:59:25 -04:00
Kay Kurokawa
e046af57fa
fix empty tail blobs in stream from being saved 2017-09-20 13:59:24 -04:00
Jack Robison
6f71a5003c
remove unused EncryptedFileOpener 2017-09-20 13:59:24 -04:00
Jack Robison
14636a5d38
split up HashBlob.py into lbrynet.blob 2017-09-20 13:59:24 -04:00
Jack Robison
7d6e62eb77
consolidate HashBlob and BlobFile 2017-09-20 13:59:24 -04:00
Kay Kurokawa
e92321a9c1
have BlobFile.open_for_writing() return the writer instead of write and close functions 2017-09-20 13:59:23 -04:00
Kay Kurokawa
39c4db3471
make sure that we don't call HashBlobWriter.finished_cb multiple times when calling close() 2017-09-20 13:59:23 -04:00
Kay Kurokawa
468a16af58
move check for write_handle to the beginning and raise exception when writing to a closed file handle 2017-09-20 13:59:23 -04:00
Kay Kurokawa
196aa24b8b
add HashBlobWriter.close_handle() function to just close the write handle 2017-09-20 13:59:22 -04:00
Kay Kurokawa
94ff4e82bc
remove HashBob._close_writer(), move the closing of write handler to HashBlobWriter 2017-09-20 13:59:22 -04:00
Kay Kurokawa
0f95712a0f
rename HashBlobWriter.cancel() as close() to be more file like 2017-09-20 13:59:22 -04:00
Kay Kurokawa
ab513d076b
fix multiple writers writing to the same buffer 2017-09-20 13:59:22 -04:00
Kay Kurokawa
f2deee7201
fireback finished_deferred after deleting from self.writers so that BlobFile state is accurate after finished_deferred is called 2017-09-20 13:59:21 -04:00
Kay Kurokawa
b655cd4fa6
add better comments for classes in HashBlob.py 2017-09-20 13:59:21 -04:00
Jack Robison
487f2490ab
simplify CryptStreamCreator 2017-09-20 13:59:20 -04:00
Jack Robison
90bce0b375
fix setting _final_blob_num in EncryptedFileMetadataHandler 2017-09-20 13:59:20 -04:00
Jack Robison
b98cd24e10
don't reflect empty last blob 2017-09-20 13:59:20 -04:00
Jack Robison
070978248e
return new lbry file status from _change_file_status 2017-09-20 13:59:20 -04:00
Jack Robison
100c18d9b6
send CryptBlobInfo (not a CryptStreamBlobMaker) to DiskBlobManager.creator_finished 2017-09-20 13:59:19 -04:00
Jack Robison
e3cc3992b0
remove unnecessary functions 2017-09-20 13:59:19 -04:00
Jack Robison
cfe73a8627
fix hanging streamprogressmanager 2017-09-20 13:59:19 -04:00
Jack Robison
632fd764fa
show more information for a blob padding error 2017-09-20 13:59:19 -04:00
Jack Robison
a72fef07c0
inlinecallbacks 2017-09-20 13:59:18 -04:00
Jack Robison
1148a533bf
raise NotImplementedError on StreamCreator._blob_finished (sanity check) 2017-09-20 13:59:18 -04:00
Jack Robison
c53a189605
remove TempBlob, clean up blob classes, use FBP and BytesIO in BlobFile 2017-09-20 13:59:18 -04:00
Victor Shyba
6022aa925b
fix import 2017-09-20 13:59:18 -04:00
Victor Shyba
e69ba64707
pycrypt -> cryptography + remove manual padding, use lib 2017-09-20 13:59:17 -04:00
Victor Shyba
d2fc1daf26
use hashlib 2017-09-20 13:59:17 -04:00
Victor Shyba
a6b8327fcf
save using a FBP instead of thread 2017-09-20 13:59:17 -04:00
Victor Shyba
7262e84150
use a buffer to wait for blob completion 2017-09-20 13:59:16 -04:00
Victor Shyba
5d69e74010
use WAL on sqlite3 2017-09-20 13:59:16 -04:00
Victor Shyba
5bbb29fd79
add error handling to blobs creation 2017-09-20 13:59:16 -04:00
Alex Grintsvayg
c98197f266 deprecated blob_announce_all 2017-09-20 11:16:10 -04:00
Jack Robison
1b2bd871f4
Bump version 0.16.1rc1 --> 0.16.1 
Signed-off-by: Jack Robison <jackrobison@lbry.io>
 2017-09-20 10:24:44 -04:00