Commit graph

2006 commits

Author SHA1 Message Date
Jack Robison
4a567f7ab1
organize dht errors and interfaces 2017-10-10 13:08:22 -04:00
Akinwale Ariwodola
6ed56804b9 return empty string as default value when docstring is missing 2017-10-09 21:14:16 +01:00
Akinwale Ariwodola
fb6545481b refactored one more assert 2017-10-09 20:41:08 +01:00
Akinwale Ariwodola
4f6f226b18 refactor asserts due to PYTHONOPTIMIZE flag 2017-10-09 20:20:58 +01:00
Jack Robison
777cda2cd3
Bump version 0.17.0rc12 --> 0.17.0rc13
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-09 10:40:23 -04:00
Jack Robison
7898b9c2d8
Merge branch 'master' into add_more_session_info 2017-10-09 10:39:48 -04:00
Jack Robison
e4cc87b8f0
Bump version 0.17.0rc11 --> 0.17.0rc12
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-09 10:30:36 -04:00
Kay Kurokawa
043758c11f rename moved_verified_blob as saved_verified_blob 2017-10-06 17:05:16 -04:00
Kay Kurokawa
d9cc81766d
use DeferredLock instead of threading.Lock() as it can cause deadlocks 2017-10-06 17:05:10 -04:00
Kay Kurokawa
2115919c55
Add test when mutliple writers call _save_verified_blob at once, this will cause deadlock 2017-10-06 16:34:45 -04:00
Jack Robison
d1511cba54 fix reading sd blob
TODO: add __enter__ and __exit__ methods to HashBlobReader to let it be
used as a contextmanager
2017-10-05 17:58:18 -04:00
Kay Kurokawa
db0bc92087
add unit tests for should annouce functions in BlobManager 2017-10-05 13:59:50 -04:00
Kay Kurokawa
1f839fe2a6
add blob announcement information to session_status 2017-10-05 13:59:27 -04:00
Kay Kurokawa
0a919c3eab fix inconsistency in how blob_hashes_to_send is used, preventing proper reflecting 2017-10-03 11:22:07 -04:00
Kay Kurokawa
6268e43509 make sure to close blob files when connection is lost on reflector client 2017-10-02 16:30:58 -04:00
Kay Kurokawa
d33ebd60c4 fix to not reflect all the files at once 2017-10-02 16:30:58 -04:00
Jack Robison
64a4c47536
Bump version 0.17.0rc10 --> 0.17.0rc11
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-02 10:12:19 -07:00
Jack Robison
33a95abeac
Merge branch 'tests_to_lbrynet' 2017-10-02 10:06:12 -07:00
Akinwale Ariwodola
63dd57aaea fixed long string concatenation and merged with master 2017-10-02 17:13:45 +01:00
Jack Robison
b22c9c0f25
Bump version 0.17.0rc9 --> 0.17.0rc10
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-02 11:30:05 -04:00
Jack Robison
a0817840c5
Bump version 0.17.0rc8 --> 0.17.0rc9
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-02 11:22:44 -04:00
Jack Robison
aa3982f0e2
temporarily disable blob analytics 2017-10-02 11:21:51 -04:00
Jack Robison
6a7982022a
Bump version 0.17.0rc7 --> 0.17.0rc8
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-29 12:37:57 -04:00
Jack Robison
838436d641
Merge remote-tracking branch 'origin/fix_blob_reader_closing' 2017-09-29 12:37:15 -04:00
Akinwale Ariwodola
91498822ae fixed all pylint errors 2017-09-29 11:44:22 +01:00
Jack Robison
5ac60cf2c2
Bump version 0.17.0rc6 --> 0.17.0rc7
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-28 17:46:47 -04:00
Jack Robison
b85a813aaf
fix sd timeout 2017-09-28 17:36:55 -04:00
Jack Robison
89ef5620a4
Bump version 0.17.0rc5 --> 0.17.0rc6
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-28 16:08:15 -04:00
Jack Robison
2ebb9da108
move download_failed 2017-09-28 15:46:02 -04:00
Jack Robison
c6db4b187a
fix error name 2017-09-28 15:45:24 -04:00
Jack Robison
b7bfb259e5
fix download exceptions 2017-09-28 15:28:39 -04:00
Jack Robison
9fd60c823f
add _download_failed errback 2017-09-28 15:28:37 -04:00
Jack Robison
82a2805aaf
json blobs 2017-09-28 15:28:06 -04:00
Jack Robison
50b51569a3
cancel streams on shutdown 2017-09-28 14:48:05 -04:00
Jack Robison
fa83a4f671
fix stop condition 2017-09-28 14:04:03 -04:00
Jack Robison
c9ae251d60
download analytics 2017-09-28 14:04:03 -04:00
Jack Robison
af99edc764
add get_host_downloaded_from 2017-09-28 14:04:03 -04:00
Jack Robison
9de4657a4d
fix blob history and callback from _download_succeeded
previously _download_succeeded did not block on blob_completed,
presumably because even longer ago it did not block on a deriving
immediate_announce call and thus took a long time to return
2017-09-28 14:04:02 -04:00
Jack Robison
250855d45d
stop failed downloader outside of GetStream 2017-09-28 14:04:02 -04:00
Jack Robison
b0a3771ccf
better download errors 2017-09-28 14:04:02 -04:00
Akinwale Ariwodola
2abe85ba25 moved tests into the lbrynet package 2017-09-28 18:21:26 +01:00
Kay Kurokawa
533835a732 add comments and docstrings 2017-09-27 17:40:52 -04:00
Kay Kurokawa
a4ea49cf65 read handle was not being closed after file transfer 2017-09-27 17:30:20 -04:00
Kay Kurokawa
aab43c8d6c close the reader directly instead of calling close_read_handle() 2017-09-27 17:30:20 -04:00
Kay Kurokawa
f6da00cbab no need to catch IOError exception here, let it propagage 2017-09-27 17:30:20 -04:00
Kay Kurokawa
3b5690614c Return HashBlobReader instead of file handle in open_for_reading() 2017-09-27 17:30:20 -04:00
Kay Kurokawa
09e25ba285 add reader, for BlobFile, change original reader to v0 2017-09-27 17:30:20 -04:00
Jack Robison
df9cec66be
Bump version 0.17.0rc4 --> 0.17.0rc5
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-26 16:53:27 -04:00
Jack Robison
53456c61b8
Bump version 0.17.0rc3 --> 0.17.0rc4
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-25 19:11:10 -04:00
Jack Robison
8847e07f87
Bump version 0.17.0rc2 --> 0.17.0rc3
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-25 13:30:10 -04:00
Kay Kurokawa
0fc116fbdb Change to reflector2 in conf 2017-09-25 13:18:07 -04:00
Jack Robison
d2de0911b3
Bump version 0.17.0rc1 --> 0.17.0rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-22 14:57:32 -04:00
Kay Kurokawa
cc98cdf933
announce_head_blobs_only is True by default 2017-09-22 14:46:28 -04:00
Jack Robison
4b8700268f
discover stream info for uploads via reflector v1 2017-09-22 14:46:23 -04:00
Kay Kurokawa
4d5ba94a6e
add tests for checking stream info on reflector server 2017-09-22 14:39:37 -04:00
Kay Kurokawa
32feb628c3
add stream_info_manager to reflector server initialization 2017-09-22 14:39:29 -04:00
Kay Kurokawa
1a8e11ead3
work on reflector head blob announce only 2017-09-22 14:39:28 -04:00
Jack Robison
5503b0f290
Bump version 0.16.1 --> 0.17.0rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-22 14:38:57 -04:00
Jack Robison
6cbe86d057
rename is_validated() to get_is_verified() to distinguish from verified property 2017-09-20 14:02:34 -04:00
Jack Robison
ffbcd82263
fix redundant blob request to peer 2017-09-20 13:59:29 -04:00
Kay Kurokawa
ab3c987034
fix lints 2017-09-20 13:59:28 -04:00
Jack Robison
b6e9aa420c
fix cancelled blob request? 2017-09-20 13:59:28 -04:00
Kay Kurokawa
e50ade85be
catch IOError properly 2017-09-20 13:59:28 -04:00
Kay Kurokawa
ea49cddf52
catch IOError when writing 2017-09-20 13:59:28 -04:00
Jack Robison
85f25a8d99
remove debug logging 2017-09-20 13:59:27 -04:00
Jack Robison
19ff0941f5
fix ClientProtocol. _handle_response_error 2017-09-20 13:59:27 -04:00
Jack Robison
adf89a9d1a
logging 2017-09-20 13:59:27 -04:00
Jack Robison
8419e1e1d5
change some ValueErrors to IOErrors 2017-09-20 13:59:26 -04:00
Jack Robison
421141b958
raise instead of assert 2017-09-20 13:59:26 -04:00
Jack Robison
96357ab833
exchange rate error 2017-09-20 13:59:26 -04:00
Jack Robison
b9b5e755db
raise rather than assert 2017-09-20 13:59:26 -04:00
Jack Robison
ad061b5ea3
use fixed BlobFile type 2017-09-20 13:59:25 -04:00
Kay Kurokawa
8d2cc4a4c0
lint, remove ununsed imports 2017-09-20 13:59:25 -04:00
Kay Kurokawa
af3ab96815
deleting unused BlobFile.finished_deferred 2017-09-20 13:59:25 -04:00
Kay Kurokawa
e046af57fa
fix empty tail blobs in stream from being saved 2017-09-20 13:59:24 -04:00
Jack Robison
6f71a5003c
remove unused EncryptedFileOpener 2017-09-20 13:59:24 -04:00
Jack Robison
14636a5d38
split up HashBlob.py into lbrynet.blob 2017-09-20 13:59:24 -04:00
Jack Robison
7d6e62eb77
consolidate HashBlob and BlobFile 2017-09-20 13:59:24 -04:00
Kay Kurokawa
e92321a9c1
have BlobFile.open_for_writing() return the writer instead of write and close functions 2017-09-20 13:59:23 -04:00
Kay Kurokawa
39c4db3471
make sure that we don't call HashBlobWriter.finished_cb multiple times when calling close() 2017-09-20 13:59:23 -04:00
Kay Kurokawa
468a16af58
move check for write_handle to the beginning and raise exception when writing to a closed file handle 2017-09-20 13:59:23 -04:00
Kay Kurokawa
196aa24b8b
add HashBlobWriter.close_handle() function to just close the write handle 2017-09-20 13:59:22 -04:00
Kay Kurokawa
94ff4e82bc
remove HashBob._close_writer(), move the closing of write handler to HashBlobWriter 2017-09-20 13:59:22 -04:00
Kay Kurokawa
0f95712a0f
rename HashBlobWriter.cancel() as close() to be more file like 2017-09-20 13:59:22 -04:00
Kay Kurokawa
ab513d076b
fix multiple writers writing to the same buffer 2017-09-20 13:59:22 -04:00
Kay Kurokawa
f2deee7201
fireback finished_deferred after deleting from self.writers so that BlobFile state is accurate after finished_deferred is called 2017-09-20 13:59:21 -04:00
Kay Kurokawa
b655cd4fa6
add better comments for classes in HashBlob.py 2017-09-20 13:59:21 -04:00
Jack Robison
487f2490ab
simplify CryptStreamCreator 2017-09-20 13:59:20 -04:00
Jack Robison
90bce0b375
fix setting _final_blob_num in EncryptedFileMetadataHandler 2017-09-20 13:59:20 -04:00
Jack Robison
b98cd24e10
don't reflect empty last blob 2017-09-20 13:59:20 -04:00
Jack Robison
070978248e
return new lbry file status from _change_file_status 2017-09-20 13:59:20 -04:00
Jack Robison
100c18d9b6
send CryptBlobInfo (not a CryptStreamBlobMaker) to DiskBlobManager.creator_finished 2017-09-20 13:59:19 -04:00
Jack Robison
e3cc3992b0
remove unnecessary functions 2017-09-20 13:59:19 -04:00
Jack Robison
cfe73a8627
fix hanging streamprogressmanager 2017-09-20 13:59:19 -04:00
Jack Robison
632fd764fa
show more information for a blob padding error 2017-09-20 13:59:19 -04:00
Jack Robison
a72fef07c0
inlinecallbacks 2017-09-20 13:59:18 -04:00
Jack Robison
1148a533bf
raise NotImplementedError on StreamCreator._blob_finished (sanity check) 2017-09-20 13:59:18 -04:00
Jack Robison
c53a189605
remove TempBlob, clean up blob classes, use FBP and BytesIO in BlobFile 2017-09-20 13:59:18 -04:00
Victor Shyba
6022aa925b
fix import 2017-09-20 13:59:18 -04:00
Victor Shyba
e69ba64707
pycrypt -> cryptography + remove manual padding, use lib 2017-09-20 13:59:17 -04:00