Commit graph

2085 commits

Author SHA1 Message Date
Kay Kurokawa
574660cc20 add test to count the number of blobs created by EncryptedFileCreator 2017-10-12 11:16:20 -04:00
Jack Robison
fb071778dc
fix docstring 2017-10-11 15:14:29 -04:00
Jack Robison
9585b444ab
Bump version 0.17.0rc15 --> 0.17.0rc16
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-11 14:49:55 -04:00
Jack Robison
4b9c881cd0
fix recording reader was closed
reader_finished() is called when the reader closes, so the `readers -=
1` here was redundant and led to readers equalling -1 instead of 0.
2017-10-11 14:45:36 -04:00
Jack Robison
334a55bf7f
Bump version 0.17.0rc14 --> 0.17.0rc15
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-11 14:06:33 -04:00
Jack Robison
78ad87d349
fix uncaught CancelledError in peer_list 2017-10-11 14:05:03 -04:00
Jack Robison
8c79421790
less verbose ClientProtocol log
fix https://github.com/lbryio/lbry/issues/917
2017-10-11 13:47:57 -04:00
Jack Robison
0a19dd938a
Bump version 0.17.0rc13 --> 0.17.0rc14
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-11 13:07:49 -04:00
Jack Robison
a0a7d5f569
add routing_table_get 2017-10-11 12:54:40 -04:00
Akinwale Ariwodola
0291482abb raised errors directly instead of wrapping with AssertionError 2017-10-11 07:59:30 +01:00
Jack Robison
323c3e6cb3
add external_ip argument to Session, default to None 2017-10-10 13:55:36 -04:00
Jack Robison
c7acb31614
add dht tests 2017-10-10 13:55:35 -04:00
Jack Robison
e9fd8eb096
update tests and scripts 2017-10-10 13:55:31 -04:00
Jack Robison
9919fd06c6
uncomment error for store request where contact is not known 2017-10-10 13:29:54 -04:00
Jack Robison
c9515f8fb6
logging and whitespace 2017-10-10 13:29:29 -04:00
Jack Robison
5937ead17c
add Node.contacts helper property 2017-10-10 13:28:57 -04:00
Jack Robison
23ce278f8a
add removePeer to interface 2017-10-10 13:27:44 -04:00
Jack Robison
de1dc507ac
fix findCloseNodes when buckets aren't fully populated 2017-10-10 13:21:06 -04:00
Jack Robison
ab956d4a8e
use count parameter in findCloseNodes 2017-10-10 13:20:19 -04:00
Jack Robison
7c50e26bd7
include method and args in _sentMessages 2017-10-10 13:19:03 -04:00
Jack Robison
a942e6f3eb
fix args for ping() 2017-10-10 13:18:38 -04:00
Jack Robison
fe2d6bad1b
fix logging error for dht rpc methods with no args (ping) 2017-10-10 13:18:00 -04:00
Jack Robison
3096c89e37
don't wrap exceptions with Failure 2017-10-10 13:17:36 -04:00
Jack Robison
2a47385b62
add rpcAttempts and replacementCacheSize constants 2017-10-10 13:16:26 -04:00
Jack Robison
fcaca05a81
fix redundant lbryid 2017-10-10 13:15:25 -04:00
Jack Robison
46e31d5b45
getPeersForBlob inlinecallbacks refactor 2017-10-10 13:12:47 -04:00
Jack Robison
8e9f3c90a1
use looping call for Node.change_token to avoid hanging delayedCalls 2017-10-10 13:10:47 -04:00
Jack Robison
f1980f524e
fix raising remote exceptions 2017-10-10 13:09:25 -04:00
Jack Robison
4a567f7ab1
organize dht errors and interfaces 2017-10-10 13:08:22 -04:00
Akinwale Ariwodola
6ed56804b9 return empty string as default value when docstring is missing 2017-10-09 21:14:16 +01:00
Akinwale Ariwodola
fb6545481b refactored one more assert 2017-10-09 20:41:08 +01:00
Akinwale Ariwodola
4f6f226b18 refactor asserts due to PYTHONOPTIMIZE flag 2017-10-09 20:20:58 +01:00
Jack Robison
777cda2cd3
Bump version 0.17.0rc12 --> 0.17.0rc13
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-09 10:40:23 -04:00
Jack Robison
7898b9c2d8
Merge branch 'master' into add_more_session_info 2017-10-09 10:39:48 -04:00
Jack Robison
e4cc87b8f0
Bump version 0.17.0rc11 --> 0.17.0rc12
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-09 10:30:36 -04:00
Kay Kurokawa
043758c11f rename moved_verified_blob as saved_verified_blob 2017-10-06 17:05:16 -04:00
Kay Kurokawa
d9cc81766d
use DeferredLock instead of threading.Lock() as it can cause deadlocks 2017-10-06 17:05:10 -04:00
Kay Kurokawa
2115919c55
Add test when mutliple writers call _save_verified_blob at once, this will cause deadlock 2017-10-06 16:34:45 -04:00
Jack Robison
d1511cba54 fix reading sd blob
TODO: add __enter__ and __exit__ methods to HashBlobReader to let it be
used as a contextmanager
2017-10-05 17:58:18 -04:00
Kay Kurokawa
db0bc92087
add unit tests for should annouce functions in BlobManager 2017-10-05 13:59:50 -04:00
Kay Kurokawa
1f839fe2a6
add blob announcement information to session_status 2017-10-05 13:59:27 -04:00
Kay Kurokawa
0a919c3eab fix inconsistency in how blob_hashes_to_send is used, preventing proper reflecting 2017-10-03 11:22:07 -04:00
Kay Kurokawa
6268e43509 make sure to close blob files when connection is lost on reflector client 2017-10-02 16:30:58 -04:00
Kay Kurokawa
d33ebd60c4 fix to not reflect all the files at once 2017-10-02 16:30:58 -04:00
Jack Robison
64a4c47536
Bump version 0.17.0rc10 --> 0.17.0rc11
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-02 10:12:19 -07:00
Jack Robison
33a95abeac
Merge branch 'tests_to_lbrynet' 2017-10-02 10:06:12 -07:00
Akinwale Ariwodola
63dd57aaea fixed long string concatenation and merged with master 2017-10-02 17:13:45 +01:00
Jack Robison
b22c9c0f25
Bump version 0.17.0rc9 --> 0.17.0rc10
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-02 11:30:05 -04:00
Jack Robison
a0817840c5
Bump version 0.17.0rc8 --> 0.17.0rc9
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-02 11:22:44 -04:00
Jack Robison
aa3982f0e2
temporarily disable blob analytics 2017-10-02 11:21:51 -04:00
Jack Robison
6a7982022a
Bump version 0.17.0rc7 --> 0.17.0rc8
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-29 12:37:57 -04:00
Jack Robison
838436d641
Merge remote-tracking branch 'origin/fix_blob_reader_closing' 2017-09-29 12:37:15 -04:00
Akinwale Ariwodola
91498822ae fixed all pylint errors 2017-09-29 11:44:22 +01:00
Jack Robison
5ac60cf2c2
Bump version 0.17.0rc6 --> 0.17.0rc7
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-28 17:46:47 -04:00
Jack Robison
b85a813aaf
fix sd timeout 2017-09-28 17:36:55 -04:00
Jack Robison
89ef5620a4
Bump version 0.17.0rc5 --> 0.17.0rc6
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-28 16:08:15 -04:00
Jack Robison
2ebb9da108
move download_failed 2017-09-28 15:46:02 -04:00
Jack Robison
c6db4b187a
fix error name 2017-09-28 15:45:24 -04:00
Jack Robison
b7bfb259e5
fix download exceptions 2017-09-28 15:28:39 -04:00
Jack Robison
9fd60c823f
add _download_failed errback 2017-09-28 15:28:37 -04:00
Jack Robison
82a2805aaf
json blobs 2017-09-28 15:28:06 -04:00
Jack Robison
50b51569a3
cancel streams on shutdown 2017-09-28 14:48:05 -04:00
Jack Robison
fa83a4f671
fix stop condition 2017-09-28 14:04:03 -04:00
Jack Robison
c9ae251d60
download analytics 2017-09-28 14:04:03 -04:00
Jack Robison
af99edc764
add get_host_downloaded_from 2017-09-28 14:04:03 -04:00
Jack Robison
9de4657a4d
fix blob history and callback from _download_succeeded
previously _download_succeeded did not block on blob_completed,
presumably because even longer ago it did not block on a deriving
immediate_announce call and thus took a long time to return
2017-09-28 14:04:02 -04:00
Jack Robison
250855d45d
stop failed downloader outside of GetStream 2017-09-28 14:04:02 -04:00
Jack Robison
b0a3771ccf
better download errors 2017-09-28 14:04:02 -04:00
Akinwale Ariwodola
2abe85ba25 moved tests into the lbrynet package 2017-09-28 18:21:26 +01:00
Kay Kurokawa
533835a732 add comments and docstrings 2017-09-27 17:40:52 -04:00
Kay Kurokawa
a4ea49cf65 read handle was not being closed after file transfer 2017-09-27 17:30:20 -04:00
Kay Kurokawa
aab43c8d6c close the reader directly instead of calling close_read_handle() 2017-09-27 17:30:20 -04:00
Kay Kurokawa
f6da00cbab no need to catch IOError exception here, let it propagage 2017-09-27 17:30:20 -04:00
Kay Kurokawa
3b5690614c Return HashBlobReader instead of file handle in open_for_reading() 2017-09-27 17:30:20 -04:00
Kay Kurokawa
09e25ba285 add reader, for BlobFile, change original reader to v0 2017-09-27 17:30:20 -04:00
Jack Robison
df9cec66be
Bump version 0.17.0rc4 --> 0.17.0rc5
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-26 16:53:27 -04:00
Jack Robison
53456c61b8
Bump version 0.17.0rc3 --> 0.17.0rc4
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-25 19:11:10 -04:00
Jack Robison
8847e07f87
Bump version 0.17.0rc2 --> 0.17.0rc3
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-25 13:30:10 -04:00
Kay Kurokawa
0fc116fbdb Change to reflector2 in conf 2017-09-25 13:18:07 -04:00
Jack Robison
d2de0911b3
Bump version 0.17.0rc1 --> 0.17.0rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-22 14:57:32 -04:00
Kay Kurokawa
cc98cdf933
announce_head_blobs_only is True by default 2017-09-22 14:46:28 -04:00
Jack Robison
4b8700268f
discover stream info for uploads via reflector v1 2017-09-22 14:46:23 -04:00
Kay Kurokawa
4d5ba94a6e
add tests for checking stream info on reflector server 2017-09-22 14:39:37 -04:00
Kay Kurokawa
32feb628c3
add stream_info_manager to reflector server initialization 2017-09-22 14:39:29 -04:00
Kay Kurokawa
1a8e11ead3
work on reflector head blob announce only 2017-09-22 14:39:28 -04:00
Jack Robison
5503b0f290
Bump version 0.16.1 --> 0.17.0rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-22 14:38:57 -04:00
Miroslav Kovar
0fca867ec0 Modified check_connection() to try bypassing DNS before giving up. 2017-09-20 23:36:08 +02:00
Jack Robison
6cbe86d057
rename is_validated() to get_is_verified() to distinguish from verified property 2017-09-20 14:02:34 -04:00
Jack Robison
ffbcd82263
fix redundant blob request to peer 2017-09-20 13:59:29 -04:00
Kay Kurokawa
ab3c987034
fix lints 2017-09-20 13:59:28 -04:00
Jack Robison
b6e9aa420c
fix cancelled blob request? 2017-09-20 13:59:28 -04:00
Kay Kurokawa
e50ade85be
catch IOError properly 2017-09-20 13:59:28 -04:00
Kay Kurokawa
ea49cddf52
catch IOError when writing 2017-09-20 13:59:28 -04:00
Jack Robison
85f25a8d99
remove debug logging 2017-09-20 13:59:27 -04:00
Jack Robison
19ff0941f5
fix ClientProtocol. _handle_response_error 2017-09-20 13:59:27 -04:00
Jack Robison
adf89a9d1a
logging 2017-09-20 13:59:27 -04:00
Jack Robison
8419e1e1d5
change some ValueErrors to IOErrors 2017-09-20 13:59:26 -04:00
Jack Robison
421141b958
raise instead of assert 2017-09-20 13:59:26 -04:00
Jack Robison
96357ab833
exchange rate error 2017-09-20 13:59:26 -04:00
Jack Robison
b9b5e755db
raise rather than assert 2017-09-20 13:59:26 -04:00
Jack Robison
ad061b5ea3
use fixed BlobFile type 2017-09-20 13:59:25 -04:00
Kay Kurokawa
8d2cc4a4c0
lint, remove ununsed imports 2017-09-20 13:59:25 -04:00
Kay Kurokawa
af3ab96815
deleting unused BlobFile.finished_deferred 2017-09-20 13:59:25 -04:00
Kay Kurokawa
e046af57fa
fix empty tail blobs in stream from being saved 2017-09-20 13:59:24 -04:00
Jack Robison
6f71a5003c
remove unused EncryptedFileOpener 2017-09-20 13:59:24 -04:00
Jack Robison
14636a5d38
split up HashBlob.py into lbrynet.blob 2017-09-20 13:59:24 -04:00
Jack Robison
7d6e62eb77
consolidate HashBlob and BlobFile 2017-09-20 13:59:24 -04:00
Kay Kurokawa
e92321a9c1
have BlobFile.open_for_writing() return the writer instead of write and close functions 2017-09-20 13:59:23 -04:00
Kay Kurokawa
39c4db3471
make sure that we don't call HashBlobWriter.finished_cb multiple times when calling close() 2017-09-20 13:59:23 -04:00
Kay Kurokawa
468a16af58
move check for write_handle to the beginning and raise exception when writing to a closed file handle 2017-09-20 13:59:23 -04:00
Kay Kurokawa
196aa24b8b
add HashBlobWriter.close_handle() function to just close the write handle 2017-09-20 13:59:22 -04:00
Kay Kurokawa
94ff4e82bc
remove HashBob._close_writer(), move the closing of write handler to HashBlobWriter 2017-09-20 13:59:22 -04:00
Kay Kurokawa
0f95712a0f
rename HashBlobWriter.cancel() as close() to be more file like 2017-09-20 13:59:22 -04:00
Kay Kurokawa
ab513d076b
fix multiple writers writing to the same buffer 2017-09-20 13:59:22 -04:00
Kay Kurokawa
f2deee7201
fireback finished_deferred after deleting from self.writers so that BlobFile state is accurate after finished_deferred is called 2017-09-20 13:59:21 -04:00
Kay Kurokawa
b655cd4fa6
add better comments for classes in HashBlob.py 2017-09-20 13:59:21 -04:00
Jack Robison
487f2490ab
simplify CryptStreamCreator 2017-09-20 13:59:20 -04:00
Jack Robison
90bce0b375
fix setting _final_blob_num in EncryptedFileMetadataHandler 2017-09-20 13:59:20 -04:00
Jack Robison
b98cd24e10
don't reflect empty last blob 2017-09-20 13:59:20 -04:00
Jack Robison
070978248e
return new lbry file status from _change_file_status 2017-09-20 13:59:20 -04:00
Jack Robison
100c18d9b6
send CryptBlobInfo (not a CryptStreamBlobMaker) to DiskBlobManager.creator_finished 2017-09-20 13:59:19 -04:00
Jack Robison
e3cc3992b0
remove unnecessary functions 2017-09-20 13:59:19 -04:00
Jack Robison
cfe73a8627
fix hanging streamprogressmanager 2017-09-20 13:59:19 -04:00
Jack Robison
632fd764fa
show more information for a blob padding error 2017-09-20 13:59:19 -04:00
Jack Robison
a72fef07c0
inlinecallbacks 2017-09-20 13:59:18 -04:00
Jack Robison
1148a533bf
raise NotImplementedError on StreamCreator._blob_finished (sanity check) 2017-09-20 13:59:18 -04:00
Jack Robison
c53a189605
remove TempBlob, clean up blob classes, use FBP and BytesIO in BlobFile 2017-09-20 13:59:18 -04:00
Victor Shyba
6022aa925b
fix import 2017-09-20 13:59:18 -04:00
Victor Shyba
e69ba64707
pycrypt -> cryptography + remove manual padding, use lib 2017-09-20 13:59:17 -04:00
Victor Shyba
d2fc1daf26
use hashlib 2017-09-20 13:59:17 -04:00
Victor Shyba
a6b8327fcf
save using a FBP instead of thread 2017-09-20 13:59:17 -04:00
Victor Shyba
7262e84150
use a buffer to wait for blob completion 2017-09-20 13:59:16 -04:00
Victor Shyba
5d69e74010
use WAL on sqlite3 2017-09-20 13:59:16 -04:00
Victor Shyba
5bbb29fd79
add error handling to blobs creation 2017-09-20 13:59:16 -04:00
Alex Grintsvayg
c98197f266 deprecated blob_announce_all 2017-09-20 11:16:10 -04:00
Jack Robison
1b2bd871f4
Bump version 0.16.1rc1 --> 0.16.1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-20 10:24:44 -04:00
Jack Robison
747b098d8b
Bump version 0.16.0 --> 0.16.1rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-20 09:55:57 -04:00
Jack Robison
88fcd5b711
update _get_history for change in lbryum 2017-09-20 09:51:52 -04:00
Jack Robison
9bb03757ec
docopt fix 2017-09-20 09:50:48 -04:00
Jack Robison
1f5b2203d7
Bump version 0.16.0rc9 --> 0.16.0
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-18 10:14:41 -04:00
Jack Robison
1a503dd94b
Bump version 0.16.0rc8 --> 0.16.0rc9
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-15 19:45:39 -04:00
Alex Grintsvayg
8681686395 why would written_bytes ever be False? 2017-09-12 16:00:32 -04:00
Alex Grintsvayg
810089cd99 not sure why this is here 2017-09-12 13:47:08 -04:00
Mike Putnam
e7094a92ab Docs spelling correction. (#873)
Docs spelling correction
2017-09-12 09:41:11 -04:00
Jack Robison
0f4dc67fb9
Bump version 0.16.0rc7 --> 0.16.0rc8
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-11 12:09:40 -04:00
Kay Kurokawa
66152a8f93 turn on head blob announce seek for clients 2017-09-11 11:34:26 -04:00
Jack Robison
300426b912
Bump version 0.16.0rc6 --> 0.16.0rc7
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-07 14:13:04 -04:00
Jack Robison
5f9509db96
don't use google finance 2017-09-07 13:55:36 -04:00
Jack Robison
2d39f3b2ab
Bump version 0.16.0rc5 --> 0.16.0rc6
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-06 11:01:49 -04:00
Jack Robison
dd036d15c8
update decode_address import from lbryschema
https://github.com/lbryio/lbryschema/pull/16
2017-09-06 10:58:52 -04:00