Commit graph

2054 commits

Author SHA1 Message Date
Akinwale Ariwodola
4f6f226b18 refactor asserts due to PYTHONOPTIMIZE flag 2017-10-09 20:20:58 +01:00
Jack Robison
777cda2cd3
Bump version 0.17.0rc12 --> 0.17.0rc13
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-09 10:40:23 -04:00
Jack Robison
7898b9c2d8
Merge branch 'master' into add_more_session_info 2017-10-09 10:39:48 -04:00
Jack Robison
e4cc87b8f0
Bump version 0.17.0rc11 --> 0.17.0rc12
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-09 10:30:36 -04:00
Kay Kurokawa
043758c11f rename moved_verified_blob as saved_verified_blob 2017-10-06 17:05:16 -04:00
Kay Kurokawa
d9cc81766d
use DeferredLock instead of threading.Lock() as it can cause deadlocks 2017-10-06 17:05:10 -04:00
Kay Kurokawa
2115919c55
Add test when mutliple writers call _save_verified_blob at once, this will cause deadlock 2017-10-06 16:34:45 -04:00
Jack Robison
d1511cba54 fix reading sd blob
TODO: add __enter__ and __exit__ methods to HashBlobReader to let it be
used as a contextmanager
2017-10-05 17:58:18 -04:00
Kay Kurokawa
db0bc92087
add unit tests for should annouce functions in BlobManager 2017-10-05 13:59:50 -04:00
Kay Kurokawa
1f839fe2a6
add blob announcement information to session_status 2017-10-05 13:59:27 -04:00
Kay Kurokawa
0a919c3eab fix inconsistency in how blob_hashes_to_send is used, preventing proper reflecting 2017-10-03 11:22:07 -04:00
Kay Kurokawa
6268e43509 make sure to close blob files when connection is lost on reflector client 2017-10-02 16:30:58 -04:00
Kay Kurokawa
d33ebd60c4 fix to not reflect all the files at once 2017-10-02 16:30:58 -04:00
Jack Robison
64a4c47536
Bump version 0.17.0rc10 --> 0.17.0rc11
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-02 10:12:19 -07:00
Jack Robison
33a95abeac
Merge branch 'tests_to_lbrynet' 2017-10-02 10:06:12 -07:00
Akinwale Ariwodola
63dd57aaea fixed long string concatenation and merged with master 2017-10-02 17:13:45 +01:00
Jack Robison
b22c9c0f25
Bump version 0.17.0rc9 --> 0.17.0rc10
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-02 11:30:05 -04:00
Jack Robison
a0817840c5
Bump version 0.17.0rc8 --> 0.17.0rc9
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-02 11:22:44 -04:00
Jack Robison
aa3982f0e2
temporarily disable blob analytics 2017-10-02 11:21:51 -04:00
Jack Robison
6a7982022a
Bump version 0.17.0rc7 --> 0.17.0rc8
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-29 12:37:57 -04:00
Jack Robison
838436d641
Merge remote-tracking branch 'origin/fix_blob_reader_closing' 2017-09-29 12:37:15 -04:00
Akinwale Ariwodola
91498822ae fixed all pylint errors 2017-09-29 11:44:22 +01:00
Jack Robison
5ac60cf2c2
Bump version 0.17.0rc6 --> 0.17.0rc7
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-28 17:46:47 -04:00
Jack Robison
b85a813aaf
fix sd timeout 2017-09-28 17:36:55 -04:00
Jack Robison
89ef5620a4
Bump version 0.17.0rc5 --> 0.17.0rc6
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-28 16:08:15 -04:00
Jack Robison
2ebb9da108
move download_failed 2017-09-28 15:46:02 -04:00
Jack Robison
c6db4b187a
fix error name 2017-09-28 15:45:24 -04:00
Jack Robison
b7bfb259e5
fix download exceptions 2017-09-28 15:28:39 -04:00
Jack Robison
9fd60c823f
add _download_failed errback 2017-09-28 15:28:37 -04:00
Jack Robison
82a2805aaf
json blobs 2017-09-28 15:28:06 -04:00
Jack Robison
50b51569a3
cancel streams on shutdown 2017-09-28 14:48:05 -04:00
Jack Robison
fa83a4f671
fix stop condition 2017-09-28 14:04:03 -04:00
Jack Robison
c9ae251d60
download analytics 2017-09-28 14:04:03 -04:00
Jack Robison
af99edc764
add get_host_downloaded_from 2017-09-28 14:04:03 -04:00
Jack Robison
9de4657a4d
fix blob history and callback from _download_succeeded
previously _download_succeeded did not block on blob_completed,
presumably because even longer ago it did not block on a deriving
immediate_announce call and thus took a long time to return
2017-09-28 14:04:02 -04:00
Jack Robison
250855d45d
stop failed downloader outside of GetStream 2017-09-28 14:04:02 -04:00
Jack Robison
b0a3771ccf
better download errors 2017-09-28 14:04:02 -04:00
Akinwale Ariwodola
2abe85ba25 moved tests into the lbrynet package 2017-09-28 18:21:26 +01:00
Kay Kurokawa
533835a732 add comments and docstrings 2017-09-27 17:40:52 -04:00
Kay Kurokawa
a4ea49cf65 read handle was not being closed after file transfer 2017-09-27 17:30:20 -04:00
Kay Kurokawa
aab43c8d6c close the reader directly instead of calling close_read_handle() 2017-09-27 17:30:20 -04:00
Kay Kurokawa
f6da00cbab no need to catch IOError exception here, let it propagage 2017-09-27 17:30:20 -04:00
Kay Kurokawa
3b5690614c Return HashBlobReader instead of file handle in open_for_reading() 2017-09-27 17:30:20 -04:00
Kay Kurokawa
09e25ba285 add reader, for BlobFile, change original reader to v0 2017-09-27 17:30:20 -04:00
Jack Robison
df9cec66be
Bump version 0.17.0rc4 --> 0.17.0rc5
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-26 16:53:27 -04:00
Jack Robison
53456c61b8
Bump version 0.17.0rc3 --> 0.17.0rc4
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-25 19:11:10 -04:00
Jack Robison
8847e07f87
Bump version 0.17.0rc2 --> 0.17.0rc3
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-25 13:30:10 -04:00
Kay Kurokawa
0fc116fbdb Change to reflector2 in conf 2017-09-25 13:18:07 -04:00
Jack Robison
d2de0911b3
Bump version 0.17.0rc1 --> 0.17.0rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-22 14:57:32 -04:00
Kay Kurokawa
cc98cdf933
announce_head_blobs_only is True by default 2017-09-22 14:46:28 -04:00
Jack Robison
4b8700268f
discover stream info for uploads via reflector v1 2017-09-22 14:46:23 -04:00
Kay Kurokawa
4d5ba94a6e
add tests for checking stream info on reflector server 2017-09-22 14:39:37 -04:00
Kay Kurokawa
32feb628c3
add stream_info_manager to reflector server initialization 2017-09-22 14:39:29 -04:00
Kay Kurokawa
1a8e11ead3
work on reflector head blob announce only 2017-09-22 14:39:28 -04:00
Jack Robison
5503b0f290
Bump version 0.16.1 --> 0.17.0rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-22 14:38:57 -04:00
Miroslav Kovar
0fca867ec0 Modified check_connection() to try bypassing DNS before giving up. 2017-09-20 23:36:08 +02:00
Jack Robison
6cbe86d057
rename is_validated() to get_is_verified() to distinguish from verified property 2017-09-20 14:02:34 -04:00
Jack Robison
ffbcd82263
fix redundant blob request to peer 2017-09-20 13:59:29 -04:00
Kay Kurokawa
ab3c987034
fix lints 2017-09-20 13:59:28 -04:00
Jack Robison
b6e9aa420c
fix cancelled blob request? 2017-09-20 13:59:28 -04:00
Kay Kurokawa
e50ade85be
catch IOError properly 2017-09-20 13:59:28 -04:00
Kay Kurokawa
ea49cddf52
catch IOError when writing 2017-09-20 13:59:28 -04:00
Jack Robison
85f25a8d99
remove debug logging 2017-09-20 13:59:27 -04:00
Jack Robison
19ff0941f5
fix ClientProtocol. _handle_response_error 2017-09-20 13:59:27 -04:00
Jack Robison
adf89a9d1a
logging 2017-09-20 13:59:27 -04:00
Jack Robison
8419e1e1d5
change some ValueErrors to IOErrors 2017-09-20 13:59:26 -04:00
Jack Robison
421141b958
raise instead of assert 2017-09-20 13:59:26 -04:00
Jack Robison
96357ab833
exchange rate error 2017-09-20 13:59:26 -04:00
Jack Robison
b9b5e755db
raise rather than assert 2017-09-20 13:59:26 -04:00
Jack Robison
ad061b5ea3
use fixed BlobFile type 2017-09-20 13:59:25 -04:00
Kay Kurokawa
8d2cc4a4c0
lint, remove ununsed imports 2017-09-20 13:59:25 -04:00
Kay Kurokawa
af3ab96815
deleting unused BlobFile.finished_deferred 2017-09-20 13:59:25 -04:00
Kay Kurokawa
e046af57fa
fix empty tail blobs in stream from being saved 2017-09-20 13:59:24 -04:00
Jack Robison
6f71a5003c
remove unused EncryptedFileOpener 2017-09-20 13:59:24 -04:00
Jack Robison
14636a5d38
split up HashBlob.py into lbrynet.blob 2017-09-20 13:59:24 -04:00
Jack Robison
7d6e62eb77
consolidate HashBlob and BlobFile 2017-09-20 13:59:24 -04:00
Kay Kurokawa
e92321a9c1
have BlobFile.open_for_writing() return the writer instead of write and close functions 2017-09-20 13:59:23 -04:00
Kay Kurokawa
39c4db3471
make sure that we don't call HashBlobWriter.finished_cb multiple times when calling close() 2017-09-20 13:59:23 -04:00
Kay Kurokawa
468a16af58
move check for write_handle to the beginning and raise exception when writing to a closed file handle 2017-09-20 13:59:23 -04:00
Kay Kurokawa
196aa24b8b
add HashBlobWriter.close_handle() function to just close the write handle 2017-09-20 13:59:22 -04:00
Kay Kurokawa
94ff4e82bc
remove HashBob._close_writer(), move the closing of write handler to HashBlobWriter 2017-09-20 13:59:22 -04:00
Kay Kurokawa
0f95712a0f
rename HashBlobWriter.cancel() as close() to be more file like 2017-09-20 13:59:22 -04:00
Kay Kurokawa
ab513d076b
fix multiple writers writing to the same buffer 2017-09-20 13:59:22 -04:00
Kay Kurokawa
f2deee7201
fireback finished_deferred after deleting from self.writers so that BlobFile state is accurate after finished_deferred is called 2017-09-20 13:59:21 -04:00
Kay Kurokawa
b655cd4fa6
add better comments for classes in HashBlob.py 2017-09-20 13:59:21 -04:00
Jack Robison
487f2490ab
simplify CryptStreamCreator 2017-09-20 13:59:20 -04:00
Jack Robison
90bce0b375
fix setting _final_blob_num in EncryptedFileMetadataHandler 2017-09-20 13:59:20 -04:00
Jack Robison
b98cd24e10
don't reflect empty last blob 2017-09-20 13:59:20 -04:00
Jack Robison
070978248e
return new lbry file status from _change_file_status 2017-09-20 13:59:20 -04:00
Jack Robison
100c18d9b6
send CryptBlobInfo (not a CryptStreamBlobMaker) to DiskBlobManager.creator_finished 2017-09-20 13:59:19 -04:00
Jack Robison
e3cc3992b0
remove unnecessary functions 2017-09-20 13:59:19 -04:00
Jack Robison
cfe73a8627
fix hanging streamprogressmanager 2017-09-20 13:59:19 -04:00
Jack Robison
632fd764fa
show more information for a blob padding error 2017-09-20 13:59:19 -04:00
Jack Robison
a72fef07c0
inlinecallbacks 2017-09-20 13:59:18 -04:00
Jack Robison
1148a533bf
raise NotImplementedError on StreamCreator._blob_finished (sanity check) 2017-09-20 13:59:18 -04:00
Jack Robison
c53a189605
remove TempBlob, clean up blob classes, use FBP and BytesIO in BlobFile 2017-09-20 13:59:18 -04:00
Victor Shyba
6022aa925b
fix import 2017-09-20 13:59:18 -04:00
Victor Shyba
e69ba64707
pycrypt -> cryptography + remove manual padding, use lib 2017-09-20 13:59:17 -04:00
Victor Shyba
d2fc1daf26
use hashlib 2017-09-20 13:59:17 -04:00
Victor Shyba
a6b8327fcf
save using a FBP instead of thread 2017-09-20 13:59:17 -04:00
Victor Shyba
7262e84150
use a buffer to wait for blob completion 2017-09-20 13:59:16 -04:00
Victor Shyba
5d69e74010
use WAL on sqlite3 2017-09-20 13:59:16 -04:00
Victor Shyba
5bbb29fd79
add error handling to blobs creation 2017-09-20 13:59:16 -04:00
Alex Grintsvayg
c98197f266 deprecated blob_announce_all 2017-09-20 11:16:10 -04:00
Jack Robison
1b2bd871f4
Bump version 0.16.1rc1 --> 0.16.1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-20 10:24:44 -04:00
Jack Robison
747b098d8b
Bump version 0.16.0 --> 0.16.1rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-20 09:55:57 -04:00
Jack Robison
88fcd5b711
update _get_history for change in lbryum 2017-09-20 09:51:52 -04:00
Jack Robison
9bb03757ec
docopt fix 2017-09-20 09:50:48 -04:00
Jack Robison
1f5b2203d7
Bump version 0.16.0rc9 --> 0.16.0
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-18 10:14:41 -04:00
Jack Robison
1a503dd94b
Bump version 0.16.0rc8 --> 0.16.0rc9
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-15 19:45:39 -04:00
Alex Grintsvayg
8681686395 why would written_bytes ever be False? 2017-09-12 16:00:32 -04:00
Alex Grintsvayg
810089cd99 not sure why this is here 2017-09-12 13:47:08 -04:00
Mike Putnam
e7094a92ab Docs spelling correction. (#873)
Docs spelling correction
2017-09-12 09:41:11 -04:00
Jack Robison
0f4dc67fb9
Bump version 0.16.0rc7 --> 0.16.0rc8
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-11 12:09:40 -04:00
Kay Kurokawa
66152a8f93 turn on head blob announce seek for clients 2017-09-11 11:34:26 -04:00
Jack Robison
300426b912
Bump version 0.16.0rc6 --> 0.16.0rc7
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-07 14:13:04 -04:00
Jack Robison
5f9509db96
don't use google finance 2017-09-07 13:55:36 -04:00
Jack Robison
2d39f3b2ab
Bump version 0.16.0rc5 --> 0.16.0rc6
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-06 11:01:49 -04:00
Jack Robison
dd036d15c8
update decode_address import from lbryschema
https://github.com/lbryio/lbryschema/pull/16
2017-09-06 10:58:52 -04:00
Jack Robison
1487ed713e
Bump version 0.16.0rc4 --> 0.16.0rc5
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-05 15:43:16 -04:00
Jack Robison
7e107ba87e
Bump version 0.16.0rc3 --> 0.16.0rc4
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-05 15:01:47 -04:00
Jack Robison
c0365498ba
Bump version 0.16.0rc2 --> 0.16.0rc3
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-04 09:02:59 -04:00
Jack Robison
1dda382e75
Bump version 0.16.0rc1 --> 0.16.0rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-01 10:44:20 -04:00
Jack Robison
5ece58b716
pylint 2017-09-01 10:43:46 -04:00
Jack Robison
15879e87f5
Bump version 0.15.2rc3 --> 0.16.0rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-01 10:38:11 -04:00
Jack Robison
a12c0be0b9
Fix uncaught error when shutting down after a failed daemon startup 2017-09-01 10:32:47 -04:00
Jack Robison
f1f543ee77
Bump version 0.15.2rc2 --> 0.15.2rc3
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-08-31 17:09:34 -04:00
hackrush
fbd37c591f Expose include_tip_info param
Goes with lbryio/lbryum#153

Updated changelog and added docs for include_tip_info

Added proper doc for Returns of transaction_list

Fixed some other docs
2017-09-01 02:15:24 +05:30
Jack Robison
2254e3507a
Bump version 0.15.2rc1 --> 0.15.2rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-08-31 13:51:07 -04:00
Alex Grintsvayg
f4f861a163 Bump version 0.15.1 --> 0.15.2rc1 2017-08-28 11:03:42 -04:00
Kay Kurokawa
a9e6c89693 clean up and clarify in docstring when/where None is returned while searching for peers 2017-08-28 10:46:47 -04:00
Kay Kurokawa
e0985695ac some pep8 fixes 2017-08-28 10:46:47 -04:00
Kay Kurokawa
e2e28338f3 in ConnectionManager, be consistent and initialize conf values in __init__ 2017-08-28 10:46:47 -04:00
Kay Kurokawa
a31b6b192f Create an optional way of downloading by head blob first in ConnectionManager 2017-08-28 10:46:47 -04:00
Kay Kurokawa
c8bf1d8908 should_announce should be True by default 2017-08-28 10:43:57 -04:00
Kay Kurokawa
0494b11001 remove last_announce_time 2017-08-28 10:43:57 -04:00
Kay Kurokawa
0639bb9865 add support for should_announce feature 2017-08-28 10:43:57 -04:00
Kay Kurokawa
7e95169fbe add get_head_blob_hash() function in DownloadManager 2017-08-28 10:43:57 -04:00
Kay Kurokawa
c0a2c6c830 remove blob manager reliance on HashBlob classes 2017-08-28 10:43:57 -04:00
Kay Kurokawa
8955838191 migrate blob database to have should_announce and last_announce_time 2017-08-28 10:43:57 -04:00
Jack Robison
8cf2bc2b19
Bump version 0.15.0 --> 0.15.1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-08-22 18:31:09 -04:00
Jack Robison
5fc55fc482
Merge branch 'master' into android_platform_paths 2017-08-22 15:39:02 -04:00
Alex Grin
128e893b0c Merge pull request #856 from lbryio/persist-node-id
persist dht node id
2017-08-18 16:04:33 -04:00
Akinwale Ariwodola
6252184699 fix pylint error 2017-08-18 15:09:08 +01:00
Akinwale Ariwodola
1d85f7127a updated changelog 2017-08-18 12:29:38 +01:00
Akinwale Ariwodola
70881dab6e added Android platform detection and androidhelpers module which will be used to determine base paths 2017-08-18 11:52:03 +01:00
Jack Robison
e204a3b9a5
fix doc-string for resolve 2017-08-17 14:32:28 -04:00
Jack Robison
d1b7de1807
persist dht node id 2017-08-16 21:18:10 -04:00
Jack Robison
8786133cd4
Revert "fix BlobFile._close_file"
reverts 5d24f7
2017-08-15 17:48:56 -04:00
Jack Robison
5d24f75ce2 fix BlobFile._close_file 2017-08-15 12:34:00 -04:00