Commit graph

110 commits

Author SHA1 Message Date
Jack Robison e671005c3c
update BlobManager to use SQLiteStorage, remove old database functions
-remove blob upload/download history
2018-02-13 10:27:50 -05:00
Alex Grintsvayg 2f8c645edc download script now gets all blobs in stream if you give it an sd hash 2018-02-07 11:21:34 -05:00
Antonio Quartulli 8a7e707504
DHTPeerFinder: re-join the network if we have no peers
Periodically check if the routing table is empty and, if so,
re-attempt joining the DHT network.

This check is performed in the main DHTPeerFinder loop every 60 secs.

Closes: #1093
Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2018-02-06 12:33:12 +08:00
Jack Robison bc58add6de
logging 2018-01-04 21:25:56 -05:00
Jack Robison 6385ab27c1
fix handling stream with no data blobs
fixes https://github.com/lbryio/lbry/issues/905
2018-01-04 21:25:54 -05:00
Jack Robison f0a1adc9c5
whitespace, logging 2017-12-20 20:43:01 -05:00
Kay Kurokawa 71ebf79939 add argument in DHTPeerFinder.find_peers_for_blob that filters itself from peer list. Use this argument to remove itself from peer list when downloading blobs
do not filter self on peer list
2017-11-07 09:56:40 -05:00
Kay Kurokawa 9470b318b0 moved BLOB_SIZE in conf to MAX_BLOB_SIZE constant in blob.blob_file 2017-10-31 15:38:00 -04:00
Jack Robison 78ad87d349
fix uncaught CancelledError in peer_list 2017-10-11 14:05:03 -04:00
Jack Robison 8c79421790
less verbose ClientProtocol log
fix https://github.com/lbryio/lbry/issues/917
2017-10-11 13:47:57 -04:00
Jack Robison 9de4657a4d
fix blob history and callback from _download_succeeded
previously _download_succeeded did not block on blob_completed,
presumably because even longer ago it did not block on a deriving
immediate_announce call and thus took a long time to return
2017-09-28 14:04:02 -04:00
Jack Robison b0a3771ccf
better download errors 2017-09-28 14:04:02 -04:00
Jack Robison 6cbe86d057
rename is_validated() to get_is_verified() to distinguish from verified property 2017-09-20 14:02:34 -04:00
Jack Robison ffbcd82263
fix redundant blob request to peer 2017-09-20 13:59:29 -04:00
Kay Kurokawa ab3c987034
fix lints 2017-09-20 13:59:28 -04:00
Jack Robison b6e9aa420c
fix cancelled blob request? 2017-09-20 13:59:28 -04:00
Kay Kurokawa e50ade85be
catch IOError properly 2017-09-20 13:59:28 -04:00
Kay Kurokawa ea49cddf52
catch IOError when writing 2017-09-20 13:59:28 -04:00
Jack Robison 85f25a8d99
remove debug logging 2017-09-20 13:59:27 -04:00
Jack Robison 19ff0941f5
fix ClientProtocol. _handle_response_error 2017-09-20 13:59:27 -04:00
Jack Robison adf89a9d1a
logging 2017-09-20 13:59:27 -04:00
Kay Kurokawa e92321a9c1
have BlobFile.open_for_writing() return the writer instead of write and close functions 2017-09-20 13:59:23 -04:00
Jack Robison cfe73a8627
fix hanging streamprogressmanager 2017-09-20 13:59:19 -04:00
Kay Kurokawa a9e6c89693 clean up and clarify in docstring when/where None is returned while searching for peers 2017-08-28 10:46:47 -04:00
Kay Kurokawa e0985695ac some pep8 fixes 2017-08-28 10:46:47 -04:00
Kay Kurokawa e2e28338f3 in ConnectionManager, be consistent and initialize conf values in __init__ 2017-08-28 10:46:47 -04:00
Kay Kurokawa a31b6b192f Create an optional way of downloading by head blob first in ConnectionManager 2017-08-28 10:46:47 -04:00
Kay Kurokawa 0639bb9865 add support for should_announce feature 2017-08-28 10:43:57 -04:00
Kay Kurokawa 7e95169fbe add get_head_blob_hash() function in DownloadManager 2017-08-28 10:43:57 -04:00
Alex Grintsvayg 02d4444780 fixed shutdown messages 2017-08-09 19:10:11 -04:00
Kay Kurokawa 4019f2a2e1 fix problems with DownloadManager startup and stop 2017-07-05 16:33:02 -04:00
Kay Kurokawa be75c1bc5b break up GetStream.start() function further for testing 2017-07-05 16:33:02 -04:00
Kay Kurokawa fc40f5525a add download_sd_blob timeout to GetStream 2017-07-05 16:33:02 -04:00
Kay Kurokawa bd4dd8e114 add timeout to download_sd_blob and StandaloneBlobDownloader 2017-07-05 16:33:02 -04:00
Kay Kurokawa 1c1b5096be use LoopingCall in SingleProgressManager to simplify it 2017-07-05 16:33:02 -04:00
Alex Grintsvayg cdf67de46c pylint type checking 2017-04-25 14:36:14 -04:00
Alex Grintsvayg 492cbc83c9 pylint 2017-04-19 16:00:39 -04:00
Alex Grintsvayg 7f7a6a619f tests for windows, simplify pylint 2017-04-19 14:59:06 -04:00
Kay Kurokawa ddd8fd1a77 decrease connection timeout 2017-03-27 15:11:15 -04:00
Kay Kurokawa 3af5e9dc5c connect to multiple peers at once in manage 2017-03-27 15:11:15 -04:00
Jack Robison 9744287370 change attribute "uri" to "name" 2017-03-07 18:29:44 -05:00
Kay Kurokawa 824fbcc25a adding timeout to ClientProtocol 2017-02-27 13:02:35 -05:00
Kay Kurokawa c27fe7af31 use utils.call_later in ConnectionManager 2017-02-20 16:48:29 -05:00
Jack Robison b18679af53 debug log 2017-02-19 19:37:50 -05:00
Jack Robison 25ec8fde23 add timeout to get_availability and peer_list
-add optional timeout to DHTPeerFinder.find_peers_for_blob
-add peer_search_timeout setting
2017-02-16 11:17:37 -05:00
Job Evers-Meltzer a38e5c855e Remove upload_allowed attribute
This is unused and largely pulluting the argument list
of too many functions.
2017-02-15 06:48:50 -06:00
Kay Kurokawa 4f87e87d3e Adding connection manager tests, and modifying connection manager to be testeable, fix bug where failed connection was not marked as down 2017-02-13 12:17:27 -05:00
Kay Kurokawa a5e8c561e4 Revert "adding connection manager tests, and modifying connection manager to be testeable"
This reverts commit 7b6e233d22, as it was an accidental push to master
2017-02-01 11:59:36 -05:00
Kay Kurokawa 7b6e233d22 adding connection manager tests, and modifying connection manager to be testeable 2017-02-01 11:52:16 -05:00
Kay Kurokawa 90438ddf9f removing str() from logging functions 2017-01-26 12:14:33 -05:00