Commit graph

2135 commits

Author SHA1 Message Date
Kay Kurokawa
10ac86a99e use FileBodyProducer to read 2017-10-31 15:41:53 -04:00
Kay Kurokawa
9470b318b0 moved BLOB_SIZE in conf to MAX_BLOB_SIZE constant in blob.blob_file 2017-10-31 15:38:00 -04:00
Kay Kurokawa
51d4668763 fix test 2017-10-31 15:38:00 -04:00
Kay Kurokawa
96d8cb17d9 delete deprecated producer/consumer read methods from BlobFile 2017-10-31 15:38:00 -04:00
Kay Kurokawa
1360345395 use blob.open_for_reading() in StreamBlobDecryptor 2017-10-31 15:38:00 -04:00
Kay Kurokawa
e07c2f7bd8 take read handle as argument instead of file path 2017-10-31 15:38:00 -04:00
Kay Kurokawa
d68ca65e41 warn if reader is garbage collected but not closed, do the same for writer 2017-10-31 15:38:00 -04:00
Kay Kurokawa
ea4b6935c9 remove unnecessary use of @property 2017-10-31 15:35:01 -04:00
Kay Kurokawa
cf9f9d0e75 remove unused get_default_market_feed() function 2017-10-31 15:35:01 -04:00
Kay Kurokawa
020a2e0e89 adjust the _online variable to be set on the errback, so any exception will set _online to False 2017-10-31 15:35:01 -04:00
Kay Kurokawa
7e7931fbf1 add Bittrex feed as a redundant feed, add unit test for it 2017-10-31 15:35:01 -04:00
Kay Kurokawa
4411c5c202 add name of feed to log.info 2017-10-31 15:35:01 -04:00
Miroslav Kovar
433547407e Added tests. 2017-10-31 15:35:01 -04:00
Miroslav Kovar
aa15f6c4b8 Added redundant market feed (cryptonator). 2017-10-31 15:35:01 -04:00
Jack Robison
ee3a2e88b7
Bump version 0.17.2rc1 --> 0.17.2rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-31 12:28:59 -04:00
Jack Robison
cfd4a94450
logging 2017-10-31 12:21:36 -04:00
Jack Robison
f7aa478b9b
remove unused bypass_dns parameter 2017-10-31 12:21:35 -04:00
Jack Robison
3fd542f702
Merge branch 'check_connection_bypass_dns' of https://github.com/mirgee/lbry into mirgee-check_connection_bypass_dns 2017-10-31 12:21:35 -04:00
Antonio Quartulli
d827b4d5af platform ip: ensure daemon retrieves IPv4 address only
When contacting jsonip.com to retrieve the node external IP,
the connection might be established with IPv6 and thus return
an address belonging to that family.

This address is then used to initialize the external_ip member of
Daemon session, but unfortunately IPv6 is not yet handled well.

Using an IPv6 as external IP is currently breaking parts of the
Daemon resulting in no peer connectivity at all.

We should stick to IPv4 for time being.

http://jsonip.com/about says "ipv4-only":"https://ipv4.jsonip.com"

therefore, change the IP retrieval URL to ipv4.jsonip.com to
make sure the connection is established only using an IPv4 address.

Closes: https://github.com/lbryio/lbry/issues/971
Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2017-10-31 06:59:40 -04:00
Jack Robison
db751eabb6
Bump version 0.17.1 --> 0.17.2rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-30 13:11:04 -04:00
Jack Robison
fdaaa0e678
changelog 2017-10-30 13:09:02 -04:00
Jack Robison
e89f3db31b
fix remaining length of close nodes list 2017-10-27 21:46:17 -04:00
Jack Robison
ee90c877c7
Merge branch 'dht-fix-close-nodes-list-extension' of https://github.com/ordex/lbry into ordex-dht-fix-close-nodes-list-extension 2017-10-27 18:38:03 -04:00
Jack Robison
203f2f8988
Bump version 0.17.1rc5 --> 0.17.1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-25 17:33:55 -04:00
Antonio Quartulli
673d1c4d43
Extend close nodes list by right amount
When a k-bucket does not contain enough close nodes, the
DHT will look into neighbouring k-buckets in order to entend
the list of returned nodes.

However, the list should not be extended beyond its maximum size.

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2017-10-26 02:21:24 +08:00
Alex Grintsvayg
357f15c5b8 changes that jack pointed out 2017-10-25 12:36:54 -04:00
Alex Grintsvayg
2067180467 add wallet_prefill_addresses command 2017-10-25 12:29:51 -04:00
Jack Robison
6df5de209e
Bump version 0.17.1rc4 --> 0.17.1rc5
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-25 12:08:28 -04:00
Jack Robison
e4d2a3d2ec Merge branch 'master' into android_tests_refactoring 2017-10-25 12:01:37 -04:00
Jack Robison
9decdf644d
Bump version 0.17.1rc3 --> 0.17.1rc4
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-25 10:59:43 -04:00
Jack Robison
3944c98b71
Bump version 0.17.1rc2 --> 0.17.1rc3
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-24 20:48:58 -04:00
Jack Robison
628c46e5d9
catch id validation errors 2017-10-24 20:26:03 -04:00
Jack Robison
edb8928f5c
update tests 2017-10-24 20:25:59 -04:00
Jack Robison
e2259fd8f7
fix dht rpc id length 2017-10-24 20:25:54 -04:00
Jack Robison
78417db553
Bump version 0.17.1rc1 --> 0.17.1rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-24 19:29:05 -04:00
Jack Robison
5919271966
Merge branch 'fix-remove-contact' 2017-10-24 19:26:41 -04:00
Jack Robison
9479179259
avoid future contact id parsing bugs by passing the contact id as an arg 2017-10-24 19:17:17 -04:00
Jack Robison
0b771c16ba
fix lbry id for dead contact to replace in _IterativeFindHelper 2017-10-24 19:13:45 -04:00
Jack Robison
95a0653a58
better upnp redirect 2017-10-24 19:11:19 -04:00
Jack Robison
bbc960aaf9
Bump version 0.17.0 --> 0.17.1rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-23 01:44:19 -04:00
Jack Robison
45adfc533b
fix id of new contact replacing a dead contact 2017-10-23 01:34:34 -04:00
Jack Robison
d23d4c1d73
fix lbryid length comparison 2017-10-23 01:23:04 -04:00
Jack Robison
529a11043b
don't block file manager setup on all the streams being resumed 2017-10-23 01:17:54 -04:00
Jack Robison
4e4eb5e24c
fix external ip 2017-10-23 01:17:25 -04:00
Jack Robison
93b91f8602
block session startup on joinNetwork 2017-10-23 01:16:29 -04:00
Akinwale Ariwodola
e522e7e7f7 Changed AssertionError to ValueError. Skip tests that cannot pass on Android. 2017-10-17 03:15:50 +01:00
Jack Robison
0793934d7b
Bump version 0.17.0rc17 --> 0.17.0
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-12 12:39:09 -04:00
Jack Robison
3fdd04a0e3
Bump version 0.17.0rc16 --> 0.17.0rc17
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-12 12:30:28 -04:00
Kay Kurokawa
8b2b5b991b remove unneeded _error function from CryptStreamCreator 2017-10-12 12:17:04 -04:00
Kay Kurokawa
551eab9a42 fix bug where last blob in a stream was not saved to blob manager 2017-10-12 11:25:52 -04:00
Kay Kurokawa
574660cc20 add test to count the number of blobs created by EncryptedFileCreator 2017-10-12 11:16:20 -04:00
Jack Robison
fb071778dc
fix docstring 2017-10-11 15:14:29 -04:00
Jack Robison
9585b444ab
Bump version 0.17.0rc15 --> 0.17.0rc16
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-11 14:49:55 -04:00
Jack Robison
4b9c881cd0
fix recording reader was closed
reader_finished() is called when the reader closes, so the `readers -=
1` here was redundant and led to readers equalling -1 instead of 0.
2017-10-11 14:45:36 -04:00
Jack Robison
334a55bf7f
Bump version 0.17.0rc14 --> 0.17.0rc15
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-11 14:06:33 -04:00
Jack Robison
78ad87d349
fix uncaught CancelledError in peer_list 2017-10-11 14:05:03 -04:00
Jack Robison
8c79421790
less verbose ClientProtocol log
fix https://github.com/lbryio/lbry/issues/917
2017-10-11 13:47:57 -04:00
Jack Robison
0a19dd938a
Bump version 0.17.0rc13 --> 0.17.0rc14
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-11 13:07:49 -04:00
Jack Robison
a0a7d5f569
add routing_table_get 2017-10-11 12:54:40 -04:00
Akinwale Ariwodola
0291482abb raised errors directly instead of wrapping with AssertionError 2017-10-11 07:59:30 +01:00
Jack Robison
323c3e6cb3
add external_ip argument to Session, default to None 2017-10-10 13:55:36 -04:00
Jack Robison
c7acb31614
add dht tests 2017-10-10 13:55:35 -04:00
Jack Robison
e9fd8eb096
update tests and scripts 2017-10-10 13:55:31 -04:00
Jack Robison
9919fd06c6
uncomment error for store request where contact is not known 2017-10-10 13:29:54 -04:00
Jack Robison
c9515f8fb6
logging and whitespace 2017-10-10 13:29:29 -04:00
Jack Robison
5937ead17c
add Node.contacts helper property 2017-10-10 13:28:57 -04:00
Jack Robison
23ce278f8a
add removePeer to interface 2017-10-10 13:27:44 -04:00
Jack Robison
de1dc507ac
fix findCloseNodes when buckets aren't fully populated 2017-10-10 13:21:06 -04:00
Jack Robison
ab956d4a8e
use count parameter in findCloseNodes 2017-10-10 13:20:19 -04:00
Jack Robison
7c50e26bd7
include method and args in _sentMessages 2017-10-10 13:19:03 -04:00
Jack Robison
a942e6f3eb
fix args for ping() 2017-10-10 13:18:38 -04:00
Jack Robison
fe2d6bad1b
fix logging error for dht rpc methods with no args (ping) 2017-10-10 13:18:00 -04:00
Jack Robison
3096c89e37
don't wrap exceptions with Failure 2017-10-10 13:17:36 -04:00
Jack Robison
2a47385b62
add rpcAttempts and replacementCacheSize constants 2017-10-10 13:16:26 -04:00
Jack Robison
fcaca05a81
fix redundant lbryid 2017-10-10 13:15:25 -04:00
Jack Robison
46e31d5b45
getPeersForBlob inlinecallbacks refactor 2017-10-10 13:12:47 -04:00
Jack Robison
8e9f3c90a1
use looping call for Node.change_token to avoid hanging delayedCalls 2017-10-10 13:10:47 -04:00
Jack Robison
f1980f524e
fix raising remote exceptions 2017-10-10 13:09:25 -04:00
Jack Robison
4a567f7ab1
organize dht errors and interfaces 2017-10-10 13:08:22 -04:00
Akinwale Ariwodola
6ed56804b9 return empty string as default value when docstring is missing 2017-10-09 21:14:16 +01:00
Akinwale Ariwodola
fb6545481b refactored one more assert 2017-10-09 20:41:08 +01:00
Akinwale Ariwodola
4f6f226b18 refactor asserts due to PYTHONOPTIMIZE flag 2017-10-09 20:20:58 +01:00
Jack Robison
777cda2cd3
Bump version 0.17.0rc12 --> 0.17.0rc13
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-09 10:40:23 -04:00
Jack Robison
7898b9c2d8
Merge branch 'master' into add_more_session_info 2017-10-09 10:39:48 -04:00
Jack Robison
e4cc87b8f0
Bump version 0.17.0rc11 --> 0.17.0rc12
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-09 10:30:36 -04:00
Kay Kurokawa
043758c11f rename moved_verified_blob as saved_verified_blob 2017-10-06 17:05:16 -04:00
Kay Kurokawa
d9cc81766d
use DeferredLock instead of threading.Lock() as it can cause deadlocks 2017-10-06 17:05:10 -04:00
Kay Kurokawa
2115919c55
Add test when mutliple writers call _save_verified_blob at once, this will cause deadlock 2017-10-06 16:34:45 -04:00
Jack Robison
d1511cba54 fix reading sd blob
TODO: add __enter__ and __exit__ methods to HashBlobReader to let it be
used as a contextmanager
2017-10-05 17:58:18 -04:00
Kay Kurokawa
db0bc92087
add unit tests for should annouce functions in BlobManager 2017-10-05 13:59:50 -04:00
Kay Kurokawa
1f839fe2a6
add blob announcement information to session_status 2017-10-05 13:59:27 -04:00
Kay Kurokawa
0a919c3eab fix inconsistency in how blob_hashes_to_send is used, preventing proper reflecting 2017-10-03 11:22:07 -04:00
Kay Kurokawa
6268e43509 make sure to close blob files when connection is lost on reflector client 2017-10-02 16:30:58 -04:00
Kay Kurokawa
d33ebd60c4 fix to not reflect all the files at once 2017-10-02 16:30:58 -04:00
Jack Robison
64a4c47536
Bump version 0.17.0rc10 --> 0.17.0rc11
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-02 10:12:19 -07:00
Jack Robison
33a95abeac
Merge branch 'tests_to_lbrynet' 2017-10-02 10:06:12 -07:00
Akinwale Ariwodola
63dd57aaea fixed long string concatenation and merged with master 2017-10-02 17:13:45 +01:00
Jack Robison
b22c9c0f25
Bump version 0.17.0rc9 --> 0.17.0rc10
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-02 11:30:05 -04:00
Jack Robison
a0817840c5
Bump version 0.17.0rc8 --> 0.17.0rc9
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-10-02 11:22:44 -04:00
Jack Robison
aa3982f0e2
temporarily disable blob analytics 2017-10-02 11:21:51 -04:00
Jack Robison
6a7982022a
Bump version 0.17.0rc7 --> 0.17.0rc8
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-29 12:37:57 -04:00
Jack Robison
838436d641
Merge remote-tracking branch 'origin/fix_blob_reader_closing' 2017-09-29 12:37:15 -04:00
Akinwale Ariwodola
91498822ae fixed all pylint errors 2017-09-29 11:44:22 +01:00
Jack Robison
5ac60cf2c2
Bump version 0.17.0rc6 --> 0.17.0rc7
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-28 17:46:47 -04:00
Jack Robison
b85a813aaf
fix sd timeout 2017-09-28 17:36:55 -04:00
Jack Robison
89ef5620a4
Bump version 0.17.0rc5 --> 0.17.0rc6
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-28 16:08:15 -04:00
Jack Robison
2ebb9da108
move download_failed 2017-09-28 15:46:02 -04:00
Jack Robison
c6db4b187a
fix error name 2017-09-28 15:45:24 -04:00
Jack Robison
b7bfb259e5
fix download exceptions 2017-09-28 15:28:39 -04:00
Jack Robison
9fd60c823f
add _download_failed errback 2017-09-28 15:28:37 -04:00
Jack Robison
82a2805aaf
json blobs 2017-09-28 15:28:06 -04:00
Jack Robison
50b51569a3
cancel streams on shutdown 2017-09-28 14:48:05 -04:00
Jack Robison
fa83a4f671
fix stop condition 2017-09-28 14:04:03 -04:00
Jack Robison
c9ae251d60
download analytics 2017-09-28 14:04:03 -04:00
Jack Robison
af99edc764
add get_host_downloaded_from 2017-09-28 14:04:03 -04:00
Jack Robison
9de4657a4d
fix blob history and callback from _download_succeeded
previously _download_succeeded did not block on blob_completed,
presumably because even longer ago it did not block on a deriving
immediate_announce call and thus took a long time to return
2017-09-28 14:04:02 -04:00
Jack Robison
250855d45d
stop failed downloader outside of GetStream 2017-09-28 14:04:02 -04:00
Jack Robison
b0a3771ccf
better download errors 2017-09-28 14:04:02 -04:00
Akinwale Ariwodola
2abe85ba25 moved tests into the lbrynet package 2017-09-28 18:21:26 +01:00
Kay Kurokawa
533835a732 add comments and docstrings 2017-09-27 17:40:52 -04:00
Kay Kurokawa
a4ea49cf65 read handle was not being closed after file transfer 2017-09-27 17:30:20 -04:00
Kay Kurokawa
aab43c8d6c close the reader directly instead of calling close_read_handle() 2017-09-27 17:30:20 -04:00
Kay Kurokawa
f6da00cbab no need to catch IOError exception here, let it propagage 2017-09-27 17:30:20 -04:00
Kay Kurokawa
3b5690614c Return HashBlobReader instead of file handle in open_for_reading() 2017-09-27 17:30:20 -04:00
Kay Kurokawa
09e25ba285 add reader, for BlobFile, change original reader to v0 2017-09-27 17:30:20 -04:00
Jack Robison
df9cec66be
Bump version 0.17.0rc4 --> 0.17.0rc5
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-26 16:53:27 -04:00
Jack Robison
53456c61b8
Bump version 0.17.0rc3 --> 0.17.0rc4
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-25 19:11:10 -04:00
Jack Robison
8847e07f87
Bump version 0.17.0rc2 --> 0.17.0rc3
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-25 13:30:10 -04:00
Kay Kurokawa
0fc116fbdb Change to reflector2 in conf 2017-09-25 13:18:07 -04:00
Jack Robison
d2de0911b3
Bump version 0.17.0rc1 --> 0.17.0rc2
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-22 14:57:32 -04:00
Kay Kurokawa
cc98cdf933
announce_head_blobs_only is True by default 2017-09-22 14:46:28 -04:00
Jack Robison
4b8700268f
discover stream info for uploads via reflector v1 2017-09-22 14:46:23 -04:00
Kay Kurokawa
4d5ba94a6e
add tests for checking stream info on reflector server 2017-09-22 14:39:37 -04:00
Kay Kurokawa
32feb628c3
add stream_info_manager to reflector server initialization 2017-09-22 14:39:29 -04:00
Kay Kurokawa
1a8e11ead3
work on reflector head blob announce only 2017-09-22 14:39:28 -04:00
Jack Robison
5503b0f290
Bump version 0.16.1 --> 0.17.0rc1
Signed-off-by: Jack Robison <jackrobison@lbry.io>
2017-09-22 14:38:57 -04:00
Miroslav Kovar
0fca867ec0 Modified check_connection() to try bypassing DNS before giving up. 2017-09-20 23:36:08 +02:00
Jack Robison
6cbe86d057
rename is_validated() to get_is_verified() to distinguish from verified property 2017-09-20 14:02:34 -04:00
Jack Robison
ffbcd82263
fix redundant blob request to peer 2017-09-20 13:59:29 -04:00
Kay Kurokawa
ab3c987034
fix lints 2017-09-20 13:59:28 -04:00
Jack Robison
b6e9aa420c
fix cancelled blob request? 2017-09-20 13:59:28 -04:00
Kay Kurokawa
e50ade85be
catch IOError properly 2017-09-20 13:59:28 -04:00
Kay Kurokawa
ea49cddf52
catch IOError when writing 2017-09-20 13:59:28 -04:00
Jack Robison
85f25a8d99
remove debug logging 2017-09-20 13:59:27 -04:00
Jack Robison
19ff0941f5
fix ClientProtocol. _handle_response_error 2017-09-20 13:59:27 -04:00
Jack Robison
adf89a9d1a
logging 2017-09-20 13:59:27 -04:00
Jack Robison
8419e1e1d5
change some ValueErrors to IOErrors 2017-09-20 13:59:26 -04:00
Jack Robison
421141b958
raise instead of assert 2017-09-20 13:59:26 -04:00
Jack Robison
96357ab833
exchange rate error 2017-09-20 13:59:26 -04:00
Jack Robison
b9b5e755db
raise rather than assert 2017-09-20 13:59:26 -04:00