Commit graph

737 commits

Author SHA1 Message Date
Victor Shyba
7f88dda0ae use treq on loggly 2018-05-05 02:18:03 -03:00
Victor Shyba
0bf65836c7 resume download from S3 instead of starting from scratch 2018-05-05 02:05:02 -03:00
Victor Shyba
3982e15091 download headers from s3 using treq 2018-05-05 01:16:26 -03:00
Jack Robison
cc34c4b95f
Merge pull request #1189 from lbryio/faster-headers
magic
2018-05-04 11:10:43 -04:00
Thomas Zarebczan
df2339231a
magic 2018-05-04 00:47:08 -04:00
Jack Robison
6977d6944e
show local, remote, and s3 header heights in the log 2018-05-02 17:25:00 -04:00
Jack Robison
129d2687b9
download headers from s3 when more than 10 chunks behind 2018-05-02 15:00:50 -04:00
Jack Robison
1f1b348638
fix handling ancient non-decodable claims 2018-04-19 17:37:23 -04:00
Jack Robison
b89823c968
fix blob announce locking up the daemon process 2018-04-19 15:47:19 -04:00
Jack Robison
769bc2e36e
Revert "elif"
This reverts commit c3e047a2aa.
2018-04-19 14:34:49 -04:00
Alex Grintsvayg
c3e047a2aa elif 2018-04-19 13:47:24 -04:00
Jack Robison
fa49b40389
fix claim_show 2018-04-19 12:31:36 -04:00
Jack Robison
a41bbd5e27
pylint and tests 2018-03-28 18:50:18 -04:00
Jack Robison
c5bf64cf0a
refactor DHTHashAnnouncer
-remove hash_announcer from Node and DiskBlobManager
-remove announcement related functions from DiskBlobManager
-update SQLiteStorage to store announcement times and provide blob hashes needing to be announced
-use dataExpireTimeout from lbrynet.dht.constants for re-announce timing
-use DeferredSemaphore for concurrent blob announcement
2018-03-28 15:53:51 -04:00
Lex Berezhny
267f50474b
removing more references to PTCWallet 2018-03-28 15:53:50 -04:00
Lex Berezhny
866f220d9b
removed PTCWallet 2018-03-28 15:53:50 -04:00
Lex Berezhny
339e666f38
+ Wallet.wait_for_tx_in_wallet 2018-03-28 15:53:49 -04:00
Jack Robison
5628d0825b
add CallLaterManager 2018-03-28 15:53:49 -04:00
Jack Robison
88970cb0a8
move peer manager class to lbrynet.core 2018-03-28 15:53:49 -04:00
Jack Robison
04e76443c6
move dht node component setup from Session into Node 2018-03-28 15:53:47 -04:00
Jack Robison
e6caedac91
remove DHTHashSupplier class, move former functions into DHTHashAnnouncer 2018-03-28 15:53:47 -04:00
Jack Robison
efaa97216f
move dht node setup back into node class 2018-03-28 15:53:47 -04:00
Jack Robison
e30ea50ef4
more 2018-03-28 15:53:47 -04:00
Jack Robison
3296c0fb3d
move dht related classes to lbrynet.dht 2018-03-28 15:53:47 -04:00
Kay Kurokawa
9088d152b5
better to keey track of retry count in function instead of unbounded dictionary 2018-03-28 15:53:46 -04:00
Kay Kurokawa
4cb461601e
result must be set here, otherwise it will not be defined when used later. Add test for it 2018-03-28 15:53:46 -04:00
Kay Kurokawa
75b977dff9
we just have one supplier not a list of suppliers 2018-03-28 15:53:46 -04:00
Kay Kurokawa
0f3385e4dc
make the single hash announce duration adjustable in DHTHashSupplier 2018-03-28 15:53:46 -04:00
Jack Robison
446c3a88dc
refactor DHTHashAnnouncer and iterativeAnnounceHaveBlob
-use looping call for running manage function rather than a scheduled
callLater

-track announce speed

-retry store requests that failed up to 3 times

-return a dict of {blob_hash: [storing_node_id]} results from
_announce_hashes

_refreshRoutingTable inline cb refactor

-add and use DeferredLockContextManager

-don't trap errback from iterativeFindNode in iterativeAnnounceHaveBlob
2018-03-28 15:53:45 -04:00
Jack Robison
e94d10d3eb
only call get_max_usable_balance_for_claim in Wallet.py if the bid looks too high for the balance 2018-03-14 13:47:34 -04:00
hackrush
16f2a5429b Name and output message fix. 2018-03-13 01:26:18 +05:30
hackrush
f5aadf3918 Sanitized logged error for channel and name claims 2018-03-09 21:28:33 +05:30
hackrush
6d4af4ba90 Error cleanly when claiming a new channel with exact or higher amount than balance
fixes #1107
2018-03-09 21:28:33 +05:30
Jack Robison
81de5fbbf4
verify_will_announce_head_and_sd_blobs 2018-03-08 16:46:39 -05:00
Jack Robison
3f1bcbffeb
fix blob_announce when announcing a single blob 2018-03-07 18:25:30 -05:00
Jack Robison
01c4c6ed97
fetch claim heights 2018-03-02 16:46:02 -05:00
Jack Robison
35426c7350
remove some unused code 2018-03-02 15:34:34 -05:00
Jack Robison
a1aadb0bce
fix join_dht attribute error 2018-03-02 15:13:22 -05:00
Alex Grintsvayg
d086fb9547 only log errors to loggly 2018-03-01 16:31:00 -05:00
Jack Robison
dafa80ce29
Merge branch 'master' into update_fix 2018-02-22 14:10:51 -05:00
Jack Robison
b1c66015e1
detect and remove invalid streams and sd blobs 2018-02-21 19:09:10 -05:00
Jack Robison
73eb66c0f2
pylint 2018-02-21 16:45:12 -05:00
Jack Robison
3e6b00ad00
remove sort from get_stream_hash
error on zero length data blobs or a non-zero length stream terminator blob
2018-02-21 16:34:48 -05:00
Jack Robison
0904c74273
remove unused create_plain_sd function 2018-02-21 16:33:15 -05:00
hackrush
3754f34f53 Review fixes and additional comments in test 2018-02-21 14:22:11 +05:30
hackrush
2368433b22 Check for max usable balance before updating 2018-02-20 08:54:03 +05:30
hackrush
d72ef784ed Removed daemon side bid checks during publish
Fixes #748

Fixed failing test, Yay!

Why CHANGELOG? Why not anarchy?
2018-02-20 08:54:03 +05:30
Jack Robison
68c906aff9
pylint 2018-02-13 10:27:52 -05:00
Jack Robison
e9b9118c2a
whitespace 2018-02-13 10:27:51 -05:00
Jack Robison
f8c33b6acb
refactor lbrynet.core.StreamDescriptor
-remove lbrynet/lbry_file/StreamDescriptor.py
2018-02-13 10:27:50 -05:00
Jack Robison
0b1f4192fc
update Wallet to use SQLiteStorage
-remove CachedClaim and wallet storage classes
2018-02-13 10:27:50 -05:00
Jack Robison
af87df3709
remove sqlite_helpers 2018-02-13 10:27:50 -05:00
Jack Robison
e671005c3c
update BlobManager to use SQLiteStorage, remove old database functions
-remove blob upload/download history
2018-02-13 10:27:50 -05:00
Jack Robison
db7061ce92
set up a SQLiteStorage object in Session 2018-02-13 10:27:50 -05:00
rick batka
69a99a61ba Fix issue #930. Disallow positional arguments for CLI settings_set and fix error reporting when settings_set fails. 2018-02-09 11:30:29 -05:00
Alex Grintsvayg
2f8c645edc download script now gets all blobs in stream if you give it an sd hash 2018-02-07 11:21:34 -05:00
Jack Robison
1c45cf05d7
Merge branch 'atiaxi-blob-list-uri-fix' 2018-02-06 22:55:02 -05:00
Roger Ostrander
d8e1738f27 Code review changes (removed safe_dict_descend) 2018-02-06 01:16:10 -05:00
Antonio Quartulli
8a7e707504
DHTPeerFinder: re-join the network if we have no peers
Periodically check if the routing table is empty and, if so,
re-attempt joining the DHT network.

This check is performed in the main DHTPeerFinder loop every 60 secs.

Closes: #1093
Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2018-02-06 12:33:12 +08:00
Antonio Quartulli
ce0af77aa9
dht_node: split network start and join procedures
In order to attempt to join the DHT several times
(i.e. when the first attempt has failed) we need to
split the components initialization from the real
joining operation.

Create node.startNetwork() to initialize the node
and keep the rest in node.joinNetwork()

Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2018-02-06 12:19:33 +08:00
Roger Ostrander
a4343c3eb3 API call to blob_list with uri parameter now succeeds 2018-02-03 23:08:15 -05:00
Jack Robison
f918916160
remove gmpy and seccure dependencies 2018-02-01 12:39:00 -05:00
Jack Robison
eb4ba089ab
fix checking the external ip 2018-01-22 15:47:14 -05:00
hackrush
7472d12644 Removed include_tip_info from transaction_list, goes with lbryum#183 2018-01-18 08:43:58 +05:30
Kay Kurokawa
1c608a09a9 use reworked lbryum payto command 2018-01-16 13:30:12 -05:00
akinwale
5677f6d00d
added a new startup stage for wallet_unlock (#1048)
* added a new startup stage to indicate if the daemon is waiting for wallet_unlock
2018-01-07 06:44:29 +01:00
Jack Robison
bc58add6de
logging 2018-01-04 21:25:56 -05:00
Jack Robison
6385ab27c1
fix handling stream with no data blobs
fixes https://github.com/lbryio/lbry/issues/905
2018-01-04 21:25:54 -05:00
Jack Robison
09c57675a7
add stream_availability and blob_availability, deprecate get_availability 2017-12-20 21:23:54 -05:00
Jack Robison
7c6c666342
fix verbose error 2017-12-20 20:43:01 -05:00
Jack Robison
f0a1adc9c5
whitespace, logging 2017-12-20 20:43:01 -05:00
Jack Robison
e22d43bb03
fix wallet_unlock 2017-12-18 13:17:54 -05:00
Jack Robison
20b9e4d17e
fix typo 2017-12-18 11:31:59 -05:00
Jack Robison
8c2d381aee Wallet encryption (#783)
* update known commands
* add wallet_unlock, block wallet startup on being unlocked
* add wallet_decrypt and wallet_encrypt
* wallet encryption unit tests
* added use_keyring configuration option in order to make keyring password storage optional
2017-12-17 07:00:12 +01:00
Jack Robison
a6f0c5fb4c
pylint fixes
fix exception formatting and a circular import
2017-12-15 20:25:20 -05:00
Jack Robison
b2141bdf3d
fix import error 2017-12-12 09:26:28 -05:00
Jack Robison
1307727130
revert run commands using deferToThread
reverts most of
https://github.com/lbryio/lbry/commit/100493f9068589095c489f797587ddbfd1
7f7899
2017-12-11 12:45:38 -05:00
Jack Robison
100493f906
run commands using the network as deferToThread, don't manually broadcast claims from lbrynet 2017-12-07 14:36:52 -05:00
Jack Robison
b7ee5419d4
better address use, remove _save_wallet from Wallet.py 2017-12-07 14:36:51 -05:00
Jack Robison
90aa89dcae
re-add outpoint to file dictionary returned from file_ commands 2017-12-06 17:22:47 -05:00
Kay Kurokawa
989f77c00a increase SINGLE_HASH_ANNONCE_DURATION from 1 to 5 2017-12-05 11:55:59 -05:00
Kay Kurokawa
bf29d28c4d
bug fix in claim_renew() 2017-12-05 09:41:43 -05:00
Kay Kurokawa
1ea8c1ad29
no underscore necessary (not a private function) 2017-12-05 09:41:42 -05:00
Jack Robison
d6e3b11026
add claim_renew 2017-12-05 09:41:42 -05:00
Jack Robison
58b789ed42
fix https://github.com/lbryio/lbry/issues/1013 2017-12-05 09:31:29 -05:00
Jack Robison
086c843068
add channel_list, deprecate channel_list_mine 2017-11-22 13:50:07 -05:00
Jack Robison
d98e0e8110
add channel_import and channel_export 2017-11-22 13:46:34 -05:00
Kay Kurokawa
71ebf79939 add argument in DHTPeerFinder.find_peers_for_blob that filters itself from peer list. Use this argument to remove itself from peer list when downloading blobs
do not filter self on peer list
2017-11-07 09:56:40 -05:00
Kay Kurokawa
7e8f3254b1 Add to DHT Node class initialization argument peerPort where it serves blobs, instead of specifying it in announceHaveBlob 2017-11-07 09:56:40 -05:00
Ian Chamberlain
20e9ff2902 Delete blob hash from list when blob is deleted 2017-11-05 21:56:54 -05:00
Alex Grin
fcfde63720
Merge branch 'master' into wallet_list_unspent 2017-11-01 17:35:31 -04:00
Alex Grintsvayg
3152ecfd71 add wallet_list_unspent 2017-11-01 17:29:11 -04:00
Kay Kurokawa
9470b318b0 moved BLOB_SIZE in conf to MAX_BLOB_SIZE constant in blob.blob_file 2017-10-31 15:38:00 -04:00
Jack Robison
cfd4a94450
logging 2017-10-31 12:21:36 -04:00
Jack Robison
f7aa478b9b
remove unused bypass_dns parameter 2017-10-31 12:21:35 -04:00
Jack Robison
3fd542f702
Merge branch 'check_connection_bypass_dns' of https://github.com/mirgee/lbry into mirgee-check_connection_bypass_dns 2017-10-31 12:21:35 -04:00
Antonio Quartulli
d827b4d5af platform ip: ensure daemon retrieves IPv4 address only
When contacting jsonip.com to retrieve the node external IP,
the connection might be established with IPv6 and thus return
an address belonging to that family.

This address is then used to initialize the external_ip member of
Daemon session, but unfortunately IPv6 is not yet handled well.

Using an IPv6 as external IP is currently breaking parts of the
Daemon resulting in no peer connectivity at all.

We should stick to IPv4 for time being.

http://jsonip.com/about says "ipv4-only":"https://ipv4.jsonip.com"

therefore, change the IP retrieval URL to ipv4.jsonip.com to
make sure the connection is established only using an IPv4 address.

Closes: https://github.com/lbryio/lbry/issues/971
Signed-off-by: Antonio Quartulli <antonio@mandelbit.com>
2017-10-31 06:59:40 -04:00
Alex Grintsvayg
357f15c5b8 changes that jack pointed out 2017-10-25 12:36:54 -04:00
Alex Grintsvayg
2067180467 add wallet_prefill_addresses command 2017-10-25 12:29:51 -04:00
Jack Robison
95a0653a58
better upnp redirect 2017-10-24 19:11:19 -04:00