Commit graph

700 commits

Author SHA1 Message Date
Jack Robison
33945e14d3
use _value_producer in peer_list to match the downloader behavior 2019-08-19 12:08:17 -04:00
Jack Robison
1d9705fb17
reuse blob protocol object instead of transport 2019-08-19 12:08:17 -04:00
Jack Robison
1949937b5e
bump aioupnp requirement to 0.0.14 2019-08-19 10:51:20 -04:00
Lex Berezhny
956e21269e monitor wallet server block transitions and report if new block is excessively delayed 2019-08-19 09:52:37 -04:00
Alex Grin
ff73418fc1
Merge pull request #2371 from lbryio/basenetwork_refactor
refactor basenetwork so each session takes care of itself
2019-08-16 10:19:53 -04:00
Victor Shyba
ab6944b7b0 wallet server: dont fail to start on segwit txs 2019-08-14 10:26:02 -03:00
Victor Shyba
4d741bd200 update lbrycrd to 17, add option to disable segwit for now 2019-08-13 18:07:15 -03:00
Victor Shyba
f3a163b382 fix names and types 2019-08-12 18:16:58 -03:00
Victor Shyba
022d60ec2c both exceptions can be raised, depending on when the call happens 2019-08-12 18:16:57 -03:00
Victor Shyba
5728493abb refactor basenetwork so each session takes care of itself 2019-08-12 18:16:57 -03:00
Lex Berezhny
af1c8ec35c adding missing comma in wallet_server_monitor 2019-08-12 14:16:47 -04:00
Lex Berezhny
cb84abfb88 v0.39.0 2019-08-12 13:01:16 -04:00
Jack Robison
357ce881a6
more blob exchange tests 2019-08-12 10:47:28 -04:00
Jack Robison
aa417f5410
test max request size 2019-08-12 10:47:28 -04:00
Jack Robison
0ca29b9518
test idle timeout 2019-08-12 10:47:28 -04:00
Jack Robison
22db04068e
add server side timeouts for idle blob exchange connections and slow transfers 2019-08-12 10:47:28 -04:00
Jack Robison
65e74281e0
max request size 2019-08-12 10:47:28 -04:00
Lex Berezhny
46d89929ba fixup balance tests and other stuff 2019-08-12 10:22:14 -04:00
Lex Berezhny
1c941a355b regenerate api docs 2019-08-12 10:22:14 -04:00
Lex Berezhny
0d6248fbeb fix torba tests 2019-08-12 10:22:14 -04:00
Lex Berezhny
98d4d00f96 most commands now work across all accounts 2019-08-12 10:22:14 -04:00
Jack Robison
e2d618f472
formatting in time_to_first_byte.py
-pending claim_type being usable in claim_search, don't try downloading channel claims in time_to_first_byte.py
2019-08-12 00:49:33 -04:00
Victor Shyba
13891330d9 check blob hashes from completed_blob_hashes 2019-08-11 19:11:13 -03:00
Jack Robison
b8b42a1fd2
add error_message to ttfb analytics, update tests 2019-08-09 12:55:01 -04:00
Jack Robison
fba1b28615
add connected_servers field to wallet status
-add `wallet_server` to time to first bytes analytics event
2019-08-09 12:54:38 -04:00
Lex Berezhny
98828387e3 slow queries saved to metabase 2019-08-06 20:41:14 -04:00
Lex Berezhny
1c12247b71 updated wallet_server_monitor to update slack 2019-08-06 17:44:31 -04:00
Lex Berezhny
ee10ebd5d7 renamed lbry/scripts/wallet_server_metabase_analytics.py -> lbry/scripts/wallet_server_monitor.py 2019-08-06 16:07:45 -04:00
Lex Berezhny
9937ad6e85 v0.38.7 2019-08-05 13:40:49 -04:00
Jack Robison
60ce393531 remove comment 2019-08-05 13:39:38 -04:00
Jack Robison
bc33cad999 add test for connection failure analytics 2019-08-05 13:39:38 -04:00
Jack Robison
4261b50d9d include connection failure count in ttfb analytics 2019-08-05 13:39:38 -04:00
Jack Robison
e2b3141536 typing 2019-08-05 13:39:38 -04:00
Thomas Zarebczan
266aa1b15d update delete>abandon 2019-08-05 12:42:25 -04:00
Oleg Silkin
b57a7475c5 Fixes comment docs & adds wallet component requirement on comment funcs 2019-08-05 12:42:25 -04:00
Victor Shyba
8cf48eb5f7 move granular balances logic to account method 2019-08-05 11:08:33 -04:00
Victor Shyba
35541bbbb9 new api format, hide subtotals by default 2019-08-05 11:08:33 -04:00
Victor Shyba
59424a3e73 add query to get tips summary for granular balances 2019-08-05 11:08:33 -04:00
Victor Shyba
2056888667 implement tips_received tips_sent, wip, in python for now 2019-08-05 11:08:33 -04:00
Victor Shyba
1e54785742 add granular balances 2019-08-05 11:08:33 -04:00
Lex Berezhny
a58ed6f331 wallet server metabase analytics script 2019-08-05 09:23:47 -04:00
Lex Berezhny
e9098887fb script to check channel signature 2019-08-01 17:27:54 -04:00
Jack Robison
221585908a
re-raise unexpected resolve error during download as a ResolveError 2019-07-29 17:56:30 -04:00
Jack Robison
f4c111f04c
handle null content fee 2019-07-29 17:56:24 -04:00
Alex Grin
de12e25450 v0.38.6 2019-07-29 15:11:18 -04:00
Oleg Silkin
2545ebbece Adds unittests & fixes comment_client functions 2019-07-29 14:55:42 -04:00
Oleg Silkin
14ec6ce43b Adds unit-testing for delete comment signatures 2019-07-29 14:55:42 -04:00
Oleg Silkin
0cac1e65aa Imports comment_client and uses dot notation for rest of modules 2019-07-29 14:55:42 -04:00
Oleg Silkin
1e4d57ab83 Simplifies signing function into one to make API symmetric 2019-07-29 14:55:42 -04:00
Oleg Silkin
49b42b7e03 Simplifies 2019-07-29 14:55:42 -04:00
Oleg Silkin
89c0b5dbdf adds comment abandon function 2019-07-29 14:55:42 -04:00
Lex Berezhny
8138675808 added index for claim_type searches 2019-07-29 14:55:07 -04:00
Jack Robison
356b3c85e5
use app default order_by 2019-07-28 21:42:04 -04:00
Jack Robison
1a0680ead9
update claim_search_performance.py, add new test cases shown by time_to_first_byte.py 2019-07-28 21:22:07 -04:00
Jack Robison
c876d891fa
use perf_counter 2019-07-28 21:18:29 -04:00
Jack Robison
a08232f164
fix claim search kwargs in time to first byte script 2019-07-28 21:18:13 -04:00
Victor Shyba
0f8cf46626
refactor and fix ttfb for new api 2019-07-28 17:33:37 -04:00
Alex Grin
95017b5fc8 v0.38.5 2019-07-25 13:22:54 -04:00
Jack Robison
35e7cc685f
fix logging error 2019-07-24 22:12:51 -04:00
Victor Shyba
2ac4883bda cleanup and fix prober 2019-07-24 22:32:20 -03:00
Victor Shyba
5a7212aebb gotta probe 'em all 2019-07-24 20:26:38 -03:00
Lex Berezhny
3f39cc2955 v0.38.4 2019-07-24 18:02:03 -04:00
Lex Berezhny
8a5bfe884a save channel keys into wallet before broadcasting 2019-07-24 18:00:06 -04:00
Lex Berezhny
046dd53913 add index to filter by fee_amount and order by release_time 2019-07-24 14:27:59 -04:00
Alex Grintsvayg
d2f174635c
add script to monitor wallet servers for slow queries 2019-07-24 13:36:22 -04:00
Lex Berezhny
01a760d8f0 v0.38.3 2019-07-23 17:44:38 -04:00
Victor Shyba
9215d2c9f9 log that checkpoint succeeded 2019-07-23 17:44:13 -04:00
Victor Shyba
0bb09ae91e use checkpoint to speed up 2019-07-23 17:44:13 -04:00
Victor Shyba
6f5a595975 check from final size instead of partials 2019-07-23 17:44:13 -04:00
Victor Shyba
8a69ec062e download headers to disk and repair instead of connecting each 2019-07-23 17:44:13 -04:00
Victor Shyba
45fb673e49 dont fail when s3 is out of reach 2019-07-23 17:44:13 -04:00
Lex Berezhny
93b5f1809e revert to v0.38.2 so we can release v0.38.3 again 2019-07-23 17:43:04 -04:00
Alex Grin
ff05eaae48 v0.38.3 2019-07-23 11:14:20 -04:00
Alex Grin
77235f0ad8 v0.38.2 2019-07-22 17:45:43 -04:00
Alex Grintsvayg
f6a80ba929
Revert "v0.38.2"
This reverts commit 295ceb90d5.
2019-07-22 17:45:12 -04:00
Alex Grin
295ceb90d5 v0.38.2 2019-07-22 13:31:20 -04:00
Victor Shyba
df41a82b23 fix integration test 2019-07-22 11:31:45 -04:00
Alex Grintsvayg
1e6097e3b2
more spv dns entries 2019-07-22 11:24:12 -04:00
Lex Berezhny
521facedc4 script to find max server load 2019-07-22 00:15:05 -04:00
Lex Berezhny
de80a2ba97 fixed 0 results when only filtering by lots of common tags 2019-07-21 19:44:10 -04:00
Lex Berezhny
3afd615447 dont run common tag optimization strategy if there are 5 or more common tags provided 2019-07-20 15:45:15 -04:00
Lex Berezhny
87e52bec0a successfuly run indexes after full wallet server sync 2019-07-20 15:45:15 -04:00
Lex Berezhny
b89f04b1f1 fix claim integration tests 2019-07-20 15:45:15 -04:00
Lex Berezhny
e4f802e5f4 when resolving inside channel break a tie of claims with same effective_amount by using height 2019-07-20 15:45:15 -04:00
Lex Berezhny
16fc2c456f moved executing create index queries outside of a tx 2019-07-20 15:45:15 -04:00
Lex Berezhny
ef7656ae98 removed some dead code 2019-07-20 15:45:15 -04:00
Lex Berezhny
ad2df4871e popular tags are indexed and use different search strategy than less popular tags 2019-07-20 15:45:15 -04:00
Jack Robison
8d5f50b695
improve claim search test script to show sql for nearly interrupted queries 2019-07-19 14:17:21 -04:00
Lex Berezhny
bbc056eef0 added better stats to sqlite_perf_test.py 2019-07-19 11:26:50 -04:00
Jack Robison
82fd3c632e
another claim search performance test case 2019-07-19 10:50:37 -04:00
Jack Robison
dbae939808
claim search performance test 2019-07-19 10:42:38 -04:00
Jack Robison
c2dcacb0de
more test cases 2019-07-19 10:37:15 -04:00
Lex Berezhny
8f45618cd0 added improved effective_amount index covering release_time 2019-07-18 23:24:00 -04:00
Lex Berezhny
29a87c850c fix sqlite_perf_test 2019-07-18 19:54:38 -04:00
Lex Berezhny
08da763327 more metrics cleanup 2019-07-18 19:54:38 -04:00
Lex Berezhny
d7ec3c182d tuples 2019-07-18 19:54:38 -04:00
Lex Berezhny
ffe6418392 fix metrics json response test 2019-07-18 19:54:38 -04:00
Lex Berezhny
88adf3ee27 oops 2019-07-18 19:54:38 -04:00
Lex Berezhny
d5f8af471a pylint 2019-07-18 19:54:38 -04:00
Lex Berezhny
046459a72d refactored websockets and metrics 2019-07-18 19:54:38 -04:00
Lex Berezhny
49b0f59790 added metrics module 2019-07-18 19:54:38 -04:00
Victor Shyba
576ef9c4ed remove unused variable 2019-07-17 18:54:21 -03:00
Victor Shyba
4d64fca9de fix memory blob showing as completed/verified 2019-07-17 18:54:21 -03:00
Victor Shyba
8b1307e1ca file status completed set only if all bytes were written 2019-07-17 18:54:21 -03:00
Victor Shyba
6997ea608d fix reconnect and timeouts 2019-07-16 23:59:28 -03:00
Alex Grintsvayg
d97d738880 remove RCs from release tool 2019-07-16 21:35:21 -04:00
Lex Berezhny
f72b07d0f4 fixup 2019-07-16 21:28:36 -04:00
Lex Berezhny
b89916a3d7 guarded dict access 2019-07-16 21:15:39 -04:00
Lex Berezhny
e4aeb66257 claim_list doesnt blow up 2019-07-16 21:08:51 -04:00
Jack Robison
8fbf82f4ea
filter mutually exclusive tags 2019-07-16 20:05:49 -04:00
Jack Robison
478ae7e657
add claim search performance script 2019-07-16 20:05:49 -04:00
Jack Robison
d319761483
interrupt slow queries and log them for debugging
- add QUERY_TIMEOUT_MS env variable

- return sqlite timeout errors, jsonrpc error code -32000
2019-07-16 20:05:45 -04:00
Lex Berezhny
31284e0c5e dont run empty queries 2019-07-16 13:57:22 -04:00
Lex Berezhny
8e64b1840d added errors key to metrics tracking 2019-07-16 13:39:17 -04:00
Thomas Zarebczan
76a27fdef1 str > list for a few fields 2019-07-16 00:59:06 -04:00
Lex Berezhny
0f1bde2274 pylint 2019-07-16 00:57:53 -04:00
Lex Berezhny
e02a4e44c0 working resolve/search caching 2019-07-16 00:57:53 -04:00
Lex Berezhny
71dc882d5d indexes update 2019-07-16 00:57:53 -04:00
Lex Berezhny
ae4a29d41c prevent duplicate tags 2019-07-16 00:57:53 -04:00
Lex Berezhny
d27a3b6421 support for UN M.49 region codes in language 2019-07-16 00:57:53 -04:00
Lex Berezhny
03a58cf50a added lrucache to search/resolve 2019-07-16 00:57:53 -04:00
Lex Berezhny
6d7aa93157 sqlite_perf_test uses lbry.wallet.server.db.reader 2019-07-16 00:57:53 -04:00
Lex Berezhny
d083910255 refactored metrics gathering for wallet server 2019-07-16 00:57:53 -04:00
Lex Berezhny
db3f9af174 refactored metrics gathering for wallet server 2019-07-16 00:57:53 -04:00
Lex Berezhny
1eebe006ae pylint 2019-07-16 00:57:53 -04:00
Lex Berezhny
0327ce53a6 uncomment imports 2019-07-16 00:57:53 -04:00
Lex Berezhny
dc8b4b5252 instrument wallet.server.db.reader with timer metrics 2019-07-16 00:57:53 -04:00
LBRY bot
1923e6f152 v0.38.1 2019-07-15 12:02:18 -04:00
Lex Berezhny
0d621e085b v0.38.1rc1 2019-07-15 11:58:13 -04:00
Victor Shyba
510d88fff1 remove unused checksum, add typing 2019-07-13 01:21:26 -04:00
Victor Shyba
d9460dcd9e refactor and clean up 2019-07-13 01:21:26 -04:00
Victor Shyba
d0607b6fec make header component use torba headers 2019-07-13 01:21:26 -04:00
Victor Shyba
14f743c493 show status where expected 2019-07-13 01:21:26 -04:00
Victor Shyba
df8fe2e3ef bump header checksum 2019-07-13 01:21:26 -04:00
Victor Shyba
906fea972e remove lost warning message 2019-07-13 01:21:26 -04:00
Victor Shyba
f2944fd33b if no headers, best block hash is genesis 2019-07-13 01:21:26 -04:00
Victor Shyba
dcb1e53aba remove unused network command 2019-07-13 01:21:26 -04:00
Victor Shyba
a4d8508b40 update remote height on demand 2019-07-13 01:21:26 -04:00
Lex Berezhny
c5aeac6898 sqlite performance script measures sql time inside each process individually 2019-07-11 20:10:28 -04:00
Lex Berezhny
b81c801f2d sqlite perf test script 2019-07-11 19:20:58 -04:00
Lex Berezhny
cc098f3090 refactored wallet server db reader to support thread pool and process pool 2019-07-11 14:04:49 -04:00
Lex Berezhny
a73c5aec27 pylint 2019-07-11 14:04:49 -04:00
Lex Berezhny
68b29d9529 multi-process query executor 2019-07-11 14:04:49 -04:00
Alex Grintsvayg
5176feed81 let daemon be shut down before it has fully started. fixes #2231 2019-07-09 16:55:48 -04:00
Lex Berezhny
8c63033461 tx parsing speedup and faster wallet sync 2019-07-09 02:20:56 -04:00
Lex Berezhny
8c878f8e25 claim search uses different tag filtering approaches depeding on query type 2019-07-08 16:33:24 -04:00
Lex Berezhny
99d21e93f3 added --no_totals argument to claim_search 2019-07-07 23:51:32 -04:00
Lex Berezhny
350e610f15 handle invalid fee in old JSON claims 2019-07-06 20:53:03 -04:00
Thomas Zarebczan
4f208b6b31
Merge pull request #2286 from osilkin98/2279-fix
Fixes corner case on comment validation for pending channel
2019-07-03 14:14:47 -04:00
Thomas Zarebczan
09db71ae7f
Update comment_client.py 2019-07-02 23:39:27 -04:00
Thomas Zarebczan
60dc43340d
use util.aiohttp
Fix certificate errors
2019-07-02 18:38:43 -04:00
Oleg Silkin
256b10bd7d
Merge branch 'master' into 2279-fix 2019-07-02 12:01:00 -04:00
Oleg Silkin
77adcaeb50 Fixes corner case where channel is pending confirmation 2019-07-02 11:58:24 -04:00
Jack Robison
a2953ac9ac
test session bloat from timed out sockets 2019-07-01 11:36:26 -04:00
Jack Robison
4f5a4d9ce0
add track_bandwidth config setting to disable bandwidth usage in status 2019-07-01 09:54:06 -04:00
Lex Berezhny
82f2ad21e1 added IGNORE to insert into trend query 2019-06-28 16:02:54 -04:00
Lex Berezhny
86b46ebf19 fix for has_channel_signature in claim_search 2019-06-26 19:19:10 -04:00
Lex Berezhny
ca999053ae update lbrycrd to v0.12.4.1 2019-06-26 12:40:26 -04:00
Lex Berezhny
8b152f3c96 check for valid fee.currency and fee.amount before processing 2019-06-26 10:44:33 -04:00
Lex Berezhny
c68bfbdf2e v0.38.0 2019-06-25 16:27:01 -04:00
Jack Robison
7e8180fefc fix attribute error if availability_response field is missing 2019-06-25 16:22:02 -04:00
Jack Robison
305226a3bd fix database migration bugs 2019-06-25 16:09:24 -04:00
Lex Berezhny
8195deebe3 updated generated docs 2019-06-25 15:34:32 -04:00
Lex Berezhny
b1982a81dc updated release script to add --start-tag option 2019-06-25 12:50:13 -04:00
Lex Berezhny
18e19213f4 fix fee_amount default on wallet server 2019-06-25 11:04:32 -04:00
Lex Berezhny
6fb67b86f5 added spv4-spv6 2019-06-25 10:42:59 -04:00
Lex Berezhny
a4c15769d0 v0.38.0rc10 2019-06-25 02:01:42 -04:00
Lex Berezhny
d667efa9de remove docker wine based windows build process scripts 2019-06-25 01:33:04 -04:00
Jack Robison
15341aa80e
fix setting the external ip from upnp 2019-06-24 15:39:31 -04:00
Lex Berezhny
3f4895bd40 v0.38.0rc9 2019-06-23 23:42:29 -04:00
Jack Robison
103c93a06c update aioupnp to 0.0.13 2019-06-23 23:39:45 -04:00
Lex Berezhny
9ce93a1da6 added --not_channel_ids and --has_channel_signature 2019-06-23 20:24:35 -04:00
Lex Berezhny
d0e1468acd channel migration better handles missing or invalid certificates 2019-06-23 13:46:02 -04:00
Lex Berezhny
816cde32a9 fix support reorg error 2019-06-23 10:56:59 -04:00
Lex Berezhny
ef39ba26a0 v0.38.0rc8 2019-06-23 00:08:41 -04:00
Lex Berezhny
59ca3d3d16 take_over_height fix 2019-06-22 23:24:56 -04:00
Lex Berezhny
80ff60f0aa added take_over_height to claim search / resolve output 2019-06-22 23:24:56 -04:00
Lex Berezhny
488c2e2f17 searching by fee_amount and fee_currency 2019-06-22 23:24:56 -04:00
Lex Berezhny
9e11fc1e99 dont error when claim search gets invalid channel 2019-06-22 23:24:56 -04:00
Lex Berezhny
a8b590ecbb add tag normalization on storage and on search 2019-06-22 23:24:56 -04:00
Lex Berezhny
8ca8591ed6 wrong test method reverted 2019-06-22 23:24:56 -04:00
Lex Berezhny
e393314423 fix for claims_in_channel not updating on abandoned claim 2019-06-22 23:24:56 -04:00
Lex Berezhny
0a6eb76542 cleaned up make idea 2019-06-21 11:39:35 -04:00
Lex Berezhny
e6d42b5319 .idea directory now requires running make idea first 2019-06-21 11:26:58 -04:00
Lex Berezhny
d8265add2d added coin selection strategy for both prefer_confirmed and only_confirmed 2019-06-21 03:27:22 -04:00
Lex Berezhny
01cd02e4c5 import fix 2019-06-21 03:27:22 -04:00
Alex Grintsvayg
338d1bd8e7 add coin selection strategy config 2019-06-21 03:27:22 -04:00
Lex Berezhny
7dedaeeef7 remaining lbry -> lbry-sdk changes 2019-06-20 23:13:57 -04:00
Lex Berezhny
fe7224e537 residual fixes after lbrynet -> lbry move 2019-06-20 22:50:39 -04:00
Lex Berezhny
f5e38f6e23 updated imports after moving lbrynet -> lbry 2019-06-20 22:50:39 -04:00
Lex Berezhny
ee6f511126 moved lbrynet -> lbry 2019-06-20 22:50:39 -04:00
Lex Berezhny
7061a62e88 set correct directory in Docker build 2019-06-20 22:50:39 -04:00
Lex Berezhny
133fceeee5 fixing docker build 2019-06-20 22:50:39 -04:00
Lex Berezhny
5bbba0b65a updated windows build 2019-06-20 22:50:39 -04:00
Lex Berezhny
07a63b2a0a moved lbry.png into lbry 2019-06-20 22:50:39 -04:00
Lex Berezhny
2b6f5fde13 moved more lbry files into lbry dir 2019-06-20 22:50:39 -04:00
Lex Berezhny
d4b006656d torba integration test 2019-06-20 22:50:39 -04:00
Lex Berezhny
1ec1ad19f8 pin to mypy==0.701 2019-06-20 22:50:39 -04:00
Lex Berezhny
8b145cb1d8 combined .travis.yml 2019-06-20 22:50:39 -04:00
Lex Berezhny
85d7adc0b5 moved lbrynet into lbry directory 2019-06-20 22:50:39 -04:00