Commit graph

801 commits

Author SHA1 Message Date
Oleg Silkin
49b42b7e03 Simplifies 2019-07-29 14:55:42 -04:00
Oleg Silkin
89c0b5dbdf adds comment abandon function 2019-07-29 14:55:42 -04:00
Lex Berezhny
8138675808 added index for claim_type searches 2019-07-29 14:55:07 -04:00
Jack Robison
356b3c85e5
use app default order_by 2019-07-28 21:42:04 -04:00
Jack Robison
1a0680ead9
update claim_search_performance.py, add new test cases shown by time_to_first_byte.py 2019-07-28 21:22:07 -04:00
Jack Robison
c876d891fa
use perf_counter 2019-07-28 21:18:29 -04:00
Jack Robison
a08232f164
fix claim search kwargs in time to first byte script 2019-07-28 21:18:13 -04:00
Victor Shyba
0f8cf46626
refactor and fix ttfb for new api 2019-07-28 17:33:37 -04:00
Alex Grin
95017b5fc8 v0.38.5 2019-07-25 13:22:54 -04:00
Jack Robison
35e7cc685f
fix logging error 2019-07-24 22:12:51 -04:00
Victor Shyba
2ac4883bda cleanup and fix prober 2019-07-24 22:32:20 -03:00
Victor Shyba
5a7212aebb gotta probe 'em all 2019-07-24 20:26:38 -03:00
Lex Berezhny
3f39cc2955 v0.38.4 2019-07-24 18:02:03 -04:00
Lex Berezhny
8a5bfe884a save channel keys into wallet before broadcasting 2019-07-24 18:00:06 -04:00
Lex Berezhny
046dd53913 add index to filter by fee_amount and order by release_time 2019-07-24 14:27:59 -04:00
Alex Grintsvayg
d2f174635c
add script to monitor wallet servers for slow queries 2019-07-24 13:36:22 -04:00
Lex Berezhny
01a760d8f0 v0.38.3 2019-07-23 17:44:38 -04:00
Victor Shyba
9215d2c9f9 log that checkpoint succeeded 2019-07-23 17:44:13 -04:00
Victor Shyba
0bb09ae91e use checkpoint to speed up 2019-07-23 17:44:13 -04:00
Victor Shyba
6f5a595975 check from final size instead of partials 2019-07-23 17:44:13 -04:00
Victor Shyba
8a69ec062e download headers to disk and repair instead of connecting each 2019-07-23 17:44:13 -04:00
Victor Shyba
45fb673e49 dont fail when s3 is out of reach 2019-07-23 17:44:13 -04:00
Lex Berezhny
93b5f1809e revert to v0.38.2 so we can release v0.38.3 again 2019-07-23 17:43:04 -04:00
Alex Grin
ff05eaae48 v0.38.3 2019-07-23 11:14:20 -04:00
Alex Grin
77235f0ad8 v0.38.2 2019-07-22 17:45:43 -04:00
Alex Grintsvayg
f6a80ba929
Revert "v0.38.2"
This reverts commit 295ceb90d5.
2019-07-22 17:45:12 -04:00
Alex Grin
295ceb90d5 v0.38.2 2019-07-22 13:31:20 -04:00
Victor Shyba
df41a82b23 fix integration test 2019-07-22 11:31:45 -04:00
Alex Grintsvayg
1e6097e3b2
more spv dns entries 2019-07-22 11:24:12 -04:00
Lex Berezhny
521facedc4 script to find max server load 2019-07-22 00:15:05 -04:00
Lex Berezhny
de80a2ba97 fixed 0 results when only filtering by lots of common tags 2019-07-21 19:44:10 -04:00
Lex Berezhny
3afd615447 dont run common tag optimization strategy if there are 5 or more common tags provided 2019-07-20 15:45:15 -04:00
Lex Berezhny
87e52bec0a successfuly run indexes after full wallet server sync 2019-07-20 15:45:15 -04:00
Lex Berezhny
b89f04b1f1 fix claim integration tests 2019-07-20 15:45:15 -04:00
Lex Berezhny
e4f802e5f4 when resolving inside channel break a tie of claims with same effective_amount by using height 2019-07-20 15:45:15 -04:00
Lex Berezhny
16fc2c456f moved executing create index queries outside of a tx 2019-07-20 15:45:15 -04:00
Lex Berezhny
ef7656ae98 removed some dead code 2019-07-20 15:45:15 -04:00
Lex Berezhny
ad2df4871e popular tags are indexed and use different search strategy than less popular tags 2019-07-20 15:45:15 -04:00
Jack Robison
8d5f50b695
improve claim search test script to show sql for nearly interrupted queries 2019-07-19 14:17:21 -04:00
Lex Berezhny
bbc056eef0 added better stats to sqlite_perf_test.py 2019-07-19 11:26:50 -04:00
Jack Robison
82fd3c632e
another claim search performance test case 2019-07-19 10:50:37 -04:00
Jack Robison
dbae939808
claim search performance test 2019-07-19 10:42:38 -04:00
Jack Robison
c2dcacb0de
more test cases 2019-07-19 10:37:15 -04:00
Lex Berezhny
8f45618cd0 added improved effective_amount index covering release_time 2019-07-18 23:24:00 -04:00
Lex Berezhny
29a87c850c fix sqlite_perf_test 2019-07-18 19:54:38 -04:00
Lex Berezhny
08da763327 more metrics cleanup 2019-07-18 19:54:38 -04:00
Lex Berezhny
d7ec3c182d tuples 2019-07-18 19:54:38 -04:00
Lex Berezhny
ffe6418392 fix metrics json response test 2019-07-18 19:54:38 -04:00
Lex Berezhny
88adf3ee27 oops 2019-07-18 19:54:38 -04:00
Lex Berezhny
d5f8af471a pylint 2019-07-18 19:54:38 -04:00
Lex Berezhny
046459a72d refactored websockets and metrics 2019-07-18 19:54:38 -04:00
Lex Berezhny
49b0f59790 added metrics module 2019-07-18 19:54:38 -04:00
Victor Shyba
576ef9c4ed remove unused variable 2019-07-17 18:54:21 -03:00
Victor Shyba
4d64fca9de fix memory blob showing as completed/verified 2019-07-17 18:54:21 -03:00
Victor Shyba
8b1307e1ca file status completed set only if all bytes were written 2019-07-17 18:54:21 -03:00
Victor Shyba
6997ea608d fix reconnect and timeouts 2019-07-16 23:59:28 -03:00
Alex Grintsvayg
d97d738880 remove RCs from release tool 2019-07-16 21:35:21 -04:00
Lex Berezhny
f72b07d0f4 fixup 2019-07-16 21:28:36 -04:00
Lex Berezhny
b89916a3d7 guarded dict access 2019-07-16 21:15:39 -04:00
Lex Berezhny
e4aeb66257 claim_list doesnt blow up 2019-07-16 21:08:51 -04:00
Jack Robison
8fbf82f4ea
filter mutually exclusive tags 2019-07-16 20:05:49 -04:00
Jack Robison
478ae7e657
add claim search performance script 2019-07-16 20:05:49 -04:00
Jack Robison
d319761483
interrupt slow queries and log them for debugging
- add QUERY_TIMEOUT_MS env variable

- return sqlite timeout errors, jsonrpc error code -32000
2019-07-16 20:05:45 -04:00
Lex Berezhny
31284e0c5e dont run empty queries 2019-07-16 13:57:22 -04:00
Lex Berezhny
8e64b1840d added errors key to metrics tracking 2019-07-16 13:39:17 -04:00
Thomas Zarebczan
76a27fdef1 str > list for a few fields 2019-07-16 00:59:06 -04:00
Lex Berezhny
0f1bde2274 pylint 2019-07-16 00:57:53 -04:00
Lex Berezhny
e02a4e44c0 working resolve/search caching 2019-07-16 00:57:53 -04:00
Lex Berezhny
71dc882d5d indexes update 2019-07-16 00:57:53 -04:00
Lex Berezhny
ae4a29d41c prevent duplicate tags 2019-07-16 00:57:53 -04:00
Lex Berezhny
d27a3b6421 support for UN M.49 region codes in language 2019-07-16 00:57:53 -04:00
Lex Berezhny
03a58cf50a added lrucache to search/resolve 2019-07-16 00:57:53 -04:00
Lex Berezhny
6d7aa93157 sqlite_perf_test uses lbry.wallet.server.db.reader 2019-07-16 00:57:53 -04:00
Lex Berezhny
d083910255 refactored metrics gathering for wallet server 2019-07-16 00:57:53 -04:00
Lex Berezhny
db3f9af174 refactored metrics gathering for wallet server 2019-07-16 00:57:53 -04:00
Lex Berezhny
1eebe006ae pylint 2019-07-16 00:57:53 -04:00
Lex Berezhny
0327ce53a6 uncomment imports 2019-07-16 00:57:53 -04:00
Lex Berezhny
dc8b4b5252 instrument wallet.server.db.reader with timer metrics 2019-07-16 00:57:53 -04:00
LBRY bot
1923e6f152 v0.38.1 2019-07-15 12:02:18 -04:00
Lex Berezhny
0d621e085b v0.38.1rc1 2019-07-15 11:58:13 -04:00
Victor Shyba
510d88fff1 remove unused checksum, add typing 2019-07-13 01:21:26 -04:00
Victor Shyba
d9460dcd9e refactor and clean up 2019-07-13 01:21:26 -04:00
Victor Shyba
d0607b6fec make header component use torba headers 2019-07-13 01:21:26 -04:00
Victor Shyba
14f743c493 show status where expected 2019-07-13 01:21:26 -04:00
Victor Shyba
df8fe2e3ef bump header checksum 2019-07-13 01:21:26 -04:00
Victor Shyba
906fea972e remove lost warning message 2019-07-13 01:21:26 -04:00
Victor Shyba
f2944fd33b if no headers, best block hash is genesis 2019-07-13 01:21:26 -04:00
Victor Shyba
dcb1e53aba remove unused network command 2019-07-13 01:21:26 -04:00
Victor Shyba
a4d8508b40 update remote height on demand 2019-07-13 01:21:26 -04:00
Lex Berezhny
c5aeac6898 sqlite performance script measures sql time inside each process individually 2019-07-11 20:10:28 -04:00
Lex Berezhny
b81c801f2d sqlite perf test script 2019-07-11 19:20:58 -04:00
Lex Berezhny
cc098f3090 refactored wallet server db reader to support thread pool and process pool 2019-07-11 14:04:49 -04:00
Lex Berezhny
a73c5aec27 pylint 2019-07-11 14:04:49 -04:00
Lex Berezhny
68b29d9529 multi-process query executor 2019-07-11 14:04:49 -04:00
Alex Grintsvayg
5176feed81 let daemon be shut down before it has fully started. fixes #2231 2019-07-09 16:55:48 -04:00
Lex Berezhny
8c63033461 tx parsing speedup and faster wallet sync 2019-07-09 02:20:56 -04:00
Lex Berezhny
8c878f8e25 claim search uses different tag filtering approaches depeding on query type 2019-07-08 16:33:24 -04:00
Lex Berezhny
99d21e93f3 added --no_totals argument to claim_search 2019-07-07 23:51:32 -04:00
Lex Berezhny
350e610f15 handle invalid fee in old JSON claims 2019-07-06 20:53:03 -04:00
Thomas Zarebczan
4f208b6b31
Merge pull request #2286 from osilkin98/2279-fix
Fixes corner case on comment validation for pending channel
2019-07-03 14:14:47 -04:00
Thomas Zarebczan
09db71ae7f
Update comment_client.py 2019-07-02 23:39:27 -04:00
Thomas Zarebczan
60dc43340d
use util.aiohttp
Fix certificate errors
2019-07-02 18:38:43 -04:00
Oleg Silkin
256b10bd7d
Merge branch 'master' into 2279-fix 2019-07-02 12:01:00 -04:00
Oleg Silkin
77adcaeb50 Fixes corner case where channel is pending confirmation 2019-07-02 11:58:24 -04:00
Jack Robison
a2953ac9ac
test session bloat from timed out sockets 2019-07-01 11:36:26 -04:00
Jack Robison
4f5a4d9ce0
add track_bandwidth config setting to disable bandwidth usage in status 2019-07-01 09:54:06 -04:00
Lex Berezhny
82f2ad21e1 added IGNORE to insert into trend query 2019-06-28 16:02:54 -04:00
Lex Berezhny
86b46ebf19 fix for has_channel_signature in claim_search 2019-06-26 19:19:10 -04:00
Lex Berezhny
ca999053ae update lbrycrd to v0.12.4.1 2019-06-26 12:40:26 -04:00
Lex Berezhny
8b152f3c96 check for valid fee.currency and fee.amount before processing 2019-06-26 10:44:33 -04:00
Lex Berezhny
c68bfbdf2e v0.38.0 2019-06-25 16:27:01 -04:00
Jack Robison
7e8180fefc fix attribute error if availability_response field is missing 2019-06-25 16:22:02 -04:00
Jack Robison
305226a3bd fix database migration bugs 2019-06-25 16:09:24 -04:00
Lex Berezhny
8195deebe3 updated generated docs 2019-06-25 15:34:32 -04:00
Lex Berezhny
b1982a81dc updated release script to add --start-tag option 2019-06-25 12:50:13 -04:00
Lex Berezhny
18e19213f4 fix fee_amount default on wallet server 2019-06-25 11:04:32 -04:00
Lex Berezhny
6fb67b86f5 added spv4-spv6 2019-06-25 10:42:59 -04:00
Lex Berezhny
a4c15769d0 v0.38.0rc10 2019-06-25 02:01:42 -04:00
Lex Berezhny
d667efa9de remove docker wine based windows build process scripts 2019-06-25 01:33:04 -04:00
Jack Robison
15341aa80e
fix setting the external ip from upnp 2019-06-24 15:39:31 -04:00
Lex Berezhny
3f4895bd40 v0.38.0rc9 2019-06-23 23:42:29 -04:00
Jack Robison
103c93a06c update aioupnp to 0.0.13 2019-06-23 23:39:45 -04:00
Lex Berezhny
9ce93a1da6 added --not_channel_ids and --has_channel_signature 2019-06-23 20:24:35 -04:00
Lex Berezhny
d0e1468acd channel migration better handles missing or invalid certificates 2019-06-23 13:46:02 -04:00
Lex Berezhny
816cde32a9 fix support reorg error 2019-06-23 10:56:59 -04:00
Lex Berezhny
ef39ba26a0 v0.38.0rc8 2019-06-23 00:08:41 -04:00
Lex Berezhny
59ca3d3d16 take_over_height fix 2019-06-22 23:24:56 -04:00
Lex Berezhny
80ff60f0aa added take_over_height to claim search / resolve output 2019-06-22 23:24:56 -04:00
Lex Berezhny
488c2e2f17 searching by fee_amount and fee_currency 2019-06-22 23:24:56 -04:00
Lex Berezhny
9e11fc1e99 dont error when claim search gets invalid channel 2019-06-22 23:24:56 -04:00
Lex Berezhny
a8b590ecbb add tag normalization on storage and on search 2019-06-22 23:24:56 -04:00
Lex Berezhny
8ca8591ed6 wrong test method reverted 2019-06-22 23:24:56 -04:00
Lex Berezhny
e393314423 fix for claims_in_channel not updating on abandoned claim 2019-06-22 23:24:56 -04:00
Lex Berezhny
0a6eb76542 cleaned up make idea 2019-06-21 11:39:35 -04:00
Lex Berezhny
e6d42b5319 .idea directory now requires running make idea first 2019-06-21 11:26:58 -04:00
Lex Berezhny
d8265add2d added coin selection strategy for both prefer_confirmed and only_confirmed 2019-06-21 03:27:22 -04:00
Lex Berezhny
01cd02e4c5 import fix 2019-06-21 03:27:22 -04:00
Alex Grintsvayg
338d1bd8e7 add coin selection strategy config 2019-06-21 03:27:22 -04:00
Lex Berezhny
7dedaeeef7 remaining lbry -> lbry-sdk changes 2019-06-20 23:13:57 -04:00
Lex Berezhny
fe7224e537 residual fixes after lbrynet -> lbry move 2019-06-20 22:50:39 -04:00
Lex Berezhny
f5e38f6e23 updated imports after moving lbrynet -> lbry 2019-06-20 22:50:39 -04:00
Lex Berezhny
ee6f511126 moved lbrynet -> lbry 2019-06-20 22:50:39 -04:00
Lex Berezhny
7061a62e88 set correct directory in Docker build 2019-06-20 22:50:39 -04:00
Lex Berezhny
133fceeee5 fixing docker build 2019-06-20 22:50:39 -04:00
Lex Berezhny
5bbba0b65a updated windows build 2019-06-20 22:50:39 -04:00
Lex Berezhny
07a63b2a0a moved lbry.png into lbry 2019-06-20 22:50:39 -04:00
Lex Berezhny
2b6f5fde13 moved more lbry files into lbry dir 2019-06-20 22:50:39 -04:00
Lex Berezhny
d4b006656d torba integration test 2019-06-20 22:50:39 -04:00
Lex Berezhny
1ec1ad19f8 pin to mypy==0.701 2019-06-20 22:50:39 -04:00
Lex Berezhny
8b145cb1d8 combined .travis.yml 2019-06-20 22:50:39 -04:00
Lex Berezhny
85d7adc0b5 moved lbrynet into lbry directory 2019-06-20 22:50:39 -04:00