Victor Shyba
508bdb8e94
dht_crawler: keep working set in memory, flush to db on intervals
2022-09-07 12:03:11 -03:00
Victor Shyba
cd42f0d726
dht_crawler: fix node id store
2022-09-07 12:03:11 -03:00
Victor Shyba
2706b66a92
dht_crawler: dont re-bootstrap. try known reachable even when they expire
2022-09-07 12:03:11 -03:00
Victor Shyba
29c2d5715d
dht_crawler: fix last_seen update
2022-09-07 12:03:11 -03:00
Victor Shyba
965389b759
dht_crawler: process older first, avoid discarding
2022-09-07 12:03:11 -03:00
Victor Shyba
174439f517
dht_crawler: cleanup, try not to reset key
2022-09-07 12:03:11 -03:00
Victor Shyba
baf422fc03
dht_crawler: extract refresh_limit, bump to 1h
2022-09-07 12:03:11 -03:00
Victor Shyba
61f7fbe230
dht_crawler: avoid reads
2022-09-07 12:03:11 -03:00
Victor Shyba
c6c27925b7
dht_crawler: flush/commit only when finished
2022-09-07 12:03:11 -03:00
Victor Shyba
be4c62cf32
check membership instead of one update per peer
2022-09-07 12:03:11 -03:00
Victor Shyba
443a1c32fa
dht_crawler: save a set of connections to avoid dupes, enable initial crawl
2022-09-07 12:03:11 -03:00
Victor Shyba
90c2a58470
dht_crawler: dont gather empty, fix crash
2022-09-07 12:03:11 -03:00
Victor Shyba
adc79ec404
dht_crawler: only warn for missing key if it replied
2022-09-07 12:03:11 -03:00
Victor Shyba
137d8ca4ac
dht_crawler: enable WAL
2022-09-07 12:03:11 -03:00
Victor Shyba
abf4d888af
dht_crawler: warn if we cannot get node id
2022-09-07 12:03:11 -03:00
Victor Shyba
6c350e57dd
dht_crawler: query recently checked as stats
2022-09-07 12:03:11 -03:00
Victor Shyba
fb7a93096e
only count checked unreachable
2022-09-07 12:03:11 -03:00
Victor Shyba
7ea88e7b31
dht_crawler: store data
2022-09-07 12:03:11 -03:00
Victor Shyba
2361e34541
dht crawler, initial version
2022-09-07 12:03:11 -03:00
Victor Shyba
318728aebd
add bootstrap flag to routing table
2022-08-11 20:38:42 -03:00
Lex Berezhny
ec82486e15
removed go hub dependency
2022-08-08 14:55:44 -04:00
Lex Berezhny
b8867cd18c
release.py script changed to use gh auth login for authentication
2022-04-10 23:28:16 -04:00
Jack Robison
9faf6e46ca
move lbry.wallet.server to new project called scribe
...
switch from using lbrycrd to lbcd
2022-03-27 23:33:26 -04:00
Victor Shyba
8e6fa3490c
disable CSV endpoints by default
2022-01-12 12:39:23 -03:00
Victor Shyba
8a1a1a4000
remove estimation endpoints as that is done over prometheus metrics now
2022-01-12 12:39:23 -03:00
Victor Shyba
2d9130b4e0
prometheus: move blobs_stored and peers to SDK. add buckets_in_routing_table
2022-01-12 12:39:23 -03:00
Victor Shyba
470ee72462
add passive estimation to prometheus
2022-01-12 12:39:23 -03:00
Victor Shyba
add147b409
fix missing async
2022-01-12 12:39:23 -03:00
Victor Shyba
371df6e6c2
keep same node id between runs
2022-01-12 12:39:23 -03:00
Victor Shyba
7ed5fe8f66
add semaphore on active estimation to avoid abuse
2022-01-12 12:39:23 -03:00
Victor Shyba
a6ca7a6f38
same api across different estimation methods
2022-01-12 12:39:23 -03:00
Victor Shyba
1c857b8dd8
be explicit about ignoring params
2022-01-12 12:39:23 -03:00
Victor Shyba
87ff3f95ff
better endpoint names, small docs
2022-01-12 12:39:23 -03:00
Jack Robison
e7d9079389
improve script
2022-01-12 12:39:23 -03:00
Victor Shyba
9cdcff0e1e
first attempt at crawling
2022-01-12 12:39:23 -03:00
Victor Shyba
11c3ea0b87
fix typo from arg name
2021-11-24 13:05:43 -03:00
Victor Shyba
d19e07d661
add blob endpoint for listing announced blobs
2021-11-17 13:27:19 -03:00
Victor Shyba
751ff6e21f
add /peers.csv to monitoring endpoint
2021-11-17 13:27:19 -03:00
Jack Robison
a00d5f18af
add script to setup docker volumes from snapshots
2021-10-24 16:25:34 -04:00
Victor Shyba
dc18c26aa4
add optional prometheus to dht_node script
2021-10-22 03:39:46 -03:00
Victor Shyba
156d89567e
add option to set bootstrap_node
2021-09-30 13:26:33 -03:00
Victor Shyba
90c743d963
configure where to save peers
2021-09-30 13:26:33 -03:00
Victor Shyba
b926293fa7
define arg types
2021-09-30 13:26:33 -03:00
Victor Shyba
71a19191f8
add dht seed node script
2021-09-30 13:26:33 -03:00
Cristian Vicas
fef0cc764d
Drop comment_* apis
...
Removed the comment API
Removed tests for the comment API
Removed the documentation section
Removed the comment server configuration
2021-09-02 08:51:00 +03:00
Lex Berezhny
ef2e048efc
fixes for release process
2021-07-26 15:57:45 -04:00
Alex Grin
940f517aa3
Merge branch 'master' into note-download-blob-peer
2021-07-19 14:09:51 -04:00
Victor Shyba
a74685d66d
add script to troubleshoot p2p/dht
2021-07-19 15:01:37 -03:00
belikor
4ebe4ce1b7
scripts: note to further investigate in download_blob_from_peer
...
Currently `lbrynet blob get <hash>` does not work to download
single blobs which are not already present in the system.
The function locks up and never returns.
It only works for blobs that are in the `blobfiles` directory
already.
This bug is reported in lbryio/lbry-sdk, issue #2070 .
Maybe this script can be investigated, and certain parts
can be added to `lbry.extras.daemon.daemon.jsonrpc_blob_get`
in order to solve the previous issue, and finally download
single blobs from the network (peers or reflector servers).
2021-07-09 11:53:35 -05:00
belikor
8c79740ee8
script/test_claim_search: fix the import of ClientSession
...
This is nothing special, it just allows the module
to run without throwing an error on the import.
From
```
from lbry.wallet.client.basenetwork import ClientSession
```
To
```
from lbry.wallet.network import ClientSession
```
2021-07-09 10:52:41 -04:00
