Madiator2011/lbry-sdk
1
0
Fork 0
forked from LBRYCommunity/lbry-sdk
Code Pull requests Activity
8742 commits 111 branches 641 tags 30 MiB
Commit graph

1845 commits

Author SHA1 Message Date
Cristian Vicas
01557b599a Updated documentation for RPC calls: status, blob_list. 2022-03-15 15:34:08 -03:00
belikor
65323b4169 file_manager: raise new InvalidStreamURLError if the URL is invalid 
When using `lbrynet get URL`, if the URL is not a valid URL
the function `url.URL.parse` will raise a `ValueError` exception
which will produce a whole backtrace.

For example, this is the case if we provide a channel name
with a forward slash but without a stream name.
```
lbrynet get @Non-existing/
```

```
Traceback (most recent call last):
  File "/opt/git/lbry-sdk/lbry/file/file_manager.py", line 84, in download_from_uri
    if not URL.parse(uri).has_stream:
  File "/opt/git/lbry-sdk/lbry/schema/url.py", line 114, in parse
    raise ValueError('Invalid LBRY URL')
ValueError: Invalid LBRY URL
WARNING  lbry.extras.daemon.daemon:1110: Error downloading Non-existing/: Invalid LBRY URL
```

Now we raise a new `InvalidStreamURLError` which can be trapped in the upper functions
that use `url.URL.parse` such as `FileManager.download_from_uri`.
If we do this the traceback won't be shown.
```
WARNING  lbry.file.file_manager:252:
Failed to download Non-existing/: Invalid LBRY stream URL: '@Non-existing/'
WARNING  lbry.extras.daemon.daemon:1110:
Error downloading Non-existing/: Invalid LBRY stream URL: '@Non-existing/'
```

This handles the case when trying to download only "channel" parts
without the claim part.
```
lbrynet get @Non-existing
lbrynet get @Non-existing/
lbrynet get Non-existing/
```
 2022-03-15 15:34:08 -03:00
Jack Robison
cdef8b4852 clear es attributes during initial sync 2022-03-15 15:34:08 -03:00
Jack Robison
8d72142390 fix setting references on txos in extra_txos 2022-03-15 15:34:08 -03:00
Jack Robison
172a0f0ac2 fix reposted channel being missing from resolve result 
-improve names of the resolve related methods in `LevelDB`
 2022-03-15 15:34:08 -03:00
Jack Robison
1022080be6 fix compactify script 2022-03-15 15:34:08 -03:00
Jack Robison
8031a55dbb fix test 2022-03-15 15:34:08 -03:00
Jack Robison
cb5c39a159 only save undo info for blocks within reorg limit 2022-03-15 15:34:08 -03:00
Jack Robison
9ec510c742 fix channel count 2022-03-15 15:34:08 -03:00
Jack Robison
ccc9a900ef sort touched or deleted claim hashes 2022-03-15 15:34:08 -03:00
Jack Robison
c2a5ff0ae3 block processor db refactoring 
-access db through HubDB class, don't use plyvel.DB directly
-add channel count and support amount prefixes
 2022-03-15 15:34:08 -03:00
Jack Robison
afa710dcb5 fix and add test for abandoning a controlling in the same block a new claim is made 2022-03-15 15:34:08 -03:00
Jack Robison
830fc7f8cc fix ES index name so it stays the same within a test case 2022-03-15 15:34:08 -03:00
Jack Robison
88e8926a59 fix bug with early takeover by an update 2022-03-15 15:34:08 -03:00
Jack Robison
acd0c2188f fix activating non existent claim 2022-03-15 15:34:08 -03:00
Jack Robison
6155cda66f add tests for takeovers from amount changes in updates before/on/after activation 2022-03-15 15:34:08 -03:00
Jack Robison
f77f2f6e80 batch address history notifications 2022-03-15 15:34:08 -03:00
Jack Robison
68d397a269 improve leveldb caching 2022-03-15 15:34:08 -03:00
Jack Robison
66ed57c834 refactor reload_blocking_filtering_streams 2022-03-15 15:34:08 -03:00
Jack Robison
8b42475d59 fix filtering error upon abandon 2022-03-15 15:34:08 -03:00
Jack Robison
de9159d83c faster read_claim_txos 2022-03-15 15:34:08 -03:00
Jack Robison
b66adfdf78 remove unused executor 2022-03-15 15:34:08 -03:00
Victor Shyba
a4be5eb1d8 fix blocking and filtering 2022-03-15 15:34:08 -03:00
Jack Robison
7d3eef1fd9 fix logging number of notified sessions 2022-03-15 15:34:08 -03:00
Jack Robison
6e93c5bc0d fix update that initiates takeover not being delayed 2022-03-15 15:34:08 -03:00
Jack Robison
16b21b8bda use hub binary from https://github.com/lbryio/hub/pull/13 2022-03-15 15:34:08 -03:00
Jack Robison
a0e0039988 handle invalid release time 2022-03-15 15:34:08 -03:00
Jack Robison
3970e91766 name and normalized -> claim_name and normalized_name 
-update generated pb files
 2022-03-15 15:34:08 -03:00
Jack Robison
c4126edb79 fix es sync.py 2022-03-15 15:34:08 -03:00
Jack Robison
589a6588da fix all_claims_producer 2022-03-15 15:34:08 -03:00
Jack Robison
1ec4111b9f merge conflicts 2022-03-15 15:34:08 -03:00
Jack Robison
c00912015a claim search fixes 2022-03-15 15:34:08 -03:00
Jack Robison
0d19439982 fix release_time and creation_timestamp 2022-03-15 15:34:08 -03:00
Jack Robison
12f790ab01 delete unused code 2022-03-15 15:34:08 -03:00
Jack Robison
ff960fda0e non blocking claim producer 2022-03-15 15:34:08 -03:00
Jack Robison
72e45b5cb1 fix tests 2022-03-15 15:34:08 -03:00
Jack Robison
b59e0490a2 renormalization 2022-03-15 15:34:08 -03:00
Jack Robison
ca335b7a65 fix trending overflow 2022-03-15 15:34:08 -03:00
Jack Robison
8f9e6a519d refactor trending 2022-03-15 15:34:08 -03:00
Jack Robison
da75968078 trending fixes 2022-03-15 15:34:08 -03:00
Jack Robison
3800fb1ab0 make app backward compatible with trending_score 
-update trending decay function to zero out low trending score values faster
 2022-03-15 15:34:08 -03:00
Jack Robison
a51bf6a4fa log time to update and decay trending in elasticsearch 2022-03-15 15:34:08 -03:00
Jack Robison
0be141188c skip integrity errors for trending spikes 2022-03-15 15:34:08 -03:00
Jack Robison
6f2b985b73 update trending in elasticsearch 
-add TrendingPrefixSpike to leveldb
-expose `TRENDING_HALF_LIFE`, `TRENDING_WHALE_HALF_LIFE` and `TRENDING_WHALE_THRESHOLD` hub settings
 2022-03-15 15:34:08 -03:00
Brendon J. Brewer
8eba05308d constants 2022-03-15 15:34:08 -03:00
Brendon J. Brewer
ecab123a3a Put trending score into ES 2022-03-15 15:34:08 -03:00
Brendon J. Brewer
180f6c4519 Mark claims as touched 2022-03-15 15:34:08 -03:00
Jack Robison
dc4e362e10 fix non normalized canonical urls 2022-03-15 15:34:08 -03:00
Jack Robison
7e78fdec04 handle unicode error for unnormalized names 2022-03-15 15:34:08 -03:00
Jack Robison
e212ce23e3 prefix db 2022-03-15 15:34:08 -03:00
Brendon J. Brewer
0c7be8975f trending 2022-03-15 15:34:08 -03:00
Jack Robison
6cba95c148 fix claims not having non-normalized names 2022-03-15 15:34:08 -03:00
Jack Robison
91a86fd12f merge conflicts 2022-03-15 15:34:08 -03:00
Jack Robison
c819d494c3 fix missing fields in reposts 2022-03-15 15:34:08 -03:00
Jack Robison
b4853c5f67 fix merge conflicts and simplify extract_doc 2022-03-15 15:34:08 -03:00
Jack Robison
c68334b421 fix bulk es sync 2022-03-15 15:34:08 -03:00
Jack Robison
613acc7b00 fix tests 2022-03-15 15:34:08 -03:00
Jack Robison
371fc4d68c fix tests 2022-03-15 15:34:08 -03:00
Jack Robison
7ef0ae12a1 handle invalid claim update 2022-03-15 15:34:08 -03:00
Jack Robison
dc34e8884c fix keeping claim_hash_to_txo and txo_to_claim in sync 2022-03-15 15:34:08 -03:00
Victor Shyba
08d635322e implement blocking and filtering 2022-03-15 15:34:08 -03:00
Jack Robison
bc0c1b9a3e fix _get_pending_claim_name 2022-03-15 15:34:08 -03:00
Jack Robison
c42ee926da fix applying expiration fork 2022-03-15 15:34:08 -03:00
Jack Robison
c59d08080e update iterators to use pack_partial_key 2022-03-15 15:34:08 -03:00
Jack Robison
94e0624024 delete lbry/wallet/server/storage.py 
-expose leveldb lru cache size as `CACHE_MB` hub param
 2022-03-15 15:34:08 -03:00
Jack Robison
e94a2c7c94 remove dead code 2022-03-15 15:34:07 -03:00
Jack Robison
cd1ce32377 non blocking mempool loop 2022-03-15 15:34:07 -03:00
Jack Robison
d1560ef09b faster es sync 2022-03-15 15:34:07 -03:00
Jack Robison
6699d1e2f8 run advance_block in threadpool 2022-03-15 15:34:07 -03:00
Jack Robison
f1fbfa1b39 use claim_to_txo cache 2022-03-15 15:34:07 -03:00
Jack Robison
0d86717a9a faster _cached_get_active_amount for claims 
-remove dead code
 2022-03-15 15:34:07 -03:00
Jack Robison
528af27e4a fix claim search by fee for claims without fees 2022-03-15 15:34:07 -03:00
Jack Robison
fe69afaa56 clear claim_to_txo cache before reading 2022-03-15 15:34:07 -03:00
Jack Robison
31d7823498 handle claims that dont exist in ES sync 2022-03-15 15:34:07 -03:00
Jack Robison
ef6ec03161 in memory claim_to_txo and txo_to_claim dictionaries 2022-03-15 15:34:07 -03:00
Jack Robison
68596be1b9 fix spend_utxo 2022-03-15 15:34:07 -03:00
Jack Robison
a48fe84971 split flush from advance_block 2022-03-15 15:34:07 -03:00
Jack Robison
bfbe7c1bf5 rename extend_ops 2022-03-15 15:34:07 -03:00
Jack Robison
085ce1ff16 faster spend_utxo 2022-03-15 15:34:07 -03:00
Jack Robison
c81c0d9480 faster get_future_activated 2022-03-15 15:34:07 -03:00
Jack Robison
05b6bdb8f6 threadpool 2022-03-15 15:34:07 -03:00
Jack Robison
991d4f8859 cleanup 2022-03-15 15:34:07 -03:00
Jack Robison
22c75605ee fix getting block hash during reorg 2022-03-15 15:34:07 -03:00
Jack Robison
f52faa8d14 fix test 2022-03-15 15:34:07 -03:00
Jack Robison
8dd88a2780 fix spends in address histories 2022-03-15 15:34:07 -03:00
Jack Robison
7ad2234983 faster es sync 2022-03-15 15:34:07 -03:00
Jack Robison
fb5c008fc5 fix expiring channels 2022-03-15 15:34:07 -03:00
Jack Robison
f55b6bdc71 fix abandoning signed claims in the same tx as their channel 
-fix canonical/short url in es
 2022-03-15 15:34:07 -03:00
Jack Robison
de9edb0695 handle failure to generate a short id 2022-03-15 15:34:07 -03:00
Jack Robison
2180e24bc1 fix resolve by short id 2022-03-15 15:34:07 -03:00
Jack Robison
b4eaa5f918 move MemPool into BlockProcessor 2022-03-15 15:34:07 -03:00
Jack Robison
d4194954d3 combine MemPool and Notifications classes 2022-03-15 15:34:07 -03:00
Jack Robison
6e221fc7d9 fix touched hashXs notifications 2022-03-15 15:34:07 -03:00
Jack Robison
ea1285cd9f reorg claims in the search index 2022-03-15 15:34:07 -03:00
Jack Robison
4e77fa100b small fixes 2022-03-15 15:34:07 -03:00
Jack Robison
babb76d90d rename 2022-03-15 15:34:07 -03:00
Jack Robison
f73153ed8d delete stale code 2022-03-15 15:34:07 -03:00
Jack Robison
acfc1f56ee simplify advance and reorg 2022-03-15 15:34:07 -03:00
Jack Robison
81773a6497 update limited_history 2022-03-15 15:34:07 -03:00
Jack Robison
25cf751158 update lookup_utxos 2022-03-15 15:34:07 -03:00