LBRYCommunity/lbcd
1
0
Fork 0
Code Issues 17 Pull requests 4 Projects Releases 28 Packages Wiki Activity
3419 commits 9 branches 35 tags 20 MiB
Commit graph

3419 commits

This branch
This branch
All branches
Author SHA1 Message Date
Brannon King
3c0e288e0f fixed collectChildNames 2021-08-07 09:53:44 -07:00
Brannon King
1a3f34c345 change is manually serialized 2021-08-07 09:53:44 -07:00
Brannon King
85a7f74f83 switch node encoding to mum (via enkodo) 2021-08-07 09:53:44 -07:00
Brannon King
e8b2910b36 optimize collectSpentChildren, add tests for it 2021-08-07 09:53:42 -07:00
Roy Lee
88dbf2267c [lbry] cli: switch from utxoview to native map. 
The utxo is too big to hold in the memory. (~58 GB at 860K blocks)
Since we're extracting claim scripts from an already validated database,
a dumb native map saves us memory as well as overhead maintaining a
uxto.

This takes 8.5 minutes to extract claim scripts in 1M blocks, but
still takes ~56 GB of memory.
 2021-08-03 12:11:49 -07:00
Roy Lee
0377a3e7ac [lbry] cli: cleanup 2021-08-03 12:00:27 -07:00
Roy Lee
26a4ffe2e3 [lbry] cli: minor refactoring stats report 2021-08-03 11:53:56 -07:00
Roy Lee
2ead2539c0 [lbry] Rework claimtrie CLIs 
1. Ditch in-house block repo, and use btcd blocks database.
2. Commands switch from args to flags.
3. Revive chain recording and replaying, which will be part of CI pipeline.
4. Refactor cleanup the CLI skeletons.
5. Support DataDir, and testnet/regtes (not tested yet).

TODOs:

  1. Remove hardcoded test/development params, and pass them from flags.
  2. Make output more sensible.
  3. Add debug level flag.
  4. Add MerkleTrie implementation switch.
  5. Refactor periodic progess/status reporting for long run-time tasks.
  ...
 2021-08-02 00:37:04 -07:00
Roy Lee
424235655c [lbry] rework config and params 
Ideally, network related params should be part of config, which is
passed down to the components to avoid references to global instances.

This commit is only halfway through as there are a couple of structs
that are too small to house the params and are still referencing
global variables. We'll rework that later.
 2021-08-02 00:31:15 -07:00
Roy Lee
c5b4662aa8 [lbry] cleanup: fix CI errors 2021-08-02 00:24:13 -07:00
Brannon King
353d08bb91 added rpc methods to get cliam data by name 
fix misuse of normalized name


post-merge fix
 2021-07-30 16:24:14 -04:00
Brannon King
15ded4ed0f remove claim prefix for addr calculation 2021-07-30 16:16:34 -04:00
Roy Lee
a553f2e9c8 [lbry] Rremove claim operations instrumentations. 
Move them to separate command line tools
 2021-07-30 09:35:15 -07:00
Brannon King
d4073bd18d added in segwit hardfork (mimics lbrycrd) 
also validated testnet
 2021-07-30 09:27:26 -07:00
Brannon King
cb7175bd70 update params 2021-07-30 09:27:26 -07:00
Roy Lee
ade6adb7dc [lbry] Minor tweaks to log messages 2021-07-29 21:29:40 -07:00
Roy Lee
b23710bc33 [lbry] Enable specifying claimtrie implmentation. 
Note: switching between implementation require rebuilding the claimtrie
from scratch.
 2021-07-29 21:29:40 -07:00
Brannon King
82d4b6657b force disk flush when caught up to current 2021-07-28 01:32:20 +00:00
Roy Lee
0a01170422
Update full-sync.yml 
Disable RPC
 2021-07-27 16:50:53 -07:00
Roy Lee
1a65a6a19d
[CI] Add full-sync workflow 2021-07-27 10:35:32 -07:00
Brannon King
ab852a6e9f [lbry] many methods now use errors.Wrap, others use node.log 
added hasChildren test
 2021-07-27 09:34:15 -04:00
Brannon King
d691ab7a9e [lbry] print out memory usage periodically 2021-07-27 09:33:10 -04:00
Brannon King
9a177f3a9a [lbry] added intermediate checkpoints 2021-07-27 08:00:12 -04:00
Brannon King
d013bb7e72 [lbry] reject invalid claim names at mempool 2021-07-27 07:56:51 -04:00
Brannon King
9615516b51 [lbry] fix max fee rate 2021-07-27 07:56:19 -04:00
Roy Lee
ceb72948ec cleanup: go fmt 2021-07-22 23:19:07 -07:00
Brannon King
7dff7f9dd8 don't store name uselessly 2021-07-21 09:14:18 -07:00
Brannon King
ac6a7ad121 made custom decoders actually work 
fix format
 2021-07-21 08:54:07 -07:00
Brannon King
26e4083f38 not necessary to store value 2021-07-21 08:54:04 -07:00
Brannon King
9937f66b6a change.ClaimID and OutPoint types changed 2021-07-21 08:54:01 -07:00
Brannon King
b6cf5f2665 fixed missing frontload on read 2021-07-20 11:36:06 -04:00
Brannon King
d74924992a modified node cache for LRU support 2021-07-19 13:27:14 -04:00
Brannon King
a1631880be post-rebase fixes, make ramtrie default 2021-07-19 11:39:05 -04:00
Brannon King
d46bedf5ef fixed emulation of old delay calculation 2021-07-19 11:19:01 -04:00
Brannon King
0518180508 in progress on final delay workaround 2021-07-19 11:19:01 -04:00
Brannon King
a0469820a2 refactored EffectiveAmount for performance 2021-07-19 11:18:28 -04:00
Brannon King
f829fb6206 introduce ramTrie 2021-07-19 11:18:03 -04:00
Brannon King
d7f97ab750 initial sketch and test of faster trie 
use custom search

formatted
 2021-07-19 11:15:45 -04:00
Roy Lee
2e75ce6583 [lbry] configure and pass claimtrie from server 2021-07-12 22:41:33 -07:00
Roy Lee
6b55968ccd [lbry] rework claimtrie config and param 2021-07-12 22:40:24 -07:00
Roy Lee
ceba136a70 [lbry] config: add ClaimTrie flag 2021-07-12 22:40:24 -07:00
Roy Lee
9e5a717c39 [lbry] git: ignore binaries 2021-07-12 15:24:58 -07:00
Roy Lee
f218c04488 [lbry] claimtrie: remove duplicated initialization of reportedBlockRepo 2021-07-11 22:51:28 -07:00
Roy Lee
328705f579 [lbry] claimtrie: support replay of chain changes 2021-07-10 17:07:48 -07:00
Roy Lee
3c85e6e56a [lbry] claimtrie: minor refactoring of claimtrie CLI 2021-07-10 17:07:17 -07:00
Roy Lee
27c81de4e5 [lbry] go module: update go modules 
go mod init github.com/lbryio/chain
go mod edit --replace github.com/btcsuite/btcd=./
go mod edit --replace github.com/btcsuite/btcutil=github.com/lbryio/lbcutil@f93c78a8bc21
go mod tidy
 2021-07-08 10:41:12 -07:00
Roy Lee
ccaa6dd816 [lbry] claimtrie: import current snapshot 
Sync to tip

Co-authored-by: Brannon King <countprimes@gmail.com>
 2021-07-08 10:41:12 -07:00
Roy Lee
2dcdb458e8 [lbry] blockchain: connect to ClaimTrie 
Co-authored-by: Brannon King <countprimes@gmail.com>
 2021-07-08 10:41:12 -07:00
Roy Lee
56c21c6bd6 [lbry] FIXME: remove the tests for now to pass CI. 
Some test files failed to build as the go module "replace" doesn't work
with test and internal packages yet.

The other tests need updates to the testdata.
 2021-07-08 10:31:56 -07:00
Roy Lee
87c3243bf1 [lbry] chaincfg: add chckpoint at block 946,000 2021-07-08 10:31:56 -07:00