Commit graph

35 commits

Author SHA1 Message Date
Brannon King
ade593da33 added more unit tests for claimtrie 2021-08-10 17:08:51 -04:00
Brannon King
132b93713d added full sync part 2
add sha


add coreutils


fix data folder


added icu


more icu
2021-08-10 09:49:51 -04:00
Brannon King
3c0e288e0f fixed collectChildNames 2021-08-07 09:53:44 -07:00
Brannon King
1a3f34c345 change is manually serialized 2021-08-07 09:53:44 -07:00
Brannon King
85a7f74f83 switch node encoding to mum (via enkodo) 2021-08-07 09:53:44 -07:00
Brannon King
e8b2910b36 optimize collectSpentChildren, add tests for it 2021-08-07 09:53:42 -07:00
Roy Lee
88dbf2267c [lbry] cli: switch from utxoview to native map.
The utxo is too big to hold in the memory. (~58 GB at 860K blocks)
Since we're extracting claim scripts from an already validated database,
a dumb native map saves us memory as well as overhead maintaining a
uxto.

This takes 8.5 minutes to extract claim scripts in 1M blocks, but
still takes ~56 GB of memory.
2021-08-03 12:11:49 -07:00
Roy Lee
0377a3e7ac [lbry] cli: cleanup 2021-08-03 12:00:27 -07:00
Roy Lee
26a4ffe2e3 [lbry] cli: minor refactoring stats report 2021-08-03 11:53:56 -07:00
Roy Lee
2ead2539c0 [lbry] Rework claimtrie CLIs
1. Ditch in-house block repo, and use btcd blocks database.
2. Commands switch from args to flags.
3. Revive chain recording and replaying, which will be part of CI pipeline.
4. Refactor cleanup the CLI skeletons.
5. Support DataDir, and testnet/regtes (not tested yet).

TODOs:

  1. Remove hardcoded test/development params, and pass them from flags.
  2. Make output more sensible.
  3. Add debug level flag.
  4. Add MerkleTrie implementation switch.
  5. Refactor periodic progess/status reporting for long run-time tasks.
  ...
2021-08-02 00:37:04 -07:00
Roy Lee
424235655c [lbry] rework config and params
Ideally, network related params should be part of config, which is
passed down to the components to avoid references to global instances.

This commit is only halfway through as there are a couple of structs
that are too small to house the params and are still referencing
global variables. We'll rework that later.
2021-08-02 00:31:15 -07:00
Roy Lee
c5b4662aa8 [lbry] cleanup: fix CI errors 2021-08-02 00:24:13 -07:00
Brannon King
353d08bb91 added rpc methods to get cliam data by name
fix misuse of normalized name


post-merge fix
2021-07-30 16:24:14 -04:00
Roy Lee
a553f2e9c8 [lbry] Rremove claim operations instrumentations.
Move them to separate command line tools
2021-07-30 09:35:15 -07:00
Brannon King
d4073bd18d added in segwit hardfork (mimics lbrycrd)
also validated testnet
2021-07-30 09:27:26 -07:00
Brannon King
82d4b6657b force disk flush when caught up to current 2021-07-28 01:32:20 +00:00
Brannon King
ab852a6e9f [lbry] many methods now use errors.Wrap, others use node.log
added hasChildren test
2021-07-27 09:34:15 -04:00
Roy Lee
ceb72948ec cleanup: go fmt 2021-07-22 23:19:07 -07:00
Brannon King
7dff7f9dd8 don't store name uselessly 2021-07-21 09:14:18 -07:00
Brannon King
ac6a7ad121 made custom decoders actually work
fix format
2021-07-21 08:54:07 -07:00
Brannon King
26e4083f38 not necessary to store value 2021-07-21 08:54:04 -07:00
Brannon King
9937f66b6a change.ClaimID and OutPoint types changed 2021-07-21 08:54:01 -07:00
Brannon King
b6cf5f2665 fixed missing frontload on read 2021-07-20 11:36:06 -04:00
Brannon King
d74924992a modified node cache for LRU support 2021-07-19 13:27:14 -04:00
Brannon King
a1631880be post-rebase fixes, make ramtrie default 2021-07-19 11:39:05 -04:00
Brannon King
d46bedf5ef fixed emulation of old delay calculation 2021-07-19 11:19:01 -04:00
Brannon King
0518180508 in progress on final delay workaround 2021-07-19 11:19:01 -04:00
Brannon King
a0469820a2 refactored EffectiveAmount for performance 2021-07-19 11:18:28 -04:00
Brannon King
f829fb6206 introduce ramTrie 2021-07-19 11:18:03 -04:00
Brannon King
d7f97ab750 initial sketch and test of faster trie
use custom search

formatted
2021-07-19 11:15:45 -04:00
Roy Lee
6b55968ccd [lbry] rework claimtrie config and param 2021-07-12 22:40:24 -07:00
Roy Lee
f218c04488 [lbry] claimtrie: remove duplicated initialization of reportedBlockRepo 2021-07-11 22:51:28 -07:00
Roy Lee
328705f579 [lbry] claimtrie: support replay of chain changes 2021-07-10 17:07:48 -07:00
Roy Lee
3c85e6e56a [lbry] claimtrie: minor refactoring of claimtrie CLI 2021-07-10 17:07:17 -07:00
Roy Lee
ccaa6dd816 [lbry] claimtrie: import current snapshot
Sync to tip

Co-authored-by: Brannon King <countprimes@gmail.com>
2021-07-08 10:41:12 -07:00