Commit graph

19 commits

Author SHA1 Message Date
Brannon King
531428d306 reuse claim memory 2021-08-10 18:12:44 -04:00
Brannon King
ccfa7af546 remove memory pressure from parseScript 2021-08-10 18:12:13 -04:00
Roy Lee
88dbf2267c [lbry] cli: switch from utxoview to native map.
The utxo is too big to hold in the memory. (~58 GB at 860K blocks)
Since we're extracting claim scripts from an already validated database,
a dumb native map saves us memory as well as overhead maintaining a
uxto.

This takes 8.5 minutes to extract claim scripts in 1M blocks, but
still takes ~56 GB of memory.
2021-08-03 12:11:49 -07:00
Roy Lee
0377a3e7ac [lbry] cli: cleanup 2021-08-03 12:00:27 -07:00
Roy Lee
26a4ffe2e3 [lbry] cli: minor refactoring stats report 2021-08-03 11:53:56 -07:00
Roy Lee
2ead2539c0 [lbry] Rework claimtrie CLIs
1. Ditch in-house block repo, and use btcd blocks database.
2. Commands switch from args to flags.
3. Revive chain recording and replaying, which will be part of CI pipeline.
4. Refactor cleanup the CLI skeletons.
5. Support DataDir, and testnet/regtes (not tested yet).

TODOs:

  1. Remove hardcoded test/development params, and pass them from flags.
  2. Make output more sensible.
  3. Add debug level flag.
  4. Add MerkleTrie implementation switch.
  5. Refactor periodic progess/status reporting for long run-time tasks.
  ...
2021-08-02 00:37:04 -07:00
Brannon King
353d08bb91 added rpc methods to get cliam data by name
fix misuse of normalized name


post-merge fix
2021-07-30 16:24:14 -04:00
Brannon King
ab852a6e9f [lbry] many methods now use errors.Wrap, others use node.log
added hasChildren test
2021-07-27 09:34:15 -04:00
Brannon King
ac6a7ad121 made custom decoders actually work
fix format
2021-07-21 08:54:07 -07:00
Brannon King
26e4083f38 not necessary to store value 2021-07-21 08:54:04 -07:00
Brannon King
9937f66b6a change.ClaimID and OutPoint types changed 2021-07-21 08:54:01 -07:00
Brannon King
a1631880be post-rebase fixes, make ramtrie default 2021-07-19 11:39:05 -04:00
Brannon King
0518180508 in progress on final delay workaround 2021-07-19 11:19:01 -04:00
Brannon King
a0469820a2 refactored EffectiveAmount for performance 2021-07-19 11:18:28 -04:00
Brannon King
f829fb6206 introduce ramTrie 2021-07-19 11:18:03 -04:00
Roy Lee
6b55968ccd [lbry] rework claimtrie config and param 2021-07-12 22:40:24 -07:00
Roy Lee
328705f579 [lbry] claimtrie: support replay of chain changes 2021-07-10 17:07:48 -07:00
Roy Lee
3c85e6e56a [lbry] claimtrie: minor refactoring of claimtrie CLI 2021-07-10 17:07:17 -07:00
Roy Lee
ccaa6dd816 [lbry] claimtrie: import current snapshot
Sync to tip

Co-authored-by: Brannon King <countprimes@gmail.com>
2021-07-08 10:41:12 -07:00