Commit graph

24 commits

Author SHA1 Message Date
Niko Storni
36d4156e2a add tracing to blobs 2021-07-24 01:03:47 +02:00
Alex Grintsvayg
9a5d9d7ff5 only touch blobs when you get them 2021-07-24 01:03:47 +02:00
Niko Storni
35c713a26e add cmd to populate db
fix store init
try fixing unreasonable db bottleneck
2021-07-24 01:03:47 +02:00
Alex Grintsvayg
6fb0620091 something like this 2021-07-24 01:03:38 +02:00
Niko Storni
03df751bc7 add PoC for litedb to avoid all the overhead 2021-07-24 01:03:16 +02:00
Niko Storni
84fabdd5f4 add option to run with RO-CF only as upstream
increase idle timeout to avoid errors downstream
add option to delete blobs from DB if storage doesn't have it (for future local tracking)
2021-07-24 01:03:16 +02:00
Alex Grintsvayg
3608971f0b
add lru cache eviction metric 2020-11-04 16:03:44 -05:00
Alex Grintsvayg
de0ccd4da7
track approximate access time for blobs 2020-10-05 18:08:53 -04:00
Alex Grintsvayg
d291c063ec
add traces to unmarshall errors 2020-02-25 15:49:51 -05:00
Mark Beamer Jr
86a553b876
upgrade to lbry.go v2.4.0 2019-11-13 19:11:35 -05:00
Alex Grintsvayg
661c20a21d
make db-backed store more generic (not specific to s3) 2019-10-03 16:58:17 -04:00
Alex Grintsvayg
2ca83139df
use stream.Blob for BlobStore interface 2019-10-03 16:34:57 -04:00
Alex Grintsvayg
c7643fb5da
check blocklist first, its cheaper 2019-07-02 09:21:26 -04:00
Alex Grintsvayg
14d6d32a41 move dht to lbry.go repo 2019-01-09 17:52:30 -05:00
Alex Grintsvayg
11ebfb822b started work on go blob primitives. successfully matched python's blob crypto (excluding canonical JSON) 2018-10-04 15:05:19 -04:00
Alex Grintsvayg
61e83d86de actually done now 2018-09-20 11:29:35 -04:00
Alex Grintsvayg
9fb824790b done, but NEEDS MIGRATION AND TESTING 2018-09-20 11:29:35 -04:00
Alex Grintsvayg
75886211b1 fix partial stream upload 2018-08-15 20:18:54 -04:00
Alex Grintsvayg
0e0b2aaea3 drop DB interface, attempt to fix max conn issues using interpolateParams 2018-08-07 16:51:36 -04:00
Alex Grintsvayg
8f395d8743 fix reflector responding correctly when we have the full stream. fixes lbryio/reflector-cluster#60 2018-07-26 10:25:47 -04:00
Mark Beamer Jr
35f98ce162 code cleanup
-Added travis support
-updated travis to analyze code beneath the root.
-refactored upload.go to fix travis errors.
-gocyclo should ignore test files. $GOFILES needed to be adjusted.
-fix rows.Close() ignoring error. Created func to handle so defer can be used when needed also.
-fixed ignored errors.
-fixed unit test that was not passing correctly to anonymous function.
-fixed govet error for passing param inside go func.
-removed returned error, in favor of logging instead.
-added error logging for ignored error.
-fixed potential race conditions.
-removed unused append
-fixed time usage to align with go standards.
-removed unused variables
-made changes for code review.
-code comments for exported functions.
-Documented bitmap.go and insert into contact list.
-Documented dht, message, bootstrap
-Fixed comment typos
-Documented message,node, routing_table, testing in DHT package.
-Documented server, client, prism, server and shared in peer and reflector packages.
-Documented the stores in Store package.
-made defer adjustments inline and deleted the separate function.
-adjusted method in upload to take the only parameter it requires.
2018-06-13 09:29:13 -04:00
Alex Grintsvayg
d989d42ad3 added dep, makefile 2018-03-01 16:28:25 -05:00
Alex Grintsvayg
7b3ac43fff accepts full streams, stores them in db 2018-02-02 16:49:20 -05:00
Alex Grintsvayg
8c67da1852 correct peer protocol errors, add simple db store 2018-01-30 20:15:21 -05:00