Commit graph

76 commits

Author SHA1 Message Date
Niko Storni
766238fd7e add if this than that store
switch to wasabi for uploads
2021-07-24 01:03:47 +02:00
Niko Storni
ac5242f173 add integrity check cmd
throttle live integrity checks
bug fixes
2021-07-24 01:03:47 +02:00
Mark Beamer Jr
215103cb33 use wait group not stopper 2021-07-24 01:03:47 +02:00
Mark Beamer Jr
ed3622d0a6 Wait for request to be handled before returning 2021-07-24 01:03:47 +02:00
Mark Beamer Jr
848fce5afa Add request queue for blob cache 2021-07-24 01:03:47 +02:00
Niko Storni
7da49a4ccb upgrade quic-go
add cache for blobs not found
2021-07-24 01:03:47 +02:00
Niko Storni
a0c9ed2ace make it simpler 2021-07-24 01:03:47 +02:00
Niko Storni
998b082a06 remove panics 2021-07-24 01:03:47 +02:00
Niko Storni
36d4156e2a add tracing to blobs 2021-07-24 01:03:47 +02:00
Niko Storni
03df751bc7 add PoC for litedb to avoid all the overhead 2021-07-24 01:03:16 +02:00
Niko Storni
84fabdd5f4 add option to run with RO-CF only as upstream
increase idle timeout to avoid errors downstream
add option to delete blobs from DB if storage doesn't have it (for future local tracking)
2021-07-24 01:03:16 +02:00
Alex Grintsvayg
fb77bf621e
dont over-allocate ram when reading blobs via QUIC 2020-11-27 16:18:26 -05:00
Alex Grintsvayg
070c378dfd
apparently the normal check doesn't work 2020-11-04 16:03:46 -05:00
Alex Grintsvayg
3608971f0b
add lru cache eviction metric 2020-11-04 16:03:44 -05:00
Alex Grintsvayg
c9fa04043c
rename the stores, add caching to reflector cmd 2020-11-04 16:03:44 -05:00
Niko Storni
5cb1365903 increase idle timeout 2020-10-19 23:42:40 +02:00
Niko Storni
c3db95a6c1 add more metrics
increase handshake timeout by 1 second
2020-10-15 02:59:12 +02:00
Alex Grintsvayg
de0ccd4da7
track approximate access time for blobs 2020-10-05 18:08:53 -04:00
Niko Storni
e8b98bc862 update dependencies 2020-09-01 20:15:34 +02:00
Niko Storni
f458529c74 fix memory leak? 2020-07-14 00:20:58 +02:00
Niko Storni
47f28002ff close unclosed handle
reduce idle timeout for http3
update QUIC library
2020-07-10 15:19:57 +02:00
Niko Storni
694bda105c add metrics 2020-07-09 15:02:32 +02:00
Niko Storni
34ca7847d0 return a better descriptive error when the blob isn't found 2020-07-09 15:02:32 +02:00
Alex Grintsvayg
df4f42db82 successfully shut down wallet server 2020-07-09 15:02:32 +02:00
Niko Storni
264390a2b2 add debug code 2020-07-09 15:02:32 +02:00
Niko Storni
fdcc41829a handshake changes 2020-07-09 15:02:32 +02:00
Niko Storni
09c7718f30 refactor code 2020-07-09 15:02:32 +02:00
Niko Storni
8a5f57b14f remove QUIC protocol
add HTTP3/QUIC protocol
2020-07-09 15:02:32 +02:00
Niko Storni
90997b9918 use new connections for each blob 2020-07-09 15:02:32 +02:00
Niko Storni
e0da2674a1 use new connections for each action
reduce timeout
2020-07-09 15:02:32 +02:00
Mark Beamer Jr
de1fb63a1c fix potentially missing client or stream for a quic store 2020-07-09 15:02:32 +02:00
Mark Beamer Jr
e98794e125 Add close function for quic store so routines do not hang waiting for timeout. 2020-07-09 15:02:32 +02:00
Niko Storni
fb0004bac4 increase packet size
add retro-compatibility
remove unused SPV servers
remove travis test failure
2020-07-09 15:02:32 +02:00
Alex Grintsvayg
4a902597df
thats confusing 2020-03-30 16:05:08 -04:00
Alex Grintsvayg
e6ba61fce2
more info on json errors 2020-03-20 10:15:41 -04:00
Alex Grintsvayg
d1063bd54e
log full traces more 2020-02-25 18:22:22 -05:00
Alex Grintsvayg
d291c063ec
add traces to unmarshall errors 2020-02-25 15:49:51 -05:00
Alex Grintsvayg
11e50a6022
remove unused stats code 2020-01-02 13:27:34 -05:00
Alex Grintsvayg
5d8a2d697c
use labels for different error types 2020-01-02 13:12:33 -05:00
Alex Grintsvayg
50089481fb
switch to prometheus for metrics 2020-01-02 13:12:33 -05:00
Andrey Beletsky
52127eee7c Remove setting default client timeout in peer.NewStore 2019-12-16 22:47:35 +07:00
Andrey Beletsky
95eb94f5a7 Remove excessive INFO-level logging 2019-12-16 21:52:51 +07:00
Andrey Beletsky
834733b675 Add options for peer.NewStore to allow for setting TCP timeout 2019-11-22 18:56:20 +07:00
Mark Beamer Jr
86a553b876
upgrade to lbry.go v2.4.0 2019-11-13 19:11:35 -05:00
Alex Grintsvayg
69f1e0f4ca
make MemoryStore consistent with the New...() pattern 2019-10-03 16:49:28 -04:00
Alex Grintsvayg
2ca83139df
use stream.Blob for BlobStore interface 2019-10-03 16:34:57 -04:00
Alex Grintsvayg
a8230db802
rewrite getstream command using caching store 2019-10-03 16:13:08 -04:00
Alex Grintsvayg
acb9840871
add peer blob store, which gets blobs from a peer 2019-10-03 16:10:29 -04:00
Alex Grintsvayg
c1e8e7481f
fix getstream command to write as it downloads (or else it runs out of memory) 2019-09-27 14:38:49 -04:00
Alex Grintsvayg
08df3b167c
add getstream command to download a stream from a peer 2019-09-11 13:28:58 -04:00