Niko Storni
5cc1e84adb
remove locks causing deadlocks
2021-05-21 05:53:13 +02:00
Niko Storni
a7086a00f3
add http server/client
2021-05-21 05:49:02 +02:00
Mark Beamer Jr
76ece1e117
Add queue to prevent writing too many files at once.
2021-05-20 20:43:01 -04:00
Mark Beamer Jr
c1caf1938c
Add queue to prevent writing too many files at once.
2021-05-20 20:41:47 -04:00
Mark Beamer Jr
213d21b021
Add locks to disk store.
2021-05-20 19:59:50 -04:00
Niko Storni
006b04f6e9
add a lot of extra heavy debugging
2021-05-21 01:48:46 +02:00
Niko Storni
dc95351cf3
add integrity check cmd
...
throttle live integrity checks
bug fixes
2021-04-07 04:46:18 +02:00
Niko Storni
38b44218f2
check blobs when reading them
2021-04-05 23:34:45 +02:00
Niko Storni
6291e33ee1
add tracing to blobs
2021-01-14 20:38:04 +01:00
Niko Storni
03304312e8
add PoC for litedb to avoid all the overhead
2020-12-23 06:04:42 +01:00
Alex Grintsvayg
e70b9af3e4
dont overallocate ram when reading blobs from disk
...
ReadFile checks the file size and allocates a bit more space than we
expect we'll need. ReadAll uses Go's standard resizing algo, which
doubles the underlying array each time you hit the end. So ReadAll
ends up allocating 4MB for a full blob, while ReadFile allocates
slightly over 2MB.
2020-11-27 16:18:26 -05:00
Alex Grintsvayg
659a6e73cc
use speedwalk for faster file listing
2020-11-04 16:03:47 -05:00
Alex Grintsvayg
aaae3ffa5b
remove afero fs abstraction in prep for using speedwalk
2020-11-04 16:03:47 -05:00
Alex Grintsvayg
7a3225434e
add test for DiskStore.list()
2020-11-04 16:03:45 -05:00
Alex Grintsvayg
3608971f0b
add lru cache eviction metric
2020-11-04 16:03:44 -05:00
Alex Grintsvayg
c9fa04043c
rename the stores, add caching to reflector cmd
2020-11-04 16:03:44 -05:00
Alex Grintsvayg
c6b53792c8
separate disk and lru behavior
2020-11-04 16:03:44 -05:00
Alex Grintsvayg
69fa06420b
LRU cache for disk store, abstract fs in disk store for testing
2020-11-04 16:03:43 -05:00
Niko Storni
47f28002ff
close unclosed handle
...
reduce idle timeout for http3
update QUIC library
2020-07-10 15:19:57 +02:00
Niko Storni
5c91051b78
disable disk cleanup routine
2020-07-09 15:02:32 +02:00
Niko Storni
3ffe7a10c7
add other reflector store
...
add flags
improve disk cleanup
2020-07-09 15:02:32 +02:00
Andrey Beletsky
1bf3cb81b3
Use ModTime on systems that don't provide Atim file stat field
2020-07-09 15:02:32 +02:00
Niko Storni
4a5a148843
implement disk cleanup
2020-02-27 14:53:33 -05:00
Mark Beamer Jr
86a553b876
upgrade to lbry.go v2.4.0
2019-11-13 19:11:35 -05:00
Alex Grintsvayg
2ca83139df
use stream.Blob for BlobStore interface
2019-10-03 16:34:57 -04:00