reflector.go

Author	SHA1	Message	Date
Niko Storni	38b44218f2	check blobs when reading them	2021-04-05 23:34:45 +02:00
Niko Storni	6291e33ee1	add tracing to blobs	2021-01-14 20:38:04 +01:00
Niko Storni	03304312e8	add PoC for litedb to avoid all the overhead	2020-12-23 06:04:42 +01:00
Alex Grintsvayg	e70b9af3e4	dont overallocate ram when reading blobs from disk ReadFile checks the file size and allocates a bit more space than we expect we'll need. ReadAll uses Go's standard resizing algo, which doubles the underlying array each time you hit the end. So ReadAll ends up allocating 4MB for a full blob, while ReadFile allocates slightly over 2MB.	2020-11-27 16:18:26 -05:00
Alex Grintsvayg	659a6e73cc	use speedwalk for faster file listing	2020-11-04 16:03:47 -05:00
Alex Grintsvayg	aaae3ffa5b	remove afero fs abstraction in prep for using speedwalk	2020-11-04 16:03:47 -05:00
Alex Grintsvayg	7a3225434e	add test for DiskStore.list()	2020-11-04 16:03:45 -05:00
Alex Grintsvayg	3608971f0b	add lru cache eviction metric	2020-11-04 16:03:44 -05:00
Alex Grintsvayg	c9fa04043c	rename the stores, add caching to reflector cmd	2020-11-04 16:03:44 -05:00
Alex Grintsvayg	c6b53792c8	separate disk and lru behavior	2020-11-04 16:03:44 -05:00
Alex Grintsvayg	69fa06420b	LRU cache for disk store, abstract fs in disk store for testing	2020-11-04 16:03:43 -05:00
Niko Storni	47f28002ff	close unclosed handle reduce idle timeout for http3 update QUIC library	2020-07-10 15:19:57 +02:00
Niko Storni	5c91051b78	disable disk cleanup routine	2020-07-09 15:02:32 +02:00
Niko Storni	3ffe7a10c7	add other reflector store add flags improve disk cleanup	2020-07-09 15:02:32 +02:00
Andrey Beletsky	1bf3cb81b3	Use ModTime on systems that don't provide Atim file stat field	2020-07-09 15:02:32 +02:00
Niko Storni	4a5a148843	implement disk cleanup	2020-02-27 14:53:33 -05:00
Mark Beamer Jr	86a553b876	upgrade to lbry.go v2.4.0	2019-11-13 19:11:35 -05:00
Alex Grintsvayg	2ca83139df	use stream.Blob for BlobStore interface	2019-10-03 16:34:57 -04:00

18 commits