Commit graph

332 commits

Author SHA1 Message Date
Alex Grintsvayg
6c071ca9bb
simplify resolve call on wallet node 2020-11-14 21:14:55 -05:00
Alex Grintsvayg
7bddcf01b8
Merge branch 'smarter_caches'
* smarter_caches:
  use speedwalk for faster file listing
  remove afero fs abstraction in prep for using speedwalk
  add faster file.Walk fn. meant for DiskStore.list()
  clarify Get() error requirement
  separate singleflight cache wrapper, component names for cache metrics
  apparently the normal check doesn't work
  split cloudfront into RO and RW stores
  add noop store that does nothing
  add test for DiskStore.list()
  add lru cache eviction metric
  rename the stores, add caching to reflector cmd
  separate disk and lru behavior
  LRU cache for disk store, abstract fs in disk store for testing
2020-11-04 16:04:16 -05:00
Alex Grintsvayg
659a6e73cc
use speedwalk for faster file listing 2020-11-04 16:03:47 -05:00
Alex Grintsvayg
aaae3ffa5b
remove afero fs abstraction in prep for using speedwalk 2020-11-04 16:03:47 -05:00
Alex Grintsvayg
131fed28d2
add faster file.Walk fn. meant for DiskStore.list() 2020-11-04 16:03:47 -05:00
Alex Grintsvayg
72571236ab
clarify Get() error requirement 2020-11-04 16:03:46 -05:00
Alex Grintsvayg
560e180e36
separate singleflight cache wrapper, component names for cache metrics 2020-11-04 16:03:46 -05:00
Alex Grintsvayg
070c378dfd
apparently the normal check doesn't work 2020-11-04 16:03:46 -05:00
Alex Grintsvayg
124d4065c2
split cloudfront into RO and RW stores 2020-11-04 16:03:45 -05:00
Alex Grintsvayg
f131c1f35b
add noop store that does nothing 2020-11-04 16:03:45 -05:00
Alex Grintsvayg
7a3225434e
add test for DiskStore.list() 2020-11-04 16:03:45 -05:00
Alex Grintsvayg
3608971f0b
add lru cache eviction metric 2020-11-04 16:03:44 -05:00
Alex Grintsvayg
c9fa04043c
rename the stores, add caching to reflector cmd 2020-11-04 16:03:44 -05:00
Alex Grintsvayg
c6b53792c8
separate disk and lru behavior 2020-11-04 16:03:44 -05:00
Alex Grintsvayg
69fa06420b
LRU cache for disk store, abstract fs in disk store for testing 2020-11-04 16:03:43 -05:00
Niko Storni
5cb1365903 increase idle timeout 2020-10-19 23:42:40 +02:00
Niko Storni
e430c2fd40 bump go version 2020-10-15 03:43:03 +02:00
Niko
66024716ac
Merge pull request #45 from lbryio/thundering_herd
ensure only single origin Get request is in flight per hash. protects against thundering herd.
2020-10-15 03:16:34 +02:00
Niko Storni
f043516a14 revert upload changes 2020-10-15 03:08:27 +02:00
Niko Storni
c3db95a6c1 add more metrics
increase handshake timeout by 1 second
2020-10-15 02:59:12 +02:00
Niko Storni
08c93d44fd update quic lib 2020-10-15 00:13:16 +02:00
Alex Grintsvayg
b02e80d472 ensure only single origin Get request is in flight per hash. protects against thundering herd. 2020-10-15 00:12:31 +02:00
Niko Storni
f1875454cc store uploaded blobs 2020-10-15 00:12:18 +02:00
Alex Grintsvayg
a80e0f5b0d
change error msg 2020-10-06 10:17:50 -04:00
Alex Grintsvayg
2b3581a692
silence all those quic errors 2020-10-06 10:11:36 -04:00
Alex Grintsvayg
a0f78028cc
handle the case where last_accessed_at is null 2020-10-06 09:39:43 -04:00
Alex Grintsvayg
a084330055
drop mediainfo requirement since travis cant install it 2020-10-05 18:28:41 -04:00
Alex Grintsvayg
ea80ed6506
install mediainfo during build 2020-10-05 18:22:33 -04:00
Alex Grintsvayg
4b335ed692
bumping to 1.15 for the quic-go dependency 2020-10-05 18:15:02 -04:00
Alex Grintsvayg
6118dde36c
Merge branch 'track_access'
* track_access:
  small changes for easier testing
  track approximate access time for blobs
2020-10-05 18:10:49 -04:00
Alex Grintsvayg
8364d3fc54
small changes for easier testing 2020-10-05 18:08:54 -04:00
Alex Grintsvayg
de0ccd4da7
track approximate access time for blobs 2020-10-05 18:08:53 -04:00
Alex Grintsvayg
31f9346027
Merge branch 'publish_from_go'
* publish_from_go:
  add publish command
2020-10-05 18:08:22 -04:00
Alex Grintsvayg
5658fe4607
add publish command 2020-10-05 16:30:57 -04:00
Niko Storni
fc5f5ff7d3 add cloudfront support 2020-09-09 00:18:07 +02:00
Niko Storni
e8b98bc862 update dependencies 2020-09-01 20:15:34 +02:00
Niko Storni
f458529c74 fix memory leak? 2020-07-14 00:20:58 +02:00
Niko Storni
150b1f6f1f fix travis 2020-07-10 15:24:48 +02:00
Niko Storni
47f28002ff close unclosed handle
reduce idle timeout for http3
update QUIC library
2020-07-10 15:19:57 +02:00
Niko
beff466d18
Merge pull request #43 from lbryio/http3
Add/replace peer protocol with HTTP3/QUIC protocol
see previous commits for more details
2020-07-09 15:17:35 +02:00
Niko Storni
694bda105c add metrics 2020-07-09 15:02:32 +02:00
Niko Storni
34ca7847d0 return a better descriptive error when the blob isn't found 2020-07-09 15:02:32 +02:00
Niko Storni
5c91051b78 disable disk cleanup routine 2020-07-09 15:02:32 +02:00
Alex Grintsvayg
df4f42db82 successfully shut down wallet server 2020-07-09 15:02:32 +02:00
Alex Grintsvayg
41d758ef5c test wallet server connection 2020-07-09 15:02:32 +02:00
Niko Storni
264390a2b2 add debug code 2020-07-09 15:02:32 +02:00
Niko Storni
fdcc41829a handshake changes 2020-07-09 15:02:32 +02:00
Niko Storni
09c7718f30 refactor code 2020-07-09 15:02:32 +02:00
Niko Storni
8a5f57b14f remove QUIC protocol
add HTTP3/QUIC protocol
2020-07-09 15:02:32 +02:00
Niko Storni
90997b9918 use new connections for each blob 2020-07-09 15:02:32 +02:00