LBRYCommunity/reflector.go
1
0
Fork 0
Code Issues 7 Pull requests Projects Releases 10 Packages Wiki Activity

Commit graph

  • 7f5a89fa5a fix buffer cache running out of space Niko Storni 2020-11-22 04:04:44 +0100
  • 704e15f8c1 use LFUDA store Niko Storni 2020-11-21 01:39:50 +0100
  • 5eb1f13b54 add LFUDA store Niko Storni 2020-11-21 01:26:32 +0100
  • 176e05714e rename cahces Alex Grintsvayg 2020-11-20 15:01:33 -0500
  • eefd84b02d add buffer cache for nvme drive Niko Storni 2020-11-20 19:39:08 +0100
  • af2742c34f update quic Niko Storni 2020-11-18 05:03:02 +0100
  • 2a1557845d
         wrap blob insertion in tx. fixes lbryio/lbry-sdk#3296 insert_in_tx Alex Grintsvayg 2021-05-20 17:15:45 -0400
  • 9670bc14f8 fix unsafe dereference Niko Storni 2021-05-21 21:06:59 +0200
  • df881e16b5 add metrics Niko Storni 2021-05-21 19:09:02 +0200
  • bc889001bb update lbry.go dep Niko Storni 2021-05-21 18:05:37 +0200
  • 1ec2184833 upgrade singleflight Niko Storni 2021-05-21 17:58:33 +0200
  • 5cc1e84adb remove locks causing deadlocks Niko Storni 2021-05-21 05:53:13 +0200
  • a7086a00f3 add http server/client Niko Storni 2021-05-21 05:49:02 +0200
  • 76ece1e117
         Add queue to prevent writing too many files at once. Mark Beamer Jr 2021-05-20 20:43:01 -0400
  • c1caf1938c
         Add queue to prevent writing too many files at once. Mark Beamer Jr 2021-05-20 20:41:47 -0400
  • 213d21b021
         Add locks to disk store. Mark Beamer Jr 2021-05-20 19:59:50 -0400
  • 006b04f6e9 add a lot of extra heavy debugging Niko Storni 2021-05-21 01:48:46 +0200
  • 45130499cd
         Add single flight for cache not just origin Mark Beamer Jr 2021-05-20 19:05:48 -0400
  • 4ecce75e23
         add metric calls for other packages Mark Beamer Jr 2021-05-20 18:12:30 -0400
  • 0152300d8d
         add guage metrics for go routines in reflector package Mark Beamer Jr 2021-05-20 18:01:13 -0400
  • eafc62f2a6
         add gops to reflector server Mark Beamer Jr 2021-05-20 17:21:35 -0400
  • 50c077a9cb request queue size param Niko Storni 2021-05-20 23:17:18 +0200
  • 116a31fbef fix shared_test, add hostName field insert_under_tx Victor Shyba 2021-05-20 17:17:48 -0300
  • 734553dc2a insert stream blobs under a transaction Victor Shyba 2021-05-20 15:35:43 -0300
  • 13c6be981c make withTx part of SQL Victor Shyba 2021-05-20 15:14:56 -0300
  • 070938e12a increase window size Niko Storni 2021-05-06 22:53:18 +0200
  • c4084eeb68 improve disk cleanup Niko Storni 2021-04-29 03:41:18 +0200
  • 4392c97242 fix mess with lbry.go Niko Storni 2021-04-13 00:52:56 +0200
  • ec3aae33ba add if this than that store Niko Storni 2021-04-12 23:05:50 +0200
  • dc95351cf3 add integrity check cmd Niko Storni 2021-04-07 04:46:18 +0200
  • 25a7fac4f0
         use wait group not stopper Mark Beamer Jr 2021-04-06 14:28:29 -0400
  • b97595311f
         Wait for request to be handled before returning Mark Beamer Jr 2021-04-06 14:21:05 -0400
  • bd13836897
         Add request queue for blob cache Mark Beamer Jr 2021-04-06 14:00:36 -0400
  • 38b44218f2 check blobs when reading them Niko Storni 2021-04-05 23:34:45 +0200
  • 2cf4acdb59
         add 'send' command to efficiently send a file to reflector Alex Grintsvayg 2021-04-02 14:30:36 -0400
  • 90c36fbe24 upgrade quic-go Niko Storni 2021-03-31 04:53:27 +0200
  • 3a441aed3a fix issues caused by beamer's renaming Niko Storni 2021-03-29 19:56:18 +0200
  • ebb62d0a24 run go mod tidy Niko Storni 2021-03-29 19:44:27 +0200
  • 8cb7389619 make it simpler Niko Storni 2021-02-23 15:23:46 +0100
  • 7b49dd115b remove panics Niko Storni 2021-02-23 15:08:32 +0100
  • 6291e33ee1 add tracing to blobs Niko Storni 2021-01-09 05:08:20 +0100
  • 3e475e537b optimize batch insertions Niko Storni 2021-01-07 01:26:30 +0100
  • c4504631bc
         avoid heavy interpolateparams call Alex Grintsvayg 2021-01-06 10:43:35 -0500
  • cc504e6c44
         fix long query Alex Grintsvayg 2021-01-05 12:16:44 -0500
  • 49714c02a6
         only touch blobs when you get them Alex Grintsvayg 2021-01-05 11:36:33 -0500
  • b33651ae26 save uploaded blobs and work around the blocklist issue Niko Storni 2021-01-05 05:09:55 +0100
  • 0d5004a83b add cmd to populate db Niko Storni 2020-12-30 04:24:11 +0100
  • 04f6859c74 Merge branch 'grin' into litedb Niko Storni 2020-12-24 23:13:31 +0100
  • 3a1d9d3304
         something like this Alex Grintsvayg 2020-12-23 17:08:13 -0500
  • 03304312e8 add PoC for litedb to avoid all the overhead Niko Storni 2020-12-23 06:04:42 +0100
  • 869030fc58 address some review comments Niko Storni 2020-12-22 21:19:48 +0100
  • def551cc89 add option to run with RO-CF only as upstream Niko Storni 2020-12-22 20:53:48 +0100
  • 74b76a11e4 upgrade quic Niko Storni 2020-12-17 23:49:37 +0100
  • 2c0df2ca8a
         update lfuda library Niko Storni 2020-11-27 16:19:17 +0100
  • 9fc96ac01b
         only store the blobs in the underlying storage if LFUDA accepted them Niko Storni 2020-11-25 19:24:32 +0100
  • ff9b61b034
         fix cache size mess Niko Storni 2020-11-22 05:06:36 +0100
  • 7b80b2d4d2
         fix buffer cache running out of space Niko Storni 2020-11-22 04:04:44 +0100
  • d45abdbdb0
         use LFUDA store Niko Storni 2020-11-21 01:39:50 +0100
  • bc54601dde
         add LFUDA store Niko Storni 2020-11-21 01:26:32 +0100
  • bb41a84bb7
         rename cahces Alex Grintsvayg 2020-11-20 15:01:33 -0500
  • a574fecf4e
         add buffer cache for nvme drive Niko Storni 2020-11-20 19:39:08 +0100
  • 9146c8b084
         update quic Niko Storni 2020-11-18 05:03:02 +0100
  • 044e2fe5d7
         Merge branch 'fix_mem_leak' Alex Grintsvayg 2020-11-27 16:18:44 -0500
  • fb77bf621e
         dont over-allocate ram when reading blobs via QUIC Alex Grintsvayg 2020-11-21 12:07:47 -0500
  • e70b9af3e4
         dont overallocate ram when reading blobs from disk Alex Grintsvayg 2020-11-21 11:39:15 -0500
  • 5df05cf46f
         ensure autodeploy is off Alex Grintsvayg 2020-11-23 12:41:09 -0500
  • 6c071ca9bb
         simplify resolve call on wallet node better_wallet_node Alex Grintsvayg 2020-11-13 20:57:14 -0500
  • 7bddcf01b8
         Merge branch 'smarter_caches' Alex Grintsvayg 2020-11-04 16:04:16 -0500
  • 659a6e73cc
         use speedwalk for faster file listing Alex Grintsvayg 2020-11-02 14:48:56 -0500
  • aaae3ffa5b
         remove afero fs abstraction in prep for using speedwalk Alex Grintsvayg 2020-11-02 14:35:04 -0500
  • 131fed28d2
         add faster file.Walk fn. meant for DiskStore.list() Alex Grintsvayg 2020-10-30 15:01:56 -0400
  • 72571236ab
         clarify Get() error requirement Alex Grintsvayg 2020-10-29 14:22:58 -0400
  • 560e180e36
         separate singleflight cache wrapper, component names for cache metrics Alex Grintsvayg 2020-10-29 12:39:53 -0400
  • 070c378dfd
         apparently the normal check doesn't work Alex Grintsvayg 2020-10-28 15:15:35 -0400
  • 124d4065c2
         split cloudfront into RO and RW stores Alex Grintsvayg 2020-10-28 13:59:02 -0400
  • f131c1f35b
         add noop store that does nothing Alex Grintsvayg 2020-10-26 13:12:01 -0400
  • 7a3225434e
         add test for DiskStore.list() Alex Grintsvayg 2020-10-26 12:27:27 -0400
  • 3608971f0b
         add lru cache eviction metric Alex Grintsvayg 2020-10-22 13:49:02 -0400
  • c9fa04043c
         rename the stores, add caching to reflector cmd Alex Grintsvayg 2020-10-22 13:12:31 -0400
  • c6b53792c8
         separate disk and lru behavior Alex Grintsvayg 2020-10-22 12:18:31 -0400
  • 69fa06420b
         LRU cache for disk store, abstract fs in disk store for testing Alex Grintsvayg 2020-10-21 17:31:15 -0400
  • 5cb1365903 increase idle timeout Niko Storni 2020-10-19 23:42:40 +0200
  • e430c2fd40 bump go version Niko Storni 2020-10-15 03:43:03 +0200
  • 66024716ac
         Merge pull request #45 from lbryio/thundering_herd Niko 2020-10-15 03:16:34 +0200
  • f043516a14 revert upload changes Niko Storni 2020-10-15 03:08:27 +0200
  • c3db95a6c1 add more metrics Niko Storni 2020-10-15 02:59:12 +0200
  • 08c93d44fd update quic lib Niko Storni 2020-10-15 00:13:16 +0200
  • b02e80d472 ensure only single origin Get request is in flight per hash. protects against thundering herd. Alex Grintsvayg 2020-10-14 16:08:48 -0400
  • f1875454cc store uploaded blobs Niko Storni 2020-10-15 00:12:18 +0200
  • a80e0f5b0d
         change error msg Alex Grintsvayg 2020-10-06 10:17:50 -0400
  • 2b3581a692
         silence all those quic errors Alex Grintsvayg 2020-10-06 10:11:36 -0400
  • a0f78028cc
         handle the case where last_accessed_at is null Alex Grintsvayg 2020-10-06 09:39:43 -0400
  • a084330055
         drop mediainfo requirement since travis cant install it Alex Grintsvayg 2020-10-05 18:28:41 -0400
  • ea80ed6506
         install mediainfo during build Alex Grintsvayg 2020-10-05 18:22:33 -0400
  • 4b335ed692
         bumping to 1.15 for the quic-go dependency Alex Grintsvayg 2020-10-05 18:15:02 -0400
  • 6118dde36c
         Merge branch 'track_access' Alex Grintsvayg 2020-10-05 18:10:49 -0400
  • 8364d3fc54
         small changes for easier testing Alex Grintsvayg 2020-10-05 18:07:06 -0400
  • de0ccd4da7
         track approximate access time for blobs Alex Grintsvayg 2020-10-05 14:05:00 -0400
  • 31f9346027
         Merge branch 'publish_from_go' Alex Grintsvayg 2020-10-05 18:08:22 -0400
  • 5658fe4607
         add publish command Alex Grintsvayg 2020-01-08 22:12:40 -0500