Commit graph

117 commits

Author SHA1 Message Date
Jimmy Zelinskie 3e334b9536 storage: remove memorybysubnet
This code, while interesting, was only relevant to Facebook and they use
their own fork that they maintain. There was not enough outside
interest to warrant maintaining. I'd rather us use the effort to support
a redis storage backend instead.
2019-02-13 19:44:04 -05:00
Jimmy Zelinskie dc753b937c vendor: move to Go modules for dependencies
Fixes #444.
2019-02-12 20:36:25 -05:00
onestraw e83f68b952 storage/redis: add exiting info
Change-Id: I7876bf420a35b48314d14925f5f2ae591fa2d243
2019-01-28 15:18:21 +08:00
onestraw 9d22b67f74 storage/redis: use redis reply
Change-Id: If6e6c2545b12c249413d3d13ea41e127b8d1d9b0
2019-01-21 19:44:33 +08:00
onestraw fa19ffd050 add @mrd0ll4r 's comments
Change-Id: I53616703394f889fa2d0a4e952ac857d99c85218
2019-01-20 17:02:05 +08:00
onestraw f2ab706f10 fix hlen/hdel race condition
Change-Id: Ib82e6e9f0c66d2df80d68fd00e0c6ec6b46a037b
2019-01-16 19:09:39 +08:00
onestraw d65ab677e7 storage/redis: refactor redis storage
- Based on @duyanghao's PR
  - Make staticcheck pass
  - Address review commentsq
2019-01-04 13:58:20 +08:00
duyanghao e78892d5ac Add Support for Redis Storage Backend(To Achieve Chihaya High Availability)
Change-Id: I5cf703095d1060ac17e403b86056d3eccad97f2c
Signed-off-by: duyanghao <1294057873@qq.com>
2019-01-03 17:21:13 +08:00
onestraw e09d11e4b9 fix goimports error
Change-Id: I0f6e383ec1081cc47c690fdaab3fd35590a2634b
2018-12-17 16:59:44 +08:00
Justin Li 3c80ed8a8e Fix goimports violations 2018-10-24 09:25:03 -04:00
Justin Li d95120c817 Return []error from Stop() channel, allow recursive stop groups 2018-09-09 11:30:15 -04:00
Jimmy Zelinskie 84ee1d6658 storage/memorybysubnet: fix mispellings 2018-06-15 13:33:26 -04:00
Jimmy Zelinskie 3c052ec98d storage/memory: multi-line call to New() 2018-06-15 13:33:26 -04:00
Jimmy Zelinskie 7dbbc86380 middleware: add a registration model 2017-12-29 16:55:48 -05:00
Leo Balduf 6198491194 storage: document PeerStore in more detail 2017-12-02 22:41:56 +01:00
Leo Balduf 89bc479a3b *: make use of timecache 2017-10-15 20:05:39 +02:00
Leo Balduf b5dda16706 storage: stop peer store after tests 2017-09-13 03:47:19 +02:00
mrd0ll4r 4f4495f0f3 Merge pull request #350 from mrd0ll4r/benchmark-scrapes
storage: add Benchmarks for ScrapeSwarm, optimize implementations
2017-08-30 19:34:55 +02:00
Leo Balduf 5400a99b75 storage: add Benchmarks for ScrapeSwarm, optimize implementations 2017-08-30 08:54:11 +02:00
Leo Balduf 8ee8793867 storage: update benchmark config 2017-08-25 19:41:41 +02:00
Leo Balduf df7b59e2f3 storage: add PeerLifetime to test config 2017-08-17 23:35:20 +02:00
Leo Balduf 8ed171b0ea pkg/log: create wrapper around logrus 2017-06-26 20:46:40 +02:00
Leo Balduf 1aa6c86d3f storage: update config defaults 2017-06-25 19:04:24 +02:00
Jimmy Zelinskie dab03f52dc storage: share prometheus models
Running of the binary actually caused a panic due to multiple calling of
MustRegister(). This fixes that by sharing models in the storage
package.
2017-06-05 22:07:13 -04:00
Jimmy Zelinskie c41519e73f storage: sync memory & memorybysubnet
This change is a manual merge of all of the optimizations that have been
added to the memory peer store into the memorybysubnet peer store.

This also fixes some inconsistencies between the two.
2017-06-04 16:42:32 -04:00
Jimmy Zelinskie 7786e1a915 storage: enforce all peer stores are loggable 2017-06-04 16:06:01 -04:00
Jimmy Zelinskie 85d7d9c677 storage/memorybysubnet: bench with masks 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie acf7e3c749 storage: register unique Prometheus metrics names 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie 039f25f571 storage/memorybysubnet: add peerSubnet type 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie b013106f89 storage/memorybysubnet: delete empty subnet buckets 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie cb6a3be2ac storage/memorybysubnet: s/mask/preferredSubnet 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie d07b61d67d storage/memorybysubnet: replace range with len() 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie 370004a9f5 storage/memorybysubnet: clarify subnet bits _set_ 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie 9ce6c31021 storage/memorysubnet: allocate CIDRMask only once 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie 496cc1a31d storage: dynamically register drivers 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie 6fc3f618aa storage/memorybysubnet: add package docs 2017-06-03 15:45:41 -04:00
Jimmy Zelinskie bd02be6ab5 storage/memorybysubnet: fix TODOs 2017-06-03 15:45:41 -04:00
Jimmy Zelinskie 7f7c79bdf1 storage/memorybysubnet: init 2017-06-03 15:45:41 -04:00
Cedric Charly ce6706b0d5 storage/memory: set default prometheus_reporting_interval
When left blank in the config, the default prometheus_reporting_interval value
defaulted to 0, causing a panic during peer store initialization. This
change sets the default value to 1 if not provided.

Fixes #319
2017-06-03 14:21:39 -05:00
Leo Balduf a70d6dc036 memory: add metrics for peers 2017-05-29 19:04:40 +02:00
Leo Balduf 143ba54695 storage/memory: remove calls to time.Now() 2017-05-12 20:27:31 +02:00
Leo Balduf 71eb9fb767 storage/config: fix example config, add warning for missing shardCount 2017-05-12 13:16:39 +02:00
Jimmy Zelinskie cb55019ab8 *: add structured logging 2017-05-07 04:30:22 -04:00
Jimmy Zelinskie ea0dba3a3d cmd/chihaya: refactor root run command
This change refactors a bunch of the state of execution into its own
object. It also attempts to simplify stopping and adjusts some other
packages to integrate with the stopper interface.

Fixes #309.
2017-05-01 15:56:38 -04:00
Jimmy Zelinskie 74dde3f362 Merge pull request #284 from jzelinskie/promaf
prometheus: record IP AddressFamily
2017-02-03 11:45:56 -05:00
Jimmy Zelinskie a4b08c021b mv pkg/stopper pkg/stop
This makes most of the callsites stutter slightly less.
2017-02-02 21:09:25 -05:00
Jimmy Zelinskie 0e07b33827 prometheus: record IP AddressFamily 2017-02-02 19:19:33 -05:00
Leo Balduf 102b032c43 udp: fix ordering of scrapes 2017-01-30 13:07:14 +01:00
Leo Balduf 18d7e5d51b storage: add prometheus to memory implementation 2017-01-25 18:59:10 +01:00
Leo Balduf 3c098c0703 middleware: add sanitization hook 2017-01-20 20:29:59 +01:00