Commit graph

117 commits

Author SHA1 Message Date
Jimmy Zelinskie
3e334b9536 storage: remove memorybysubnet
This code, while interesting, was only relevant to Facebook and they use
their own fork that they maintain. There was not enough outside
interest to warrant maintaining. I'd rather us use the effort to support
a redis storage backend instead.
2019-02-13 19:44:04 -05:00
Jimmy Zelinskie
dc753b937c vendor: move to Go modules for dependencies
Fixes #444.
2019-02-12 20:36:25 -05:00
onestraw
e83f68b952 storage/redis: add exiting info
Change-Id: I7876bf420a35b48314d14925f5f2ae591fa2d243
2019-01-28 15:18:21 +08:00
onestraw
9d22b67f74 storage/redis: use redis reply
Change-Id: If6e6c2545b12c249413d3d13ea41e127b8d1d9b0
2019-01-21 19:44:33 +08:00
onestraw
fa19ffd050 add @mrd0ll4r 's comments
Change-Id: I53616703394f889fa2d0a4e952ac857d99c85218
2019-01-20 17:02:05 +08:00
onestraw
f2ab706f10 fix hlen/hdel race condition
Change-Id: Ib82e6e9f0c66d2df80d68fd00e0c6ec6b46a037b
2019-01-16 19:09:39 +08:00
onestraw
d65ab677e7 storage/redis: refactor redis storage
- Based on @duyanghao's PR
  - Make staticcheck pass
  - Address review commentsq
2019-01-04 13:58:20 +08:00
duyanghao
e78892d5ac Add Support for Redis Storage Backend(To Achieve Chihaya High Availability)
Change-Id: I5cf703095d1060ac17e403b86056d3eccad97f2c
Signed-off-by: duyanghao <1294057873@qq.com>
2019-01-03 17:21:13 +08:00
onestraw
e09d11e4b9 fix goimports error
Change-Id: I0f6e383ec1081cc47c690fdaab3fd35590a2634b
2018-12-17 16:59:44 +08:00
Justin Li
3c80ed8a8e Fix goimports violations 2018-10-24 09:25:03 -04:00
Justin Li
d95120c817 Return []error from Stop() channel, allow recursive stop groups 2018-09-09 11:30:15 -04:00
Jimmy Zelinskie
84ee1d6658 storage/memorybysubnet: fix mispellings 2018-06-15 13:33:26 -04:00
Jimmy Zelinskie
3c052ec98d storage/memory: multi-line call to New() 2018-06-15 13:33:26 -04:00
Jimmy Zelinskie
7dbbc86380 middleware: add a registration model 2017-12-29 16:55:48 -05:00
Leo Balduf
6198491194 storage: document PeerStore in more detail 2017-12-02 22:41:56 +01:00
Leo Balduf
89bc479a3b *: make use of timecache 2017-10-15 20:05:39 +02:00
Leo Balduf
b5dda16706 storage: stop peer store after tests 2017-09-13 03:47:19 +02:00
mrd0ll4r
4f4495f0f3 Merge pull request #350 from mrd0ll4r/benchmark-scrapes
storage: add Benchmarks for ScrapeSwarm, optimize implementations
2017-08-30 19:34:55 +02:00
Leo Balduf
5400a99b75 storage: add Benchmarks for ScrapeSwarm, optimize implementations 2017-08-30 08:54:11 +02:00
Leo Balduf
8ee8793867 storage: update benchmark config 2017-08-25 19:41:41 +02:00
Leo Balduf
df7b59e2f3 storage: add PeerLifetime to test config 2017-08-17 23:35:20 +02:00
Leo Balduf
8ed171b0ea pkg/log: create wrapper around logrus 2017-06-26 20:46:40 +02:00
Leo Balduf
1aa6c86d3f storage: update config defaults 2017-06-25 19:04:24 +02:00
Jimmy Zelinskie
dab03f52dc storage: share prometheus models
Running of the binary actually caused a panic due to multiple calling of
MustRegister(). This fixes that by sharing models in the storage
package.
2017-06-05 22:07:13 -04:00
Jimmy Zelinskie
c41519e73f storage: sync memory & memorybysubnet
This change is a manual merge of all of the optimizations that have been
added to the memory peer store into the memorybysubnet peer store.

This also fixes some inconsistencies between the two.
2017-06-04 16:42:32 -04:00
Jimmy Zelinskie
7786e1a915 storage: enforce all peer stores are loggable 2017-06-04 16:06:01 -04:00
Jimmy Zelinskie
85d7d9c677 storage/memorybysubnet: bench with masks 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie
acf7e3c749 storage: register unique Prometheus metrics names 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie
039f25f571 storage/memorybysubnet: add peerSubnet type 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie
b013106f89 storage/memorybysubnet: delete empty subnet buckets 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie
cb6a3be2ac storage/memorybysubnet: s/mask/preferredSubnet 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie
d07b61d67d storage/memorybysubnet: replace range with len() 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie
370004a9f5 storage/memorybysubnet: clarify subnet bits _set_ 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie
9ce6c31021 storage/memorysubnet: allocate CIDRMask only once 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie
496cc1a31d storage: dynamically register drivers 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie
6fc3f618aa storage/memorybysubnet: add package docs 2017-06-03 15:45:41 -04:00
Jimmy Zelinskie
bd02be6ab5 storage/memorybysubnet: fix TODOs 2017-06-03 15:45:41 -04:00
Jimmy Zelinskie
7f7c79bdf1 storage/memorybysubnet: init 2017-06-03 15:45:41 -04:00
Cedric Charly
ce6706b0d5 storage/memory: set default prometheus_reporting_interval
When left blank in the config, the default prometheus_reporting_interval value
defaulted to 0, causing a panic during peer store initialization. This
change sets the default value to 1 if not provided.

Fixes #319
2017-06-03 14:21:39 -05:00
Leo Balduf
a70d6dc036 memory: add metrics for peers 2017-05-29 19:04:40 +02:00
Leo Balduf
143ba54695 storage/memory: remove calls to time.Now() 2017-05-12 20:27:31 +02:00
Leo Balduf
71eb9fb767 storage/config: fix example config, add warning for missing shardCount 2017-05-12 13:16:39 +02:00
Jimmy Zelinskie
cb55019ab8 *: add structured logging 2017-05-07 04:30:22 -04:00
Jimmy Zelinskie
ea0dba3a3d cmd/chihaya: refactor root run command
This change refactors a bunch of the state of execution into its own
object. It also attempts to simplify stopping and adjusts some other
packages to integrate with the stopper interface.

Fixes #309.
2017-05-01 15:56:38 -04:00
Jimmy Zelinskie
74dde3f362 Merge pull request #284 from jzelinskie/promaf
prometheus: record IP AddressFamily
2017-02-03 11:45:56 -05:00
Jimmy Zelinskie
a4b08c021b mv pkg/stopper pkg/stop
This makes most of the callsites stutter slightly less.
2017-02-02 21:09:25 -05:00
Jimmy Zelinskie
0e07b33827 prometheus: record IP AddressFamily 2017-02-02 19:19:33 -05:00
Leo Balduf
102b032c43 udp: fix ordering of scrapes 2017-01-30 13:07:14 +01:00
Leo Balduf
18d7e5d51b storage: add prometheus to memory implementation 2017-01-25 18:59:10 +01:00
Leo Balduf
3c098c0703 middleware: add sanitization hook 2017-01-20 20:29:59 +01:00