Handle elasticsearch becoming read only due to low disk space #14

New issue

Open

opened 2022-04-02 17:09:19 +02:00 by jackrobison · 0 comments

jackrobison commented

2022-04-02 17:09:19 +02:00

(Migrated from github.com)

The elastic sync service should handle ES temporarily becoming read only and recover when ES becomes writable, currently the failed queries are ignored:

2022-04-02 10:42:23,620 - scribe.service.ElasticSyncService - WARNING - indexing failed for an item: {'update': {'_index': 'claims', '_type': '_doc', '_id': '4023ca39b415cd916a304d71a3d528d8770f2ca5', 'status': 429, 'error': {'type': 'cluster_block_exception', 'reason': 'index [claims] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];'}}}

The elastic sync service should handle ES temporarily becoming read only and recover when ES becomes writable, currently the failed queries are ignored: ```2022-04-02 10:42:23,620 - scribe.service.ElasticSyncService - WARNING - indexing failed for an item: {'update': {'_index': 'claims', '_type': '_doc', '_id': '4023ca39b415cd916a304d71a3d528d8770f2ca5', 'status': 429, 'error': {'type': 'cluster_block_exception', 'reason': 'index [claims] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];'}}}```

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: LBRYCommunity/hub#14

No description provided.