8273 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Victor Shyba	f26394fd3b	report deletions on docs that doesnt exist, but dont raise	2021-03-19 19:58:13 -03:00
Victor Shyba	4d83d42b4c	fix equality instead of mod	2021-03-19 19:58:13 -03:00
Victor Shyba	57f1108df2	fix query being json serializable	2021-03-19 19:58:13 -03:00
Victor Shyba	2641a9abe5	make better resolve cache	2021-03-19 19:58:13 -03:00
Victor Shyba	6b193ab350	make indexing cooperative	2021-03-19 19:58:13 -03:00
Victor Shyba	b1bb37511c	use right key on cache	2021-03-19 19:58:13 -03:00
Victor Shyba	319187d6d6	log mempool task exceptions	2021-03-19 19:58:13 -03:00
Victor Shyba	02eb789f84	caching for resolve	2021-03-19 19:58:13 -03:00
Victor Shyba	5a9338a27f	use a dict on set_reference	2021-03-19 19:58:13 -03:00
Victor Shyba	eb6924277f	round time to 10 minutes and fetch referenced by id	2021-03-19 19:58:13 -03:00
Victor Shyba	325419404d	update dockerfile	2021-03-19 19:58:13 -03:00
Victor Shyba	bd8f371fd5	bump referenced rows query limit up	2021-03-19 19:58:13 -03:00
Victor Shyba	1783ff2845	dont delete claims on reorg	2021-03-19 19:58:13 -03:00
Victor Shyba	d388527ffa	log indexing errors	2021-03-19 19:58:13 -03:00
Victor Shyba	19494088bd	generate from queue	2021-03-19 19:58:13 -03:00
Victor Shyba	920dad524a	simplify sync and use asyncio Queue instead	2021-03-19 19:58:13 -03:00
Victor Shyba	ec89bcac8e	improve sync script for no-downtime maintenance	2021-03-19 19:58:13 -03:00
Victor Shyba	a916c1f4ad	check if db file exists before sync	2021-03-19 19:58:13 -03:00
Victor Shyba	a9a0ac92d7	ignore unset flag	2021-03-19 19:58:13 -03:00
Victor Shyba	da8a8bd1ef	filter+fts and tests for edge cases	2021-03-19 19:58:13 -03:00
Victor Shyba	d9c746891d	pin python3.7	2021-03-19 19:58:13 -03:00
Victor Shyba	67817005b5	check ES synced without a process and wait for ES	2021-03-19 19:58:13 -03:00
Jack Robison	24d11de5a7	torba-elastic-sync	2021-03-19 19:58:13 -03:00
Victor Shyba	9251c87323	refresh after sync	2021-03-19 19:58:13 -03:00
Victor Shyba	e12fab90d1	docker compose update	2021-03-19 19:58:13 -03:00
Victor Shyba	0a194b5b01	claim_ids query	2021-03-19 19:58:13 -03:00
Victor Shyba	8d028adc53	be a writer by default	2021-03-19 19:58:13 -03:00
Victor Shyba	dfca15395e	claim id is also a keyword	2021-03-19 19:58:13 -03:00
Victor Shyba	e21f2362fe	apply reorg deletion as well	2021-03-19 19:58:13 -03:00
Victor Shyba	1ce328e8a9	cache signature inspection	2021-03-19 19:58:13 -03:00
Victor Shyba	038a5f999f	cache encoded headers	2021-03-19 19:58:13 -03:00
Victor Shyba	5d3704c7ea	reader mode	2021-03-19 19:58:13 -03:00
Victor Shyba	87037c06c9	remove reader code	2021-03-19 19:58:13 -03:00
Victor Shyba	dd412c0f50	delete sqlite fts	2021-03-19 19:58:13 -03:00
Victor Shyba	bf44befff6	backport fixes from server	2021-03-19 19:58:13 -03:00
Victor Shyba	e61874bb6f	only repeat search if it has blocked items	2021-03-19 19:58:13 -03:00
Victor Shyba	1e5331768f	fix some of the tests	2021-03-19 19:58:13 -03:00
Victor Shyba	ec9a3a4f7c	do not page filtered	2021-03-19 19:58:13 -03:00
Victor Shyba	e439a3a8dc	advanced resolve	2021-03-19 19:58:13 -03:00
Victor Shyba	19f70d7a11	create changelog trigger	2021-03-19 19:58:13 -03:00
Victor Shyba	afe7ed5b05	adjust size	2021-03-19 19:58:13 -03:00
Victor Shyba	d4bf004d74	use a thread pool to sync changes	2021-03-19 19:58:13 -03:00
Victor Shyba	e4d06a088b	include the channel being filtered/blocked	2021-03-19 19:58:13 -03:00
Victor Shyba	0929088b12	missing refresh step	2021-03-19 19:58:13 -03:00
Victor Shyba	7b4838fc9b	dont update more than 400 items a time	2021-03-19 19:58:13 -03:00
Victor Shyba	0cf9533248	narrow update by query	2021-03-19 19:58:13 -03:00
Victor Shyba	84ff0b8a9f	general timeout	2021-03-19 19:58:13 -03:00
Victor Shyba	d467dcfeaf	increase sync queue	2021-03-19 19:58:13 -03:00
Victor Shyba	8e68ba4751	fix join, refresh before update	2021-03-19 19:58:13 -03:00
Victor Shyba	0f2a85ba9f	simplify sync	2021-03-19 19:58:13 -03:00