51 commits

Author	SHA1	Message	Date
Jack Robison	b4853c5f67	fix merge conflicts and simplify extract_doc	2022-03-15 15:34:08 -03:00
Victor Shyba	08d635322e	implement blocking and filtering	2022-03-15 15:34:08 -03:00
Jack Robison	d1560ef09b	faster es sync	2022-03-15 15:34:07 -03:00
Jack Robison	7ad2234983	faster es sync	2022-03-15 15:34:07 -03:00
Jack Robison	a74434e269	imports	2022-03-15 15:34:07 -03:00
Jack Robison	92be63ff5b	close db in sync script	2022-03-15 15:34:07 -03:00
Jack Robison	2341667d04	update elastic sync	2022-03-15 15:34:07 -03:00
Jack Robison	89e7c8582e	invalidate channel signatures upon channel abandon	2022-03-15 15:34:07 -03:00
Jack Robison	5be04448ea	remove extra open functions	2022-03-15 15:34:07 -03:00
Jack Robison	6ea96e79bd	reposts	2022-03-15 15:34:07 -03:00
Jack Robison	9ad31008a5	fix updating the ES search index ... -update search index to use ResolveResult tuples	2022-03-15 15:34:07 -03:00
Jack Robison	966f47a5b1	bid ordered resolve, feed ES claim data from block processor	2022-03-15 15:34:07 -03:00
Victor Shyba	b64aa51c0c	fix stream_types being an integer	2021-09-10 18:57:20 -03:00
Victor Shyba	9e81dd2360	refactor arguments fixup	2021-09-10 18:57:20 -03:00
Victor Shyba	1c31ec66f2	simplify operator handling	2021-09-10 18:57:20 -03:00
Victor Shyba	21c71bfac1	update sync utility	2021-08-09 18:33:47 -03:00
Victor Shyba	43989122bb	add error type and message to error readme and update code	2021-08-09 15:07:44 -03:00
Victor Shyba	72712d6047	raise and disconnect if too many parameters are used on search	2021-08-09 15:07:44 -03:00
Victor Shyba	c591792de9	has_source is a special case	2021-07-22 16:25:55 -03:00
Victor Shyba	3108543ae5	3 missing fields	2021-07-22 16:25:55 -03:00
Victor Shyba	1eb221c743	translate reposted, signature_valid and normalized	2021-07-22 16:25:55 -03:00
Alex Grin	bebf6bc2e7	Update constants.py	2021-07-22 16:25:55 -03:00
Alex Grin	9e91cc2138	Update constants.py	2021-07-22 16:25:55 -03:00
Victor Shyba	5bd411ca27	filtering hash->id	2021-07-22 16:25:55 -03:00
Victor Shyba	a533cda6f0	ES: all _hash to _id	2021-07-22 16:25:55 -03:00
Lex Berezhny	e457b2f0d6	fix trending to use built-in sqlite instead of apsw	2021-06-15 18:22:42 -04:00
Lex Berezhny	c9cf7fd4d4	drop apsw in wallet.server.db.elasticsearch.sync	2021-06-15 18:22:42 -04:00
Victor Shyba	3974df4a62	fix interaction between two modes	2021-05-27 20:14:12 -03:00
Victor Shyba	ca28de02d8	test and implementation for remove_duplicates on post-search filtering	2021-05-27 20:14:12 -03:00
Victor Shyba	bfc15ea029	handle limit being 0 and skip reordering if 0/none	2021-05-27 20:14:12 -03:00
Victor Shyba	6e8b8a5920	always call search_ahead	2021-05-27 20:14:12 -03:00
Victor Shyba	ccadd88af5	fix cache call	2021-05-13 22:40:21 -03:00
Victor Shyba	cc02a0efc2	fix es migration bug, expand test case	2021-05-13 19:00:53 -03:00
Victor Shyba	43a1385b79	test sync helper	2021-05-13 19:00:53 -03:00
Jack Robison	eba0c9be34	fix typo	2021-05-07 16:51:19 -04:00
Jack Robison	81ebde88db	resync ES search index on version bumps ... -bump ES search index to version 1	2021-05-07 14:36:53 -04:00
Victor Shyba	7bf211a52b	apply reposted_claim_type on es sync	2021-05-07 15:03:37 -03:00
Victor Shyba	0f02906c9b	fix has_source for reposted channels	2021-05-07 15:03:37 -03:00
Victor Shyba	f0d334d3e2	refactor from review	2021-04-28 13:28:38 -03:00
Victor Shyba	5f829b048f	use separator to avoid cache key conflicts	2021-04-27 22:57:04 -03:00
Victor Shyba	1a961e66ff	invalidate short_id cache on new block	2021-04-27 22:57:04 -03:00
Victor Shyba	fdb0e22656	cache search_ahead	2021-04-27 22:57:04 -03:00
Victor Shyba	cc2852cd48	new implementation for limit_claims_per_channel	2021-04-14 18:32:16 -04:00
Victor Shyba	46dd389d0d	add elasticsearch service to gitlab	2021-03-30 17:00:15 -04:00
Jack Robison	7832c62c5d	add ELASTIC_HOST and ELASTIC_PORT settings to hub	2021-03-30 12:48:13 -04:00
Victor Shyba	aa727cb9b1	show channels regardless of no_source	2021-03-30 09:47:08 -04:00
Victor Shyba	b8c9a99f20	fix no_source for reposts	2021-03-30 09:47:08 -04:00
Victor Shyba	5235a150b1	add prog name to sync arg parser	2021-03-24 17:07:17 -03:00
Victor Shyba	7df4cc44c4	fixes from review	2021-03-24 16:30:33 -03:00
Victor Shyba	d09663c066	remove flush call	2021-03-19 19:58:13 -03:00