Victor Shyba
|
a4058b84ce
|
clean out unused sharding
|
2021-05-07 15:03:37 -03:00 |
|
Victor Shyba
|
7bf211a52b
|
apply reposted_claim_type on es sync
|
2021-05-07 15:03:37 -03:00 |
|
Victor Shyba
|
d5f722792f
|
fix and test has_source for channel reposts
|
2021-05-07 15:03:37 -03:00 |
|
Victor Shyba
|
0f02906c9b
|
fix has_source for reposted channels
|
2021-05-07 15:03:37 -03:00 |
|
Jack Robison
|
b5dfce7861
|
Revert "finished switch from using hash # in URLs to colon :"
This reverts commit 888aa558
|
2021-05-07 11:31:28 -04:00 |
|
Jack Robison
|
2ca5a65544
|
Revert "FindShortestID updated"
This reverts commit 8f04a50c
|
2021-05-07 11:30:31 -04:00 |
|
Jack Robison
|
32f7ecb261
|
fix invalid claim fees breaking the block processor
|
2021-05-06 11:18:58 -04:00 |
|
Jack Robison
|
21d0038ff2
|
add timestamps to hub log
|
2021-04-28 16:47:00 -04:00 |
|
Jack Robison
|
c094d8f2e8
|
add ALLOW_LAN_UDP hub setting
|
2021-04-28 16:47:00 -04:00 |
|
Jack Robison
|
c465d6a6c2
|
ignore udp packets with low source ports
|
2021-04-28 16:47:00 -04:00 |
|
Lex Berezhny
|
8f04a50ce1
|
FindShortestID updated
|
2021-04-28 16:21:01 -04:00 |
|
Lex Berezhny
|
888aa5586b
|
finished switch from using hash # in URLs to colon :
|
2021-04-28 16:21:01 -04:00 |
|
Victor Shyba
|
f0d334d3e2
|
refactor from review
|
2021-04-28 13:28:38 -03:00 |
|
Victor Shyba
|
5f829b048f
|
use separator to avoid cache key conflicts
|
2021-04-27 22:57:04 -03:00 |
|
Victor Shyba
|
1a961e66ff
|
invalidate short_id cache on new block
|
2021-04-27 22:57:04 -03:00 |
|
Victor Shyba
|
fdb0e22656
|
cache search_ahead
|
2021-04-27 22:57:04 -03:00 |
|
Victor Shyba
|
cc2852cd48
|
new implementation for limit_claims_per_channel
|
2021-04-14 18:32:16 -04:00 |
|
shubhendra
|
601f99ac16
|
Remove unnecessary generator
Signed-off-by: shubhendra <withshubh@gmail.com>
|
2021-04-06 21:22:27 -04:00 |
|
shubhendra
|
68399ca31c
|
Iterate dictionary directly
Signed-off-by: shubhendra <withshubh@gmail.com>
|
2021-04-06 21:22:27 -04:00 |
|
shubhendra
|
4725f510d8
|
Remove unnecessary use of comprehension
Signed-off-by: shubhendra <withshubh@gmail.com>
|
2021-04-06 21:22:27 -04:00 |
|
Victor Shyba
|
46dd389d0d
|
add elasticsearch service to gitlab
|
2021-03-30 17:00:15 -04:00 |
|
Jack Robison
|
7832c62c5d
|
add ELASTIC_HOST and ELASTIC_PORT settings to hub
|
2021-03-30 12:48:13 -04:00 |
|
Victor Shyba
|
aa727cb9b1
|
show channels regardless of no_source
|
2021-03-30 09:47:08 -04:00 |
|
Victor Shyba
|
b8c9a99f20
|
fix no_source for reposts
|
2021-03-30 09:47:08 -04:00 |
|
Lex Berezhny
|
aff995b0d0
|
temporary fix for mempool sync failing during reorg
|
2021-03-29 16:11:03 -04:00 |
|
Victor Shyba
|
5235a150b1
|
add prog name to sync arg parser
|
2021-03-24 17:07:17 -03:00 |
|
Victor Shyba
|
7df4cc44c4
|
fixes from review
|
2021-03-24 16:30:33 -03:00 |
|
Victor Shyba
|
7f5d88e95c
|
remove dead/broken/unused API
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
d09663c066
|
remove flush call
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
ef97c9b69f
|
torba-server -> hub
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
d855e6c8b1
|
move elasticsearch things into its own module
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
cd66f7eb43
|
if not no_totals, use default page size
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
a3e146dc68
|
sort on index time
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
b81305a4a9
|
index and allow has_source
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
73884b34bc
|
apply no_totals
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
6166a34db2
|
check cache item before locking
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
6fa7da4b1c
|
less slices
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
c3e426c491
|
fix search by channel for invalid channel
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
21e023f0db
|
fix search by channel
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
063be001b3
|
cache inner parsing
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
5dff02e8bc
|
on resolve, get all claims at once
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
60a59407d8
|
cache the encoded output instead
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
20a5aecfca
|
fix lib exception to asyncio TimeoutError
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
c2e7b5a67d
|
restore some of the interrupt metrics
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
8f32303d07
|
apply search timeout
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
891b1e7782
|
track results up to 200
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
f26394fd3b
|
report deletions on docs that doesnt exist, but dont raise
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
4d83d42b4c
|
fix equality instead of mod
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
57f1108df2
|
fix query being json serializable
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
2641a9abe5
|
make better resolve cache
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
6b193ab350
|
make indexing cooperative
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
b1bb37511c
|
use right key on cache
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
319187d6d6
|
log mempool task exceptions
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
02eb789f84
|
caching for resolve
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
eb6924277f
|
round time to 10 minutes and fetch referenced by id
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
bd8f371fd5
|
bump referenced rows query limit up
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
1783ff2845
|
dont delete claims on reorg
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
d388527ffa
|
log indexing errors
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
19494088bd
|
generate from queue
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
920dad524a
|
simplify sync and use asyncio Queue instead
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
ec89bcac8e
|
improve sync script for no-downtime maintenance
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
a916c1f4ad
|
check if db file exists before sync
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
a9a0ac92d7
|
ignore unset flag
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
da8a8bd1ef
|
filter+fts and tests for edge cases
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
67817005b5
|
check ES synced without a process and wait for ES
|
2021-03-19 19:58:13 -03:00 |
|
Jack Robison
|
24d11de5a7
|
torba-elastic-sync
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
e12fab90d1
|
docker compose update
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
0a194b5b01
|
claim_ids query
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
8d028adc53
|
be a writer by default
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
dfca15395e
|
claim id is also a keyword
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
e21f2362fe
|
apply reorg deletion as well
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
038a5f999f
|
cache encoded headers
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
5d3704c7ea
|
reader mode
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
87037c06c9
|
remove reader code
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
dd412c0f50
|
delete sqlite fts
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
bf44befff6
|
backport fixes from server
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
e61874bb6f
|
only repeat search if it has blocked items
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
ec9a3a4f7c
|
do not page filtered
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
e439a3a8dc
|
advanced resolve
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
19f70d7a11
|
create changelog trigger
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
afe7ed5b05
|
adjust size
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
d4bf004d74
|
use a thread pool to sync changes
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
e4d06a088b
|
include the channel being filtered/blocked
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
0929088b12
|
missing refresh step
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
7b4838fc9b
|
dont update more than 400 items a time
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
0cf9533248
|
narrow update by query
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
84ff0b8a9f
|
general timeout
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
d467dcfeaf
|
increase sync queue
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
8e68ba4751
|
fix join, refresh before update
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
0f2a85ba9f
|
simplify sync
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
7674a0a91e
|
backport fixes from testing server
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
5bc1a66572
|
32 slices and add censor type to fields
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
9b56067213
|
raise request timeout for content filtering
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
9a9df2fc3c
|
apply filtering only to whats unfiltered
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
9989d8d1d4
|
refresh after delete
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
f9471f297e
|
apply filter and block from ES script lang
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
146b693e4a
|
exclude title and description
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
e2441ea3e7
|
use prefix from ES docs
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
119e51912e
|
fix partial id
|
2021-03-19 19:58:13 -03:00 |
|
Victor Shyba
|
dd950f5b0d
|
tag can have empty space
|
2021-03-19 19:58:13 -03:00 |
|