LBRYCommunity/reflector.go
1
0
Fork 0
Code Issues 7 Pull requests Projects Releases 10 Packages Wiki Activity
419 commits 6 branches 14 tags 1.3 MiB
Commit graph

47 commits

Author SHA1 Message Date
Niko Storni
b4913ecedf cleanup 2021-07-24 01:03:51 +02:00
Niko Storni
2b458a6bd0 fix params 
more cleanups
 2021-07-24 01:03:51 +02:00
Niko Storni
febfc51cb0 refactor refactor refactor 2021-07-24 01:03:51 +02:00
Niko Storni
64acdc29c3 improve disk cleanup 
add index to is_stored
fix test
replace LRU cache
 2021-07-24 01:03:51 +02:00
Niko Storni
74925ebba2 optimize batch insertions 
reduce touch time to every 6 hours
 2021-07-24 01:03:47 +02:00
Alex Grintsvayg
6f95b3395f avoid heavy interpolateparams call 2021-07-24 01:03:47 +02:00
Alex Grintsvayg
dff00e2317 fix long query 2021-07-24 01:03:47 +02:00
Alex Grintsvayg
9a5d9d7ff5 only touch blobs when you get them 2021-07-24 01:03:47 +02:00
Niko Storni
35c713a26e add cmd to populate db 
fix store init
try fixing unreasonable db bottleneck
 2021-07-24 01:03:47 +02:00
Alex Grintsvayg
6fb0620091 something like this 2021-07-24 01:03:38 +02:00
Alex Grintsvayg
a0f78028cc
handle the case where last_accessed_at is null 2020-10-06 09:39:43 -04:00
Alex Grintsvayg
de0ccd4da7
track approximate access time for blobs 2020-10-05 18:08:53 -04:00
Mark Beamer Jr
86a553b876
upgrade to lbry.go v2.4.0 2019-11-13 19:11:35 -05:00
Alex Grintsvayg
3e006f1571
Revert "make new changes backwards-compatible while we migrate" 
This reverts commit 594a45a271.
 2019-07-30 18:03:56 -04:00
Alex Grintsvayg
594a45a271
make new changes backwards-compatible while we migrate 2019-07-10 11:28:56 -04:00
Alex Grintsvayg
fd39b09e95
use IDs instead of hashes for join table 2019-07-10 11:27:19 -04:00
Alex Grintsvayg
c3ab5dd2a5
log timed-out query 2019-06-27 15:34:12 -04:00
Alex Grintsvayg
2047fe6c05
maybe removing this transaction will improve the situation? 2019-06-27 15:30:38 -04:00
Alex Grintsvayg
6166ff37cf
retry timed-out queries 2019-06-26 14:36:05 -04:00
Alex Grintsvayg
71549c0dea
limit idle connections 2019-06-26 11:02:37 -04:00
Alex Grintsvayg
ad1eea1e8e
a bit of debugging 2019-06-25 09:13:25 -04:00
Alex Grintsvayg
dfb77d3547
bump up batch size to speed up querying 2019-06-25 08:44:37 -04:00
Alex Grintsvayg
14d6d32a41 move dht to lbry.go repo 2019-01-09 17:52:30 -05:00
Alex Grintsvayg
11ebfb822b started work on go blob primitives. successfully matched python's blob crypto (excluding canonical JSON) 2018-10-04 15:05:19 -04:00
Alex Grintsvayg
686ac662cc more common errors 2018-09-26 16:00:19 -04:00
Alex Grintsvayg
53d3eea8fb fixes from nikos review 2018-09-21 09:18:39 -04:00
Alex Grintsvayg
61e83d86de actually done now 2018-09-20 11:29:35 -04:00
Alex Grintsvayg
9fb824790b done, but NEEDS MIGRATION AND TESTING 2018-09-20 11:29:35 -04:00
Alex Grintsvayg
75886211b1 fix partial stream upload 2018-08-15 20:18:54 -04:00
Alex Grintsvayg
3855d5c281 actual proper fix for db statement issue, added skipExists flag and the ability to upload a single blob 2018-08-07 20:19:04 -04:00
Alex Grintsvayg
0e0b2aaea3 drop DB interface, attempt to fix max conn issues using interpolateParams 2018-08-07 16:51:36 -04:00
Alex Grintsvayg
baba10c54f statements must be closed, or it leaves them all open 2018-08-07 15:58:31 -04:00
Alex Grintsvayg
8bb1242ed9 fixed some linting errors 
found them using

```
gometalinter --skip=vendor --disable-all --enable=megacheck --enable=deadcode --enable=ineffassign --enable=interfacer --enable=errcheck ./...
```
 2018-08-07 11:38:56 -04:00
Alex Grintsvayg
6f8612d248 hash announcer / rate limiter 2018-07-26 16:05:27 -04:00
Alex Grintsvayg
8f395d8743 fix reflector responding correctly when we have the full stream. fixes lbryio/reflector-cluster#60 2018-07-26 10:25:47 -04:00
Alex Grintsvayg
7f6d7ac960 tmp for testing 2018-06-22 09:30:32 -04:00
Alex Grintsvayg
c8be55cfd7 better nodefinder logging 2018-06-22 09:30:16 -04:00
Alex Grintsvayg
385a24337a cluster automatically balances what nodes are announcing what hashes 2018-06-19 13:47:13 -04:00
Alex Grintsvayg
4535122a06 starting to put together the pieces 
- prism start command
- more configs for prism when assembling the pieces
- cluster notifies on membership change, determines hash range, announces hashes
 2018-06-14 22:30:38 -04:00
Mark Beamer Jr
35f98ce162 code cleanup 
-Added travis support
-updated travis to analyze code beneath the root.
-refactored upload.go to fix travis errors.
-gocyclo should ignore test files. $GOFILES needed to be adjusted.
-fix rows.Close() ignoring error. Created func to handle so defer can be used when needed also.
-fixed ignored errors.
-fixed unit test that was not passing correctly to anonymous function.
-fixed govet error for passing param inside go func.
-removed returned error, in favor of logging instead.
-added error logging for ignored error.
-fixed potential race conditions.
-removed unused append
-fixed time usage to align with go standards.
-removed unused variables
-made changes for code review.
-code comments for exported functions.
-Documented bitmap.go and insert into contact list.
-Documented dht, message, bootstrap
-Fixed comment typos
-Documented message,node, routing_table, testing in DHT package.
-Documented server, client, prism, server and shared in peer and reflector packages.
-Documented the stores in Store package.
-made defer adjustments inline and deleted the separate function.
-adjusted method in upload to take the only parameter it requires.
 2018-06-13 09:29:13 -04:00
Alex Grintsvayg
3b0a2df0ef added upload command, --conf and --verbose flags 2018-05-14 20:55:48 -04:00
Alex Grintsvayg
d989d42ad3 added dep, makefile 2018-03-01 16:28:25 -05:00
Alex Grintsvayg
0aee55d249 add sql txn where needed. closes lbryio/reflector-cluster#58 2018-03-01 16:28:25 -05:00
Alex Grintsvayg
32a27c4e4d new errors.go 2018-03-01 16:28:25 -05:00
Alex Grintsvayg
0d458aefc3 add a few tests, better error handling 2018-02-07 15:53:53 -05:00
Alex Grintsvayg
7b3ac43fff accepts full streams, stores them in db 2018-02-02 16:49:20 -05:00
Alex Grintsvayg
8c67da1852 correct peer protocol errors, add simple db store 2018-01-30 20:15:21 -05:00