LBRYCommunity/reflector.go
1
0
Fork 0
Code Issues 7 Pull requests Projects Releases 10 Packages Wiki Activity
430 commits 6 branches 14 tags 1.3 MiB
Commit graph

149 commits

Author SHA1 Message Date
Niko Storni
4a5a148843
implement disk cleanup 2020-02-27 14:53:33 -05:00
Alex Grintsvayg
d291c063ec
add traces to unmarshall errors 2020-02-25 15:49:51 -05:00
Alex Grintsvayg
50089481fb
switch to prometheus for metrics 2020-01-02 13:12:33 -05:00
Alex Grintsvayg
dc6dd8d12b
fix blocklist, log future blocklist errors, add resolve wallet server method 2019-12-28 19:17:52 -05:00
Andrey Beletsky
834733b675 Add options for peer.NewStore to allow for setting TCP timeout 2019-11-22 18:56:20 +07:00
Mark Beamer Jr
86a553b876
upgrade to lbry.go v2.4.0 2019-11-13 19:11:35 -05:00
Alex Grintsvayg
661c20a21d
make db-backed store more generic (not specific to s3) 2019-10-03 16:58:17 -04:00
Alex Grintsvayg
69f1e0f4ca
make MemoryStore consistent with the New...() pattern 2019-10-03 16:49:28 -04:00
Alex Grintsvayg
2ca83139df
use stream.Blob for BlobStore interface 2019-10-03 16:34:57 -04:00
Alex Grintsvayg
0af6d65d40
rename FileStore -> DiskStore 2019-10-03 16:24:59 -04:00
Alex Grintsvayg
a8230db802
rewrite getstream command using caching store 2019-10-03 16:13:08 -04:00
Alex Grintsvayg
c1e8e7481f
fix getstream command to write as it downloads (or else it runs out of memory) 2019-09-27 14:38:49 -04:00
Alex Grintsvayg
cb669eb1a7
add claim decode command 2019-09-11 14:35:25 -04:00
Alex Grintsvayg
08df3b167c
add getstream command to download a stream from a peer 2019-09-11 13:28:58 -04:00
Niko Storni
80f3b3437a re-enable reflector on new db 2019-08-20 01:26:23 +02:00
Niko Storni
68caed8a62 disable reflector for server replacement 2019-08-19 19:00:34 +02:00
Niko Storni
3823ee7a4e re-enable db 2019-08-08 19:49:32 +02:00
Niko Storni
5916ab4efd disable db temporarily 2019-08-08 18:42:46 +02:00
Niko Storni
227b362296 re-enable db 2019-08-07 21:32:00 +02:00
Niko Storni
8f280bf52f turn off db for instance resize 2019-08-07 20:39:27 +02:00
Alex Grintsvayg
f30401d7a6
Revert "disable db for migration" 
This reverts commit 83bb1791b4.
 2019-07-30 18:25:08 -04:00
Alex Grintsvayg
83bb1791b4
disable db for migration 2019-07-30 18:10:01 -04:00
Niko Storni
a2d51cee3d enable db 2019-07-10 20:59:52 +02:00
Alex Grintsvayg
fce8beea4d
dont try to connect to db when useDB is off 2019-07-10 09:39:21 -04:00
Niko Storni
96e0c2e2b2 temporarily turn off reflector 2019-07-10 15:22:00 +02:00
Niko
bb5df9896a
one more try 2019-07-06 02:31:13 -04:00
Niko
accd79c81f
turn off db again 2019-07-05 18:55:25 -04:00
Niko
32dae2704f
turn reflector back on 2019-07-05 17:21:04 -04:00
Alex Grintsvayg
d61f7c892f
off 2019-07-03 15:41:12 -04:00
Alex Grintsvayg
38401bf8d6
separate uploader into reusable component 2019-07-03 13:39:37 -04:00
Alex Grintsvayg
825e699114
turn db back on 2019-07-03 13:02:39 -04:00
Alex Grintsvayg
6509c7dc52
turn off db 2019-07-02 09:33:15 -04:00
Alex Grintsvayg
c088a65041
make it easy to turn the db on and off 2019-07-02 09:32:53 -04:00
Alex Grintsvayg
970585c75d
slight edit 2019-06-26 11:47:53 -04:00
Alex Grintsvayg
46ae5a502a
Revert "temporarily disable reflector and db" 
This reverts commit fb2f807e6a.
 2019-06-25 13:46:04 -04:00
Alex Grintsvayg
fb2f807e6a
temporarily disable reflector and db 2019-06-25 13:08:35 -04:00
Alex Grintsvayg
c649636eeb
better error when connection fails 2019-06-05 11:03:55 -04:00
Alex Grintsvayg
a98990f573
track peer errors as well 2019-02-08 14:56:41 -05:00
Alex Grintsvayg
05e0a506b4
better debug output 2019-01-29 14:42:45 -05:00
Alex Grintsvayg
a8fe33ecf4
this is how the daemon actually finds the reflector peer port 2019-01-29 14:33:55 -05:00
Alex Grintsvayg
030ed4914d
test reflector server 2019-01-29 14:28:40 -05:00
Alex Grintsvayg
609ebdb74e also run peer server on reflector 2019-01-16 09:54:47 -05:00
Alex Grintsvayg
75ad143d84 switch to lbry.go/stream 2019-01-10 08:02:43 -05:00
Alex Grintsvayg
14d6d32a41 move dht to lbry.go repo 2019-01-09 17:52:30 -05:00
Alex Grintsvayg
e3ae0ef5c9 minor 2018-12-26 18:36:04 -05:00
Alex Grintsvayg
dc104dd17b switch to go modules, drop testing against go master 2018-12-26 14:12:04 -05:00
Alex Grintsvayg
61e83d86de actually done now 2018-09-20 11:29:35 -04:00
Alex Grintsvayg
9fb824790b done, but NEEDS MIGRATION AND TESTING 2018-09-20 11:29:35 -04:00
Alex Grintsvayg
6fd0526376 beginning of blocklist support 2018-09-20 11:29:35 -04:00
Alex Grintsvayg
83921b8c2d bump timeout until lbryio/lbry#1377 is resolved 2018-09-17 12:14:17 -04:00
Alex Grintsvayg
cb386de4c7 bump stat freq to 1 hour 2018-09-04 09:49:54 -04:00
Alex Grintsvayg
7ab2d355d5 some linting 2018-08-30 20:20:15 -04:00
Alex Grintsvayg
25ec93a6b9 auto-self-update 2018-08-30 17:18:42 -04:00
Alex Grintsvayg
22f42d5559 include build time in binary 2018-08-30 14:41:50 -04:00
Alex Grintsvayg
605afd1d6c add stats reporting to reflector 2018-08-28 11:18:06 -04:00
Alex Grintsvayg
204198bf9d bump timeout to 30 seconds 2018-08-20 12:05:22 -04:00
Alex Grintsvayg
391f983630 bump timeout again 2018-08-15 16:12:55 -04:00
Alex Grintsvayg
bd8a35e366 expose reflector timeout, bump it up 2018-08-15 15:50:09 -04:00
Alex Grintsvayg
4284c3b1f9 sendblob command 2018-08-15 14:25:15 -04:00
Alex Grintsvayg
74cb72f197 slack us the logs 2018-08-15 11:10:38 -04:00
Alex Grintsvayg
5f9db51d67 add version 2018-08-15 10:34:50 -04:00
Alex Grintsvayg
73f3aceca6 fixed a few reflector issues, added some tests 2018-08-09 15:46:40 -04:00
Alex Grintsvayg
3855d5c281 actual proper fix for db statement issue, added skipExists flag and the ability to upload a single blob 2018-08-07 20:19:04 -04:00
Alex Grintsvayg
8bb1242ed9 fixed some linting errors 
found them using

```
gometalinter --skip=vendor --disable-all --enable=megacheck --enable=deadcode --enable=ineffassign --enable=interfacer --enable=errcheck ./...
```
 2018-08-07 11:38:56 -04:00
Alex Grintsvayg
d15245bd05 fix rpc server 2018-08-07 11:10:12 -04:00
Jack Robison
c967af4a98
more 
-add rpc_port argument
-run node on localhost for testing
 2018-07-17 17:19:03 -04:00
Alex Grintsvayg
620a5d7d48 handle peer port correctly 2018-07-13 13:31:54 -04:00
Jack Robison
63fe5cbdc8
add jack.lbry.tech as a known node for debugging 2018-07-13 11:24:11 -04:00
Jack Robison
bbe3bee3b0
add dht start command, run a jsonrpc server to interact with the node 2018-07-12 10:17:14 -04:00
Alex Grintsvayg
4c000ed419 grin's cleanup and some WIP 2018-07-10 17:35:02 -04:00
Alex Grintsvayg
34cc92678b partial switch to new stopgroup. need to refactor to take advantage of child cancelation 2018-06-25 16:49:40 -04:00
Alex Grintsvayg
ab9b6f27e5 correct node_finder to use loose parallelism 2018-06-25 15:48:57 -04:00
Alex Grintsvayg
e480fa146f fixed a few channel lockups, fixed announced port in dht, successfully announced and served a blob 2018-06-21 11:26:48 -04:00
Alex Grintsvayg
385a24337a cluster automatically balances what nodes are announcing what hashes 2018-06-19 13:47:13 -04:00
Alex Grintsvayg
4535122a06 starting to put together the pieces 
- prism start command
- more configs for prism when assembling the pieces
- cluster notifies on membership change, determines hash range, announces hashes
 2018-06-14 22:30:38 -04:00
Alex Grintsvayg
3e7f7583d6 move bitmap into separate package 2018-06-14 20:10:44 -04:00
Mark Beamer Jr
2edfc28398 Addressed code reviews. 2018-06-13 09:44:24 -04:00
Mark Beamer Jr
a2a0b27bc4 implemented stopper pattern 
-made defer adjustments inline and deleted the separate function.
-adjusted method in upload to take the only parameter it requires.
-Implemented stopper param for reflector server
-Aligned Cluster New to NewCluster
-Adjusted DHT to use StopAndWait
-Removed blocking waitgroup add
-Unified all components under prism.
-Moved defer done outside of functions.
-renamed NewCluster to New
-fixed travis errors.
 2018-06-13 09:36:44 -04:00
Mark Beamer Jr
35f98ce162 code cleanup 
-Added travis support
-updated travis to analyze code beneath the root.
-refactored upload.go to fix travis errors.
-gocyclo should ignore test files. $GOFILES needed to be adjusted.
-fix rows.Close() ignoring error. Created func to handle so defer can be used when needed also.
-fixed ignored errors.
-fixed unit test that was not passing correctly to anonymous function.
-fixed govet error for passing param inside go func.
-removed returned error, in favor of logging instead.
-added error logging for ignored error.
-fixed potential race conditions.
-removed unused append
-fixed time usage to align with go standards.
-removed unused variables
-made changes for code review.
-code comments for exported functions.
-Documented bitmap.go and insert into contact list.
-Documented dht, message, bootstrap
-Fixed comment typos
-Documented message,node, routing_table, testing in DHT package.
-Documented server, client, prism, server and shared in peer and reflector packages.
-Documented the stores in Store package.
-made defer adjustments inline and deleted the separate function.
-adjusted method in upload to take the only parameter it requires.
 2018-06-13 09:29:13 -04:00
Alex Grintsvayg
1075de77f5 started merging all components into one 2018-05-29 17:33:58 -04:00
Alex Grintsvayg
57a7c23787 update stopper 2018-05-24 13:05:05 -04:00
Alex Grintsvayg
ea67bb93d8 added routing table saving, bitmap operations, lots of tests 2018-05-19 13:06:19 -04:00
Alex Grintsvayg
8e128ea851 count errors too 2018-05-18 09:37:26 -04:00
Alex Grintsvayg
39914c8ab8 concurrency flags, fixes 2018-05-15 13:26:20 -04:00
Alex Grintsvayg
3b0a2df0ef added upload command, --conf and --verbose flags 2018-05-14 20:55:48 -04:00
Alex Grintsvayg
b87ec26359 update dependencies 2018-05-13 22:49:32 -04:00
Alex Grintsvayg
3b1ddd75fc added concurrent dht test 2018-05-13 21:17:29 -04:00
Alex Grintsvayg
2bf117b05f bootstrap node, bucket grooming 2018-05-13 17:33:49 -04:00
Alex Grintsvayg
01476a2a8d minor refactor 2018-05-01 16:18:38 -04:00
Alex Grintsvayg
9979a70c61 fix rt updates, add Ping method 2018-04-24 18:12:17 -04:00
Alex Grintsvayg
c337973c0f add token manager, add token to request/response, sucessfully perform a STORE request on the python daemon 2018-04-05 16:27:28 -04:00
Alex Grintsvayg
c254243716 more improvements 2018-04-05 11:35:57 -04:00
Alex Grintsvayg
13f991852b findNode and findValue implemented 2018-04-03 12:14:04 -04:00
Alex Grintsvayg
e68fc1dd00 dht iterativefind, some tests 2018-03-28 21:05:27 -04:00
Alex Grintsvayg
a7b4e4bc04 add transaction manager, fix bencoding to support int keys, fix routing table bucketing 2018-03-23 20:15:35 -04:00
Alex Grintsvayg
d989d42ad3 added dep, makefile 2018-03-01 16:28:25 -05:00
Alex Grintsvayg
0aee55d249 add sql txn where needed. closes lbryio/reflector-cluster#58 2018-03-01 16:28:25 -05:00
Alex Grintsvayg
d167213d54 use serf to track cluster members, update hash range on membership change. closes lbryio/reflector-cluster#47 2018-02-08 13:33:52 -05:00
Alex Grintsvayg
ca958c0711 cobra cli 2018-02-02 16:48:57 -05:00