1948 commits

Author	SHA1	Message	Date
Jack Robison	3c03fff380	logging, update lbry-rocksdb requirement	2022-02-22 13:09:57 -05:00
Jack Robison	b1441d4247	wait for writing to finish before closing the db	2022-02-22 13:09:57 -05:00
Jack Robison	81458b75e4	fix unwinding readers during reorg	2022-02-22 13:09:57 -05:00
Jack Robison	f0f8ef044b	reduce hub writer polling delay	2022-02-22 13:09:57 -05:00
Jack Robison	47305e7446	executors	2022-02-22 13:09:57 -05:00
Jack Robison	ba6b985d71	cleanup debug logging	2022-02-22 13:09:57 -05:00
Jack Robison	49802b39cb	rocksdb column families	2022-02-22 13:09:57 -05:00
Jack Robison	46bcc5d725	executors for each reader, fix shutdown	2022-02-22 13:09:57 -05:00
Jack Robison	98f8fd0556	tests	2022-02-22 13:09:57 -05:00
Jack Robison	c0ce27ccf3	es sync notifier	2022-02-22 13:09:57 -05:00
Jack Robison	cfae30a364	reader/writer move from cli	2022-02-22 13:09:57 -05:00
Jack Robison	53e3828965	remove redundant undo cleanup, don't delete historic touched_or_deleted	2022-02-22 13:09:57 -05:00
Jack Robison	4f16f1c829	imports, impove errors	2022-02-22 13:09:57 -05:00
Jack Robison	478bd0510b	es writer	2022-02-22 13:09:57 -05:00
Jack Robison	499ee74dfc	add chain reader and reader server, new mempool, update block processor	2022-02-22 13:09:57 -05:00
Jack Robison	d3da442727	update undo key to include the block hash	2022-02-22 13:09:57 -05:00
Jack Robison	358fa21eaf	move Prefetcher to own file	2022-02-22 13:09:57 -05:00
Jack Robison	20f35d02fa	move HubDB, delete leveldb.py	2022-02-22 13:09:57 -05:00
Jack Robison	77e64ef028	add mempool, trending, and touched address indexes to the hub db	2022-02-22 13:09:57 -05:00
Jack Robison	0a71e2ff91	use rocksdb instead of leveldb ... -dont use block processor directly from session manager	2022-02-22 13:09:57 -05:00
Victor Shyba	dd5b9ca81b	add migrator to set head blobs should_announce=0	2022-02-20 22:33:57 -03:00
Victor Shyba	ec0d9f06c5	do not search for the head blob	2022-02-20 22:33:57 -03:00
Victor Shyba	03b59ac6fc	dont set head blob to announce on save	2022-02-20 22:33:57 -03:00
Victor Shyba	43ac3336d7	break tie by length	2022-02-20 22:24:04 -03:00
Victor Shyba	d12c78db74	fix and test case for blob_clean after disabling network storage	2022-02-20 22:24:04 -03:00
Victor Shyba	bb60c385d5	put back all the peers, get rid of re_add	2022-02-08 21:41:52 -03:00
Alex Grintsvayg	7c7a0d4bdf	let stream_update work on non-stream claims	2022-02-08 09:28:17 -05:00
Jeffrey Picard	e0ea6383e2	Update __init__.py ... Update go hub binary to fix es sync test.	2022-02-04 12:17:19 -05:00
Lex Berezhny	cba9c16a06	fix	2022-02-04 12:07:41 -05:00
Lex Berezhny	dd68fb077b	prevent creation of change which is below the dust threshold of 1000 dewies	2022-02-04 12:07:41 -05:00
Victor Shyba	c0f512ace7	bump DHT peer manager cache to 16384	2022-02-02 16:54:42 -03:00
Victor Shyba	c9d637b4da	add gauge for queue size	2022-02-02 11:56:42 -03:00
Victor Shyba	ae3e8fadf5	count announcements and how many peers we were able to announce to	2022-02-02 11:56:42 -03:00
Eugene Dubinin	9b463a8cab	adds tests for guess_media_type ... removes unnecessary comments	2022-01-29 20:49:42 +02:00
Eugene Dubinin	babc54a240	adjusts code style	2022-01-29 15:25:17 +02:00
Eugene Dubinin	5836a93b21	fixes KeyError on missing synonyms	2022-01-29 15:25:17 +02:00
Eugene Dubinin	557348e345	detect media_type from the file contents	2022-01-29 15:25:17 +02:00
Lex Berezhny	3a496902f8	wallet locking/unlocking no longer breaks deterministic channel keys	2022-01-24 09:45:08 -05:00
Lex Berezhny	302461b446	updated based on code review	2022-01-17 11:08:28 -05:00
Lex Berezhny	ac201c718e	drop dependency on cryptography library in wallet module	2022-01-17 10:43:59 -05:00
Victor Shyba	0618053bd4	remove request_flight metric	2022-01-12 12:41:04 -03:00
Victor Shyba	fd9dcbf9a8	add granular metric for stored blob prefix, for network announcements calculation	2022-01-12 12:39:23 -03:00
Victor Shyba	beb8583436	change colliding bits metric to gauge	2022-01-12 12:39:23 -03:00
Victor Shyba	b44e2c0b38	count bit collisions between 8 and 16	2022-01-12 12:39:23 -03:00
Victor Shyba	06e94640b5	add counter for peers with colliding bytes	2022-01-12 12:39:23 -03:00
Victor Shyba	ff36bdc802	add requests in flight and error	2022-01-12 12:39:23 -03:00
Victor Shyba	46f576de46	add request received	2022-01-12 12:39:23 -03:00
Victor Shyba	7b09c34fce	add request_sent and request_time metric on dht	2022-01-12 12:39:23 -03:00
Victor Shyba	a22f50aa84	add storing_peers and peer_manager_keys	2022-01-12 12:39:23 -03:00
Victor Shyba	2d9130b4e0	prometheus: move blobs_stored and peers to SDK. add buckets_in_routing_table	2022-01-12 12:39:23 -03:00